-- Logs begin at Mon 2022-08-29 23:02:20 UTC, end at Tue 2022-08-30 00:18:55 UTC. -- Aug 29 23:36:49.770804 dv-cinder-854273-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 23:36:49.779851 dv-cinder-854273-4-smb devstack@keystone.service[93251]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 23:36:49 2022] *** Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: nodename: dv-cinder-854273-4-smb Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: machine: x86_64 Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: clock source: unix Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: pcre jit disabled Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: detected number of CPU cores: 4 Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: current working directory: / Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: detected binary path: /usr/bin/uwsgi-core Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: your processes number limit is 47680 Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: your memory page size is 4096 bytes Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: detected max file descriptor number: 2048 Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: lock engine: pthread robust mutexes Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: thunder lock: enabled Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 23:36:49.782612 dv-cinder-854273-4-smb devstack@keystone.service[93251]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 23:36:49.823335 dv-cinder-854273-4-smb devstack@keystone.service[93251]: Python main interpreter initialized at 0x563bf29ae9c0 Aug 29 23:36:49.823335 dv-cinder-854273-4-smb devstack@keystone.service[93251]: python threads support enabled Aug 29 23:36:49.823335 dv-cinder-854273-4-smb devstack@keystone.service[93251]: your server socket listen backlog is limited to 100 connections Aug 29 23:36:49.823335 dv-cinder-854273-4-smb devstack@keystone.service[93251]: your mercy for graceful operations on workers is 90 seconds Aug 29 23:36:49.823703 dv-cinder-854273-4-smb devstack@keystone.service[93251]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 23:36:49.823781 dv-cinder-854273-4-smb devstack@keystone.service[93251]: *** Operational MODE: preforking *** Aug 29 23:36:49.824040 dv-cinder-854273-4-smb devstack@keystone.service[93251]: *** uWSGI is running in multiple interpreter mode *** Aug 29 23:36:49.824040 dv-cinder-854273-4-smb devstack@keystone.service[93251]: spawned uWSGI master process (pid: 93251) Aug 29 23:36:49.824249 dv-cinder-854273-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 23:36:49.825377 dv-cinder-854273-4-smb devstack@keystone.service[93251]: spawned uWSGI worker 1 (pid: 93262, cores: 1) Aug 29 23:36:49.825377 dv-cinder-854273-4-smb devstack@keystone.service[93251]: spawned uWSGI worker 2 (pid: 93263, cores: 1) Aug 29 23:36:49.825377 dv-cinder-854273-4-smb devstack@keystone.service[93251]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 23:36:54.187680 dv-cinder-854273-4-smb devstack@keystone.service[93262]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:36:54.187680 dv-cinder-854273-4-smb devstack@keystone.service[93262]: from cryptography.utils import int_from_bytes Aug 29 23:36:54.188485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:36:54.188485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: from cryptography.utils import int_from_bytes Aug 29 23:36:54.188863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:36:54.188863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: from cryptography.utils import int_from_bytes Aug 29 23:36:54.189338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:36:54.189338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: from cryptography.utils import int_from_bytes Aug 29 23:36:54.238933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:36:54.239109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:36:54.239306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] command line args: [] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:36:54.239508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:36:54.239603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:36:54.239707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:36:54.239787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ================================================================================ {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:36:54.239900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] command line args: [] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:36:54.239980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] admin_token = **** {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.240171 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:36:54.240252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] config_dir = [] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.240349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ================================================================================ {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:36:54.240429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.240537 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] config_source = [] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.240614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] admin_token = **** {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.240715 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] debug = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.240838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] config_dir = [] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.240922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.241147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.241216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] config_source = [] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.241282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.241347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] debug = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.241412 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.241556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.241695 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.241808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.241917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.242015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.242109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] list_limit = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.242203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.242320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] log_config_append = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.242427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.242554 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.242660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] log_dir = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.242761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] list_limit = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.242863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] log_file = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.242991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] log_config_append = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.242991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.243194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.243321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] log_dir = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.243397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.243513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] log_file = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.243636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.243719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.243798 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.243873 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.243989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.244065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.244188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.244271 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.244346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.244462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.244536 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.244614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.244744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.244861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.244941 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.245064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.245140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.245268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.245390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.245467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.245590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.245671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.245802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.245900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.246073 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.246159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.246366 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.246553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.246689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.246766 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] publish_errors = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.246975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.247144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.247239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.247319 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] publish_errors = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.247438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.247548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.247675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.247803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.247883 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.247975 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.248048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] standard_threads = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.248179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.248278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.248412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.248490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.248624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.248708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] standard_threads = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.248804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] use_journal = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.248905 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.248985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] use_json = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.249095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.249220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] use_stderr = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.249303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.249386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] use_syslog = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.249471 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] use_journal = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.249545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.249622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] use_json = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.249747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.249829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] use_stderr = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.249908 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] use_syslog = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.249981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.250138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:36:54.250222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.250393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.250478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.250634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.250709 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.250894 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.250975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.251147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.251227 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.251380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.251467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.251623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.251709 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.251867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.251953 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.252102 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.252181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.252336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.252414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.252580 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.252659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.253377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.253477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.253628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.253712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.253874 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.253953 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.254109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.254188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.254358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.254442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.254606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.254683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.254846 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.254947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.255103 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.255192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.255353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.255432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.255602 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.255686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.255841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.255918 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.256084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.256163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.256315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.256400 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.256545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.256629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.256774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.256857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.257019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.257119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.257302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.257397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.257471 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.257539 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.257694 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.257774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.257919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.257995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.258162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.258248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.258401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.258492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.258629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.258706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.258872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.258983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.259126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.259211 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.259358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.259443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.259591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.259678 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.259819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.259896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.260045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.260129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.260276 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.260366 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.260508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.260586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.260739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.260818 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.260971 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.261063 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.261200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.261278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.261434 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.261514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.261679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.261809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.261902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.261961 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.262125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.262252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.262396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.262483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.262565 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.262639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.262789 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.262925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.263045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.263124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.263280 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.263368 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.263514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.263596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.263749 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.263836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.263976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.264055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.264209 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.264290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.264441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.264530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.264672 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.264751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.264899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.264989 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.265147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.265269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.265379 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.265459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.265609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.265688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.265843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.265920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.266077 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.266168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.266309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.266387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.266547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.266626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.266783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.266891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.267048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.267137 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.267281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.267360 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.267514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.267605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.267745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.267825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.267988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.268067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.268213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.268289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.268479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.268559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.268722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.268801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.268956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.269036 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.269192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.269278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.269424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.269502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.269656 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.269745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.269888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.269968 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.270119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.270200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.270352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.270431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.270586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.270671 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.270823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.270940 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.271090 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.271171 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.271327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.271407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.271561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.271640 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.271798 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.271884 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.272031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.272113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.272269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.272348 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.272500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.272581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.272729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.272816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.272957 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.273036 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.273184 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.273263 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.273415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.273494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.273631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.273714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.273861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.273953 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.274093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.274179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.274325 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.274404 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.274555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.274633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.274787 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.274900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.275060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.275141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.275299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.275378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.275526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] auth.external = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.275606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.275755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.275845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.276039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.276118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.276266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.276345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] auth.external = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.276495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] auth.password = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.276621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.276722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] auth.token = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.276802 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.276957 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.277045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.277188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.277268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] auth.password = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.277431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.277523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] auth.token = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.277659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.277747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.277900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.277979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.278140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.278221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.278367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.278455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.278599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] credential.caching = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.278679 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.278842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.278941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.279097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.279188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.279335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] credential.caching = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.279421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.279575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.279654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.279813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.279902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.280042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.280122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.280285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.280365 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.280526 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.280612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.280756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.280842 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.281003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.281081 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.281258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.281347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.281497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.281579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.281752 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.281832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.281989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.282139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.282246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.282326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.282479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] federation.caching = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.282559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.282712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.282800 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.282980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.283064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.283226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.283306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] federation.caching = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.283456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.283556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.283699 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.283781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.283932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.284013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.284190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.284281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.284427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.284507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.284664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.284743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.284897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.284985 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.285140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.285227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.285372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.caching = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.285452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.285614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.285702 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.285859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.285938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.286090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.286169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.caching = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.286322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.286410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.286567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.286647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.286796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.286901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.287052 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.287137 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.287302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.287407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.287536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.287656 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.287777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.287885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.288027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.288113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.288278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.288358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.288512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.288593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.288743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.288896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.288977 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.289050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.289208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.289290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.289456 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.289538 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.289708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.289795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.289965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.290047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.290197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.290277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.290427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.290508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.290661 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.290796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.290933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.291012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.291131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.291212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.291369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.291452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.291608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.291693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.291845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.291925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.292071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.292152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.292316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.292395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.292559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.292638 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.292790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.292871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.293031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.293110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.293274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.293362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.293502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.293584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.293737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.293817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.293966 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.294046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.294200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.294281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.294432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.294511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.294661 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.294740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.294937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.295023 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.295147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.295227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.295387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.295467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.295627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.295708 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.295854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.295933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.296082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.296208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.296327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.296409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.296560 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.296639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.296791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.296870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.297023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.297105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.297256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.297336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.297484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.297567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.297720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.297801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.297961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.298039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.298192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.298272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.298430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.298511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.298671 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.298751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.298928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.299022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.299169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.299249 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.299396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.299475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.300141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.300237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.300373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.300454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.300607 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.300685 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.300832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.300919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.301066 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.301145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.301303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.301383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.301534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.301623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.301774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.301853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.302016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.302095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.302244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.302332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.302485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.302565 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.302721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.302801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.302974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.303069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.303205 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.303285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.303435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.303515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.303668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.303755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.303904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.303984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.304135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.304221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.304377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.304464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.304603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.304682 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.304843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.304923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.305074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.305228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.305305 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.305384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.305527 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.305607 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.305766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.305864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.305999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.306080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.306226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.306305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.306459 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.306574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.306697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] resource.caching = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.306821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.306964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.307109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.307199 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.307327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.307432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.307569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] resource.caching = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.307677 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.307822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.307922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.308074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.308156 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.308318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.308397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.308569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.308650 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.308821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.308902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.309048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] role.caching = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.309127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.309292 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] role.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.309371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.309519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.309601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.309755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.309834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.309989 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] role.caching = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.310069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.310232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.310313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] role.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.310461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.310540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.310705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.310784 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.310973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.311059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.311217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.311297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.311461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.311554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.311691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.311772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.311935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.312015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.312179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.312265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.312419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.312498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.312648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.312726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.312896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.313040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.313143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.313274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.313390 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.313520 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.313637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.313767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.314011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.314090 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.314245 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.314323 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.314473 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.314561 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.314721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.314808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.314991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.315073 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.315288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.315884 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.316034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.316114 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.316275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.316354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.316505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.316593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.316750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.316831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.316979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.317058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.317212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.317301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.317458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.317537 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.317691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.317777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.317919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.318001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.318151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] token.caching = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.318252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.318383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.318494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.318628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.318729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.318860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.318986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.319134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.319214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] token.caching = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.319378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.319459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.319611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.319757 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.319834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.319908 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.320075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.320158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.320320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.320436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.320551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.320632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.320784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.320866 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.321014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.321094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.321258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.321337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.321530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.321611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.321758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.321847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.321998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.322079 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.322255 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.322334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.322510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.connection = **** {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.322597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.322752 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.322845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.323025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.323136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.323259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.323354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.323497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.323578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.connection = **** {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.323728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.323809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.323962 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.324052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.324194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.324276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.324427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.324508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.324668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.324824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.324903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.325067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.325147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.325312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.325393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.325551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.325634 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.325793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.325873 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.326030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.326109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.326255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.326377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.326491 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.326572 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.326722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.326803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.326905 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:36:54.326973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.327222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.327457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.327699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.327936 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:36:54.328109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:36:54.356228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.356370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.356443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.356516 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.356650 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.356737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.365454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.365552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.393641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.393793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.393881 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.393959 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.446655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.447420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.494917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.495151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.496044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.496279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.648419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.648646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.648872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.649095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.649315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.649400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.649531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.649625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.649825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.650045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.650261 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.650474 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.672875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.672987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.673111 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.673195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.673348 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.673464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.673553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.673619 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.673749 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.673839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.673963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.674056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.674176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.674259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.685730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.685930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.698424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.698602 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.698825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.698927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.699069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.699151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.699285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.699370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.699495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.699578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.699704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.699810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.699955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.700129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:36:54.716284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.716492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 23:36:54.716658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.716834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.716918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 23:36:54.717033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 23:36:54.717200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.717308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.717401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 23:36:54.717570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.717660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.717918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.718076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.718167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.718344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.718455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.728297 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.728578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.728690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.728849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.728964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.729132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.729244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.729413 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.736391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.736719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.739923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.740210 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.740302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.740494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.740581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.740770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.740858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.741057 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.741143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.741321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.741405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.741946 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.742013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.742085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.742150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.742150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.742257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.742491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.742664 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.742805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.743048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.743139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.765413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.765786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.766872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.767179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.767290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.767577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.771896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.772181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.772266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.772464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.772547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.772790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.778813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.779126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.779358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.779648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.783265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.783560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.783657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.783846 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.784427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.784662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.784745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.784949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.785032 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.785233 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.785316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.785504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.785587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.785783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.785867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.787818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.803708 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.803987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.804161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.804443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.807872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.808356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.811149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.811448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.811533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.811814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.815859 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.816990 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.819058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.820177 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.822295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.822595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.822897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.823192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.823339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.823481 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.823642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.823758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.823931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.824223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.824509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.824792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.839724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.840013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.840287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.840556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.840890 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.841183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.841456 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.841728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.848089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.849150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.849628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.850687 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.851207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.851485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.852519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.852669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.854122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.854408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.854809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.855119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.855334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.855418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.855881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.856176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.856465 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.856763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.867547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.867828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.868204 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.868487 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.868726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.868810 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.869013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.869104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.869295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.869378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.869576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.869857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.870136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.870426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.884894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.886031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.887847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.888979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.890736 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.892015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.892204 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.893988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.894433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.894755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.895094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.895547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.895834 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.896135 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.902154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.902748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.903675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.904249 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.906681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.907003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.907183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.907309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.907476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.907582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.907763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.908042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.916056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.916350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.916632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.916730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.916929 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.917214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.923615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.923902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.924068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:36:54.924184 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.924460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.924543 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.924759 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.924841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.925041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.925125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.925316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.925398 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.925592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.925681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.925868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.925950 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.926143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.926234 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.926417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.926501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.926678 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.926760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.926969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.927055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.927237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.927321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.927507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.927787 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:36:54.961815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563bf29ae9c0 pid: 93262 (default app) Aug 29 23:36:54.962222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563bf29ae9c0 pid: 93263 (default app) Aug 29 23:36:54.965057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660111a-e36c-4585-be7e-423ab1f6b0a8 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:54.965342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660111a-e36c-4585-be7e-423ab1f6b0a8 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:54.965614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660111a-e36c-4585-be7e-423ab1f6b0a8 None None] PATH_INFO: `/v3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:54.969767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 791 bytes} [Mon Aug 29 23:36:54 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:02.307012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc947e-e3c0-4141-ad1a-bd99caa2eaad None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:02.307536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc947e-e3c0-4141-ad1a-bd99caa2eaad None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:02.307652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc947e-e3c0-4141-ad1a-bd99caa2eaad None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:02.311967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1/2] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:02.317698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8940b50-7396-4460-af13-6d394daa7d2f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:02.318141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8940b50-7396-4460-af13-6d394daa7d2f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:02.318241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8940b50-7396-4460-af13-6d394daa7d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:02.388852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: INFO dbcounter [None req-e8940b50-7396-4460-af13-6d394daa7d2f None None] Registered counter for database keystone Aug 29 23:37:02.408037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG oslo_db.sqlalchemy.engines [None req-e8940b50-7396-4460-af13-6d394daa7d2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:37:02.414324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writer thread running {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:37:02.593313 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG passlib.handlers.bcrypt [None req-e8940b50-7396-4460-af13-6d394daa7d2f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93262) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 23:37:02.593620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG passlib.handlers.bcrypt [None req-e8940b50-7396-4460-af13-6d394daa7d2f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93262) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 23:37:02.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e8940b50-7396-4460-af13-6d394daa7d2f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:02.653145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e8940b50-7396-4460-af13-6d394daa7d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:02.782376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 2/3] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 23:37:03.277568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc947e-e3c0-4141-ad1a-bd99caa2eaad None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:03.348152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: INFO dbcounter [None req-e5bc947e-e3c0-4141-ad1a-bd99caa2eaad None None] Registered counter for database keystone Aug 29 23:37:03.369340 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG oslo_db.sqlalchemy.engines [None req-e5bc947e-e3c0-4141-ad1a-bd99caa2eaad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:37:03.375573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writer thread running {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:37:03.497332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc947e-e3c0-4141-ad1a-bd99caa2eaad None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:03.501510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19d8b1-6c13-4dd8-8157-7cd68de34409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:03.502128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19d8b1-6c13-4dd8-8157-7cd68de34409 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:03.502434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19d8b1-6c13-4dd8-8157-7cd68de34409 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:03.502708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19d8b1-6c13-4dd8-8157-7cd68de34409 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:03.510770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19d8b1-6c13-4dd8-8157-7cd68de34409 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:03.561756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fe19d8b1-6c13-4dd8-8157-7cd68de34409 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 23:37:03.562039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19d8b1-6c13-4dd8-8157-7cd68de34409 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:03.572091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Aug 29 23:37:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:37:03.578024 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8940b50-7396-4460-af13-6d394daa7d2f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:03.593018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8940b50-7396-4460-af13-6d394daa7d2f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:03.597502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7696ca4-1ef4-4dea-b39d-a91bbd0950c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:03.598632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7696ca4-1ef4-4dea-b39d-a91bbd0950c3 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:03.598939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7696ca4-1ef4-4dea-b39d-a91bbd0950c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:03.599220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7696ca4-1ef4-4dea-b39d-a91bbd0950c3 admin admin] PATH_INFO: `/v3/projects/959954cde09c4c1cb490e7a7a1c17381` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:03.600780 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7696ca4-1ef4-4dea-b39d-a91bbd0950c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=959954cde09c4c1cb490e7a7a1c17381)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:03.654204 dv-cinder-854273-4-smb devstack@keystone.service[93262]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c7696ca4-1ef4-4dea-b39d-a91bbd0950c3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 23:37:03.654554 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7696ca4-1ef4-4dea-b39d-a91bbd0950c3 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:03.659115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 3/5] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Aug 29 23:37:03 2022] GET /identity/v3/projects/959954cde09c4c1cb490e7a7a1c17381 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:05.536509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7037a-db4c-447b-852e-a5b90b8aa32a None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:05.537050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7037a-db4c-447b-852e-a5b90b8aa32a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:05.537050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7037a-db4c-447b-852e-a5b90b8aa32a None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:05.541151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 3/6] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:05.546440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4887bf-5882-4c82-b3fc-ff8ad2c16141 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:05.546851 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4887bf-5882-4c82-b3fc-ff8ad2c16141 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:05.547029 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4887bf-5882-4c82-b3fc-ff8ad2c16141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:05.567929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-ee4887bf-5882-4c82-b3fc-ff8ad2c16141 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:05.569448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ee4887bf-5882-4c82-b3fc-ff8ad2c16141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:05.577396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 23:37:05.845575 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7037a-db4c-447b-852e-a5b90b8aa32a None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:05.858378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7037a-db4c-447b-852e-a5b90b8aa32a None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:05.863246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332f881-a1da-415a-a9c9-d698b105592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:05.863845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f881-a1da-415a-a9c9-d698b105592d admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:05.864127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f881-a1da-415a-a9c9-d698b105592d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:05.864402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f881-a1da-415a-a9c9-d698b105592d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:05.871997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332f881-a1da-415a-a9c9-d698b105592d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:05.873769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332f881-a1da-415a-a9c9-d698b105592d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:05.882475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Aug 29 23:37:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:37:05.887888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4887bf-5882-4c82-b3fc-ff8ad2c16141 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:05.896921 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4887bf-5882-4c82-b3fc-ff8ad2c16141 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:05.901290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8260b20-35c4-4562-88f7-37222ce3b893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:05.901924 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8260b20-35c4-4562-88f7-37222ce3b893 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:05.902209 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8260b20-35c4-4562-88f7-37222ce3b893 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:05.902484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8260b20-35c4-4562-88f7-37222ce3b893 admin admin] PATH_INFO: `/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:05.903815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8260b20-35c4-4562-88f7-37222ce3b893 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c4ae54dfe2844c3bb1795a2873a02d4)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:05.905664 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8260b20-35c4-4562-88f7-37222ce3b893 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:05.907218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 5/9] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Aug 29 23:37:05 2022] GET /identity/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:07.874113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d3a94-85a0-4d15-b6d5-1b2e78a1a84e None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:07.874645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d3a94-85a0-4d15-b6d5-1b2e78a1a84e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:07.874729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d3a94-85a0-4d15-b6d5-1b2e78a1a84e None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:07.876055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 5/10] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:07.881751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371dc72-a3b6-4e26-bbbb-a15b688a7614 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:07.882160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371dc72-a3b6-4e26-bbbb-a15b688a7614 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:07.882314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371dc72-a3b6-4e26-bbbb-a15b688a7614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:07.894641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a038-455a-44e5-80c3-2983746dff19 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:07.894959 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a038-455a-44e5-80c3-2983746dff19 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:07.895236 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a038-455a-44e5-80c3-2983746dff19 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:07.896750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 6/11] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:37:07.901240 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-4371dc72-a3b6-4e26-bbbb-a15b688a7614 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:07.901349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8000f53-031c-48f5-81e7-179de445439c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:07.901621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8000f53-031c-48f5-81e7-179de445439c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:07.901891 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8000f53-031c-48f5-81e7-179de445439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:07.902435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4371dc72-a3b6-4e26-bbbb-a15b688a7614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:07.943489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG passlib.handlers.bcrypt [None req-b8000f53-031c-48f5-81e7-179de445439c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93263) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 23:37:07.943874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG passlib.handlers.bcrypt [None req-b8000f53-031c-48f5-81e7-179de445439c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93263) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 23:37:07.982163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 6/12] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:07.993493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-b8000f53-031c-48f5-81e7-179de445439c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:07.995140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b8000f53-031c-48f5-81e7-179de445439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:08.093978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 7/13] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:08.246996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371dc72-a3b6-4e26-bbbb-a15b688a7614 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:08.271532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:08.350704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371dc72-a3b6-4e26-bbbb-a15b688a7614 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:08.358187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8000f53-031c-48f5-81e7-179de445439c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:08.385235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2254213-64f4-4d2b-a23c-4c43cea65eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:08.385880 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2254213-64f4-4d2b-a23c-4c43cea65eed None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:08.386160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2254213-64f4-4d2b-a23c-4c43cea65eed None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:08.386441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2254213-64f4-4d2b-a23c-4c43cea65eed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:08.398626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2254213-64f4-4d2b-a23c-4c43cea65eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-c2254213-64f4-4d2b-a23c-4c43cea65eed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:08.407263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:08.408269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:08.411870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 7/14] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:37:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:08.414247 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2254213-64f4-4d2b-a23c-4c43cea65eed None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:08.465006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8000f53-031c-48f5-81e7-179de445439c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:08.467324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:08.496081 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:08.502931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d45d7c-0f11-45b4-b851-c697f374c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:08.503734 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d45d7c-0f11-45b4-b851-c697f374c047 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:08.504017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d45d7c-0f11-45b4-b851-c697f374c047 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:08.504292 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d45d7c-0f11-45b4-b851-c697f374c047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:08.514073 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2254213-64f4-4d2b-a23c-4c43cea65eed None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:08.547421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1f23-a545-4632-a30a-5ccc75d2fbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:08.548033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1f23-a545-4632-a30a-5ccc75d2fbc5 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:08.548316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1f23-a545-4632-a30a-5ccc75d2fbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:08.548588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1f23-a545-4632-a30a-5ccc75d2fbc5 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:08.549784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd1f23-a545-4632-a30a-5ccc75d2fbc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:08.550142 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd1f23-a545-4632-a30a-5ccc75d2fbc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:08.551563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd1f23-a545-4632-a30a-5ccc75d2fbc5 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:08.563730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 8/15] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:08.569469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1f23-a545-4632-a30a-5ccc75d2fbc5 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:08.575490 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d45d7c-0f11-45b4-b851-c697f374c047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:08.577009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d45d7c-0f11-45b4-b851-c697f374c047 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:08.671964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1f23-a545-4632-a30a-5ccc75d2fbc5 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:08.676355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 8/16] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:37:08.681968 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d45d7c-0f11-45b4-b851-c697f374c047 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:08.684716 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:08.706790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522020e-3599-420f-9d83-fa8784d487bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:08.713044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522020e-3599-420f-9d83-fa8784d487bf None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:08.713044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522020e-3599-420f-9d83-fa8784d487bf None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:08.713044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522020e-3599-420f-9d83-fa8784d487bf None admin] PATH_INFO: `/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:08.713044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522020e-3599-420f-9d83-fa8784d487bf None admin] RBAC: Authorizing `identity:get_user(user_id=8c4ae54dfe2844c3bb1795a2873a02d4)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:08.713044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522020e-3599-420f-9d83-fa8784d487bf None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:08.713044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 9/17] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:08 2022] GET /identity/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:08.717959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522020e-3599-420f-9d83-fa8784d487bf None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:08.733490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:08.785088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d45d7c-0f11-45b4-b851-c697f374c047 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:08.818222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522020e-3599-420f-9d83-fa8784d487bf None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:08.818670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9b8e1-9c5f-4028-a0fe-03ae87a02122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:08.819572 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9b8e1-9c5f-4028-a0fe-03ae87a02122 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:08.819857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9b8e1-9c5f-4028-a0fe-03ae87a02122 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:08.820133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9b8e1-9c5f-4028-a0fe-03ae87a02122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:08.838485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9b8e1-9c5f-4028-a0fe-03ae87a02122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:08.839974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9b8e1-9c5f-4028-a0fe-03ae87a02122 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:08.851998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dbff3-5291-423d-95a6-75982692c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:08.852629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dbff3-5291-423d-95a6-75982692c614 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:08.852910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dbff3-5291-423d-95a6-75982692c614 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:08.853189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dbff3-5291-423d-95a6-75982692c614 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:08.854313 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dbff3-5291-423d-95a6-75982692c614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:08.856072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dbff3-5291-423d-95a6-75982692c614 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:08.857621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 10/18] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-03d9b8e1-9c5f-4028-a0fe-03ae87a02122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:37:08.858541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:08.859454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:37:08.860307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:37:08.860307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:37:08.860307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:08.860307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 9/19] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:37:08.863866 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dbff3-5291-423d-95a6-75982692c614 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:08.865666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9b8e1-9c5f-4028-a0fe-03ae87a02122 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:08.920924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:08.943580 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:08.962082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dbff3-5291-423d-95a6-75982692c614 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:08.968046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9b8e1-9c5f-4028-a0fe-03ae87a02122 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:08.996878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358df2d1-86a3-4bb5-8c3c-2f527e347cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:08.997477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358df2d1-86a3-4bb5-8c3c-2f527e347cc3 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:08.997765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358df2d1-86a3-4bb5-8c3c-2f527e347cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:08.998043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358df2d1-86a3-4bb5-8c3c-2f527e347cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:08.999011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358df2d1-86a3-4bb5-8c3c-2f527e347cc3 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.domain.id=default, user.id=8c4ae54dfe2844c3bb1795a2873a02d4) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:08.999382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358df2d1-86a3-4bb5-8c3c-2f527e347cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:09.001479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358df2d1-86a3-4bb5-8c3c-2f527e347cc3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:09.003911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f31b0f-a903-47de-8d96-b2146104fd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:09.004535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f31b0f-a903-47de-8d96-b2146104fd95 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:09.004816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f31b0f-a903-47de-8d96-b2146104fd95 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:09.005089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f31b0f-a903-47de-8d96-b2146104fd95 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:09.005729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f31b0f-a903-47de-8d96-b2146104fd95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:09.006032 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f31b0f-a903-47de-8d96-b2146104fd95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:09.007434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f31b0f-a903-47de-8d96-b2146104fd95 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:09.008466 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 11/20] 10.222.0.73 () {56 vars in 1322 bytes} [Mon Aug 29 23:37:08 2022] GET /identity/v3/role_assignments?user.id=8c4ae54dfe2844c3bb1795a2873a02d4&scope.domain.id=default&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:09.026804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 10/21] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:11.249835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c10368-cb1e-4c4f-b3a6-7d356cfbba02 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:11.250863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c10368-cb1e-4c4f-b3a6-7d356cfbba02 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:11.251367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c10368-cb1e-4c4f-b3a6-7d356cfbba02 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:11.253432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 12/22] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:11.258791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bff0b-d3d1-45b6-bd28-a29a096fe029 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:11.259661 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bff0b-d3d1-45b6-bd28-a29a096fe029 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:11.260139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bff0b-d3d1-45b6-bd28-a29a096fe029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:11.285248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-112bff0b-d3d1-45b6-bd28-a29a096fe029 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:11.286777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-112bff0b-d3d1-45b6-bd28-a29a096fe029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:11.305410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c583a-75c3-4792-ba79-c730c89e3775 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:11.306028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c583a-75c3-4792-ba79-c730c89e3775 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:11.306491 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c583a-75c3-4792-ba79-c730c89e3775 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:11.308030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 13/23] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:37:11.313567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ce70d-5722-45f9-a1eb-cc058f263522 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:11.313847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ce70d-5722-45f9-a1eb-cc058f263522 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:11.314116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ce70d-5722-45f9-a1eb-cc058f263522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:11.345118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-128ce70d-5722-45f9-a1eb-cc058f263522 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:11.346336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-128ce70d-5722-45f9-a1eb-cc058f263522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:11.448426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 11/24] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:11.457527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601b249-0eae-452b-9992-dc2a8118297b None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:11.457813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601b249-0eae-452b-9992-dc2a8118297b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:11.458086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601b249-0eae-452b-9992-dc2a8118297b None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:11.459577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 12/25] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:37:11.464186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c6616-9109-4f94-b81e-b4aedb925751 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:11.464468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c6616-9109-4f94-b81e-b4aedb925751 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:11.464744 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c6616-9109-4f94-b81e-b4aedb925751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:11.499096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5a2c6616-9109-4f94-b81e-b4aedb925751 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:11.500334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5a2c6616-9109-4f94-b81e-b4aedb925751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:11.523201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 14/26] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:11.576939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:11.604586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 13/27] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:11.776737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5950bd6-76a6-49df-bdcf-75fb5e525621 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:11.776932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5950bd6-76a6-49df-bdcf-75fb5e525621 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:11.777432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5950bd6-76a6-49df-bdcf-75fb5e525621 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:11.778993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 15/28] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:11.785067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b8fda-e77d-49eb-b4ac-534fa860d49b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:11.785355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b8fda-e77d-49eb-b4ac-534fa860d49b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:11.785631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b8fda-e77d-49eb-b4ac-534fa860d49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:11.807270 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5e9b8fda-e77d-49eb-b4ac-534fa860d49b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:11.808477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5e9b8fda-e77d-49eb-b4ac-534fa860d49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:11.833343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5950bd6-76a6-49df-bdcf-75fb5e525621 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:11.948147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 14/29] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:11.949309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b8fda-e77d-49eb-b4ac-534fa860d49b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:11.995499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:12.063756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5950bd6-76a6-49df-bdcf-75fb5e525621 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:12.075113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b8fda-e77d-49eb-b4ac-534fa860d49b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:12.083775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:12.112669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c298ad-ffdd-4bfa-bcd2-e7e32fbd2c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:12.113717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c298ad-ffdd-4bfa-bcd2-e7e32fbd2c1a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:12.113959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c298ad-ffdd-4bfa-bcd2-e7e32fbd2c1a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:12.114227 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c298ad-ffdd-4bfa-bcd2-e7e32fbd2c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:12.129802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c298ad-ffdd-4bfa-bcd2-e7e32fbd2c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:12.131285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c298ad-ffdd-4bfa-bcd2-e7e32fbd2c1a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-a6c298ad-ffdd-4bfa-bcd2-e7e32fbd2c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:37:12.147839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:12.156468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:37:12.157246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:37:12.157246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:37:12.157246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:12.157408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de38bc-da1a-4405-9431-beb6994c83b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:12.157496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 16/30] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:37:12.157496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c298ad-ffdd-4bfa-bcd2-e7e32fbd2c1a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:12.157621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de38bc-da1a-4405-9431-beb6994c83b4 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:12.157621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de38bc-da1a-4405-9431-beb6994c83b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:12.157621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de38bc-da1a-4405-9431-beb6994c83b4 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:12.157621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de38bc-da1a-4405-9431-beb6994c83b4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:12.157621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de38bc-da1a-4405-9431-beb6994c83b4 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:12.266669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c298ad-ffdd-4bfa-bcd2-e7e32fbd2c1a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:12.315396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:12.324636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cede9d-c7b9-4cc5-862a-ce3b26a0b894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:12.325279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cede9d-c7b9-4cc5-862a-ce3b26a0b894 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:12.325561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cede9d-c7b9-4cc5-862a-ce3b26a0b894 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:12.325842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cede9d-c7b9-4cc5-862a-ce3b26a0b894 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:12.337310 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cede9d-c7b9-4cc5-862a-ce3b26a0b894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-82cede9d-c7b9-4cc5-862a-ce3b26a0b894 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:12.342370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:12.343196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:12.343956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 17/31] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:37:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:12.344556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cede9d-c7b9-4cc5-862a-ce3b26a0b894 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:12.394639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 15/32] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Aug 29 23:37:11 2022] POST /identity/v3/roles => generated 219 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:37:12.396290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de38bc-da1a-4405-9431-beb6994c83b4 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:12.503708 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cede9d-c7b9-4cc5-862a-ce3b26a0b894 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:12.545569 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef2663-617b-4203-b579-899ff2cf697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:12.545569 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef2663-617b-4203-b579-899ff2cf697a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:12.545851 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef2663-617b-4203-b579-899ff2cf697a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:12.547131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef2663-617b-4203-b579-899ff2cf697a None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:12.547131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef2663-617b-4203-b579-899ff2cf697a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:12.547131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef2663-617b-4203-b579-899ff2cf697a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:12.551008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef2663-617b-4203-b579-899ff2cf697a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:12.572508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 18/33] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:12.573096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef2663-617b-4203-b579-899ff2cf697a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:12.584638 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de38bc-da1a-4405-9431-beb6994c83b4 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:12.627440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d051585-ec82-4ce0-8913-bd6dc569ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:12.628065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d051585-ec82-4ce0-8913-bd6dc569ab3f None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:12.628349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d051585-ec82-4ce0-8913-bd6dc569ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:12.628625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d051585-ec82-4ce0-8913-bd6dc569ab3f None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:12.630850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d051585-ec82-4ce0-8913-bd6dc569ab3f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:12.632453 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d051585-ec82-4ce0-8913-bd6dc569ab3f None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:12.638791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:12.697963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef2663-617b-4203-b579-899ff2cf697a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:12.718118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 16/34] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Aug 29 23:37:12 2022] POST /identity/v3/roles => generated 225 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:37:12.719309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d051585-ec82-4ce0-8913-bd6dc569ab3f None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:12.757460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61e735-be35-480d-bb60-55b9392f70d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:12.764506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61e735-be35-480d-bb60-55b9392f70d2 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:12.764506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61e735-be35-480d-bb60-55b9392f70d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:12.764506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61e735-be35-480d-bb60-55b9392f70d2 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:12.764506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61e735-be35-480d-bb60-55b9392f70d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:12.764506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61e735-be35-480d-bb60-55b9392f70d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:12.764506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61e735-be35-480d-bb60-55b9392f70d2 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:12.768096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:12.779354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 19/35] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:12.786053 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61e735-be35-480d-bb60-55b9392f70d2 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:12.891233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d051585-ec82-4ce0-8913-bd6dc569ab3f None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:12.939018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61e735-be35-480d-bb60-55b9392f70d2 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:12.941257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfacba-2d7b-4af6-ac06-a47c57107969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:12.942989 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfacba-2d7b-4af6-ac06-a47c57107969 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:12.943518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfacba-2d7b-4af6-ac06-a47c57107969 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:12.943995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfacba-2d7b-4af6-ac06-a47c57107969 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:12.945164 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfacba-2d7b-4af6-ac06-a47c57107969 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:12.947491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfacba-2d7b-4af6-ac06-a47c57107969 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:12.949354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:12.977920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52ab23-9daf-4147-80ab-1281662213eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:12.978649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52ab23-9daf-4147-80ab-1281662213eb None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:12.978976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52ab23-9daf-4147-80ab-1281662213eb None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:12.979254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52ab23-9daf-4147-80ab-1281662213eb None admin] PATH_INFO: `/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:12.980704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52ab23-9daf-4147-80ab-1281662213eb None admin] RBAC: Authorizing `identity:get_user(user_id=8c4ae54dfe2844c3bb1795a2873a02d4)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:12.982137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52ab23-9daf-4147-80ab-1281662213eb None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:12.983729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 20/36] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:12 2022] GET /identity/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4 => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:12.984825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936edb-1b1c-47ae-9d93-7a7c764df912 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:12.985120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936edb-1b1c-47ae-9d93-7a7c764df912 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:12.985373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936edb-1b1c-47ae-9d93-7a7c764df912 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:12.987120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 21/37] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:12.991112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68936edb-1b1c-47ae-9d93-7a7c764df912 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:13.057502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 17/38] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:37:12 2022] POST /identity/v3/projects => generated 301 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:37:13.058918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af51cf-efbe-4949-ae60-c787ff36477a None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:13.059222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af51cf-efbe-4949-ae60-c787ff36477a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:13.059507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af51cf-efbe-4949-ae60-c787ff36477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:13.080117 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-65af51cf-efbe-4949-ae60-c787ff36477a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:13.081798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-65af51cf-efbe-4949-ae60-c787ff36477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:13.098586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68936edb-1b1c-47ae-9d93-7a7c764df912 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:13.142248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff646e6e-60c8-48b9-baf4-14652740d16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:13.142983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646e6e-60c8-48b9-baf4-14652740d16f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:13.143331 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646e6e-60c8-48b9-baf4-14652740d16f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:13.143671 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646e6e-60c8-48b9-baf4-14652740d16f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:13.145201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff646e6e-60c8-48b9-baf4-14652740d16f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:13.146413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff646e6e-60c8-48b9-baf4-14652740d16f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:13.153186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 22/39] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:13.153186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab5da8-c4fc-46e9-94f2-571a3c507a40 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:13.153186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab5da8-c4fc-46e9-94f2-571a3c507a40 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:13.153186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab5da8-c4fc-46e9-94f2-571a3c507a40 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:13.153186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 23/40] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:13.154013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab5da8-c4fc-46e9-94f2-571a3c507a40 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:13.169477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 18/41] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:13.184387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab3e94-875a-4967-8051-5ed89e6c734c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:13.184710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab3e94-875a-4967-8051-5ed89e6c734c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:13.185021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab3e94-875a-4967-8051-5ed89e6c734c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:13.210972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-38ab3e94-875a-4967-8051-5ed89e6c734c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:13.212650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-38ab3e94-875a-4967-8051-5ed89e6c734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:13.217300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:13.218428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:13.288446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab5da8-c4fc-46e9-94f2-571a3c507a40 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:13.295622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 19/42] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:13.328189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b71165-6c7e-4e6b-961c-9b93668eb52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:13.328858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b71165-6c7e-4e6b-961c-9b93668eb52c None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:13.329144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b71165-6c7e-4e6b-961c-9b93668eb52c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:13.329517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b71165-6c7e-4e6b-961c-9b93668eb52c None admin] PATH_INFO: `/v3/domains/default/users/8c4ae54dfe2844c3bb1795a2873a02d4/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:13.331553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b71165-6c7e-4e6b-961c-9b93668eb52c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8c4ae54dfe2844c3bb1795a2873a02d4, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:13.333019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b71165-6c7e-4e6b-961c-9b93668eb52c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:13.443185 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab3e94-875a-4967-8051-5ed89e6c734c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:13.529159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 24/43] 10.222.0.73 () {58 vars in 1361 bytes} [Mon Aug 29 23:37:13 2022] PUT /identity/v3/domains/default/users/8c4ae54dfe2844c3bb1795a2873a02d4/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:37:13.544788 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab3e94-875a-4967-8051-5ed89e6c734c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:13.571287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b71165-6c7e-4e6b-961c-9b93668eb52c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:13.584515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f003fbc-8781-4a3b-9337-db70ad0d425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:13.585159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f003fbc-8781-4a3b-9337-db70ad0d425f None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:13.585444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f003fbc-8781-4a3b-9337-db70ad0d425f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:13.585770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f003fbc-8781-4a3b-9337-db70ad0d425f None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:13.586454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f003fbc-8781-4a3b-9337-db70ad0d425f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:13.588021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f003fbc-8781-4a3b-9337-db70ad0d425f None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:13.670076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:13.676257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 20/44] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Aug 29 23:37:13 2022] POST /identity/v3/roles => generated 223 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:37:13.792508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b71165-6c7e-4e6b-961c-9b93668eb52c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:13.795253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:13.831046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa483a2-2963-4f88-989d-cf1fa87e44a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:13.832162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa483a2-2963-4f88-989d-cf1fa87e44a6 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:13.832162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa483a2-2963-4f88-989d-cf1fa87e44a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:13.832338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa483a2-2963-4f88-989d-cf1fa87e44a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:13.833560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa483a2-2963-4f88-989d-cf1fa87e44a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:13.835385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa483a2-2963-4f88-989d-cf1fa87e44a6 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:13.839835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 25/45] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:13.845451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f003fbc-8781-4a3b-9337-db70ad0d425f None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:13.948314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f003fbc-8781-4a3b-9337-db70ad0d425f None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:13.982240 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4617fd-7daa-461d-9317-b19d4e910c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:13.982854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4617fd-7daa-461d-9317-b19d4e910c15 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:13.983166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4617fd-7daa-461d-9317-b19d4e910c15 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:13.983441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4617fd-7daa-461d-9317-b19d4e910c15 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:13.984098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4617fd-7daa-461d-9317-b19d4e910c15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:13.985520 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4617fd-7daa-461d-9317-b19d4e910c15 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:14.091077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 21/46] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:37:13 2022] POST /identity/v3/projects => generated 312 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:37:15.416300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f42a4-b315-4013-a2f2-ecb213805d7c None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:15.416845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f42a4-b315-4013-a2f2-ecb213805d7c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:15.416845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f42a4-b315-4013-a2f2-ecb213805d7c None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:15.418253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 26/47] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:15.423495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6879bd-b01f-4d46-9822-97234de12e8f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:15.424389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6879bd-b01f-4d46-9822-97234de12e8f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:15.424569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6879bd-b01f-4d46-9822-97234de12e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:15.442641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5f6879bd-b01f-4d46-9822-97234de12e8f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:15.443850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5f6879bd-b01f-4d46-9822-97234de12e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:15.487798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:15.507849 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 22/48] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:15.777825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f42a4-b315-4013-a2f2-ecb213805d7c None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:15.878385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f42a4-b315-4013-a2f2-ecb213805d7c None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:15.911795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f14699-74fd-4dc4-9a44-5c83ad7fb966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:15.912426 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f14699-74fd-4dc4-9a44-5c83ad7fb966 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:15.912710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f14699-74fd-4dc4-9a44-5c83ad7fb966 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:15.912985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f14699-74fd-4dc4-9a44-5c83ad7fb966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:15.923424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f14699-74fd-4dc4-9a44-5c83ad7fb966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-59f14699-74fd-4dc4-9a44-5c83ad7fb966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:15.928889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:15.929860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:15.930593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 27/49] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:37:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:15.937063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6879bd-b01f-4d46-9822-97234de12e8f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:16.004301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2a541-0f5c-4dfa-8d8e-b76372b90169 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:16.004775 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2a541-0f5c-4dfa-8d8e-b76372b90169 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:16.005065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2a541-0f5c-4dfa-8d8e-b76372b90169 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:16.006431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 28/50] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:16.011251 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74901a-d5b7-412b-8ccc-68f6e46857db None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:16.011536 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74901a-d5b7-412b-8ccc-68f6e46857db None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:16.011814 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74901a-d5b7-412b-8ccc-68f6e46857db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:16.029808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-9a74901a-d5b7-412b-8ccc-68f6e46857db None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:16.031368 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9a74901a-d5b7-412b-8ccc-68f6e46857db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:16.043752 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6879bd-b01f-4d46-9822-97234de12e8f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:16.058136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:16.077356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a72595-17e8-494a-a48c-a1556bc7a720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:16.080569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a72595-17e8-494a-a48c-a1556bc7a720 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:16.080569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a72595-17e8-494a-a48c-a1556bc7a720 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:16.080569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a72595-17e8-494a-a48c-a1556bc7a720 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:16.080569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a72595-17e8-494a-a48c-a1556bc7a720 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:16.080569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a72595-17e8-494a-a48c-a1556bc7a720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:16.081066 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a72595-17e8-494a-a48c-a1556bc7a720 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:16.092749 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 23/51] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:16.098441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a72595-17e8-494a-a48c-a1556bc7a720 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:16.099189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 29/52] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:16.142551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:16.198011 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a72595-17e8-494a-a48c-a1556bc7a720 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:16.336916 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d73997-53c8-4afd-9f82-68460b57447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:16.337569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d73997-53c8-4afd-9f82-68460b57447e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:16.337848 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d73997-53c8-4afd-9f82-68460b57447e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:16.338119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d73997-53c8-4afd-9f82-68460b57447e None admin] PATH_INFO: `/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:16.339553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d73997-53c8-4afd-9f82-68460b57447e None admin] RBAC: Authorizing `identity:get_user(user_id=8c4ae54dfe2844c3bb1795a2873a02d4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:16.340984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d73997-53c8-4afd-9f82-68460b57447e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:16.342559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 24/53] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:16 2022] GET /identity/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4 => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:16.348806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74901a-d5b7-412b-8ccc-68f6e46857db None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:16.369934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d73997-53c8-4afd-9f82-68460b57447e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:16.453044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74901a-d5b7-412b-8ccc-68f6e46857db None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:16.469629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d73997-53c8-4afd-9f82-68460b57447e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:16.481157 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:16.488264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02584203-d357-4a92-8930-f9af4806b4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:16.488894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02584203-d357-4a92-8930-f9af4806b4cd None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:16.489171 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02584203-d357-4a92-8930-f9af4806b4cd None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:16.489446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02584203-d357-4a92-8930-f9af4806b4cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:16.490571 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02584203-d357-4a92-8930-f9af4806b4cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:16.492107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02584203-d357-4a92-8930-f9af4806b4cd None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:16.493710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 30/54] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:16.499614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02584203-d357-4a92-8930-f9af4806b4cd None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:16.504548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08190e74-64df-4e24-bc76-4627ce1f5eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:16.505350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08190e74-64df-4e24-bc76-4627ce1f5eef None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:16.509369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08190e74-64df-4e24-bc76-4627ce1f5eef None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:16.509369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08190e74-64df-4e24-bc76-4627ce1f5eef None admin] PATH_INFO: `/v3/domains/default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:16.509369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08190e74-64df-4e24-bc76-4627ce1f5eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:16.509369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08190e74-64df-4e24-bc76-4627ce1f5eef None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:16.510067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 25/55] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:16.515631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08190e74-64df-4e24-bc76-4627ce1f5eef None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:16.529413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:16.601354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02584203-d357-4a92-8930-f9af4806b4cd None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:16.614532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08190e74-64df-4e24-bc76-4627ce1f5eef None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:16.635993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aa78e-b4bb-49a8-94fa-16f94e28d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:16.636602 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa78e-b4bb-49a8-94fa-16f94e28d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:16.636993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa78e-b4bb-49a8-94fa-16f94e28d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:16.637238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa78e-b4bb-49a8-94fa-16f94e28d5d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:16.637944 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aa78e-b4bb-49a8-94fa-16f94e28d5d3 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.domain.id=default, user.id=8c4ae54dfe2844c3bb1795a2873a02d4) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:16.638255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aa78e-b4bb-49a8-94fa-16f94e28d5d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:16.639748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aa78e-b4bb-49a8-94fa-16f94e28d5d3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:16.646256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 31/56] 10.222.0.73 () {56 vars in 1322 bytes} [Mon Aug 29 23:37:16 2022] GET /identity/v3/role_assignments?user.id=8c4ae54dfe2844c3bb1795a2873a02d4&scope.domain.id=default&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:16.648994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a2b8a-b32d-478c-8db5-22081867d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:16.649617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2b8a-b32d-478c-8db5-22081867d07d None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:16.649903 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2b8a-b32d-478c-8db5-22081867d07d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:16.650179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2b8a-b32d-478c-8db5-22081867d07d None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:16.650835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a2b8a-b32d-478c-8db5-22081867d07d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:16.652323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a2b8a-b32d-478c-8db5-22081867d07d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:16.745647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 26/57] 10.222.0.73 () {60 vars in 1140 bytes} [Mon Aug 29 23:37:16 2022] POST /identity/v3/projects => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:37:18.650260 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56188259-773b-4320-9f0b-5f1ec7c27e28 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:18.650800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56188259-773b-4320-9f0b-5f1ec7c27e28 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:18.650800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56188259-773b-4320-9f0b-5f1ec7c27e28 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:18.652211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 32/58] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:18.657429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34127d0d-19fb-4b17-ac0f-8e9cb66d481f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:18.658332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34127d0d-19fb-4b17-ac0f-8e9cb66d481f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:18.658509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34127d0d-19fb-4b17-ac0f-8e9cb66d481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:18.676712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-34127d0d-19fb-4b17-ac0f-8e9cb66d481f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:18.677915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-34127d0d-19fb-4b17-ac0f-8e9cb66d481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:18.700660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:18.744643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 27/59] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:19.014634 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56188259-773b-4320-9f0b-5f1ec7c27e28 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:19.109742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:19.119300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56188259-773b-4320-9f0b-5f1ec7c27e28 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:19.159196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6b53d-3e78-4682-a8e2-8a051481a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:19.159820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b53d-3e78-4682-a8e2-8a051481a3df None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:19.160103 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b53d-3e78-4682-a8e2-8a051481a3df None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:19.160379 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b53d-3e78-4682-a8e2-8a051481a3df None admin] PATH_INFO: `/v3/domains/default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:19.161506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6b53d-3e78-4682-a8e2-8a051481a3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:19.163009 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6b53d-3e78-4682-a8e2-8a051481a3df None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:19.168651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 33/60] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:19.170273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34127d0d-19fb-4b17-ac0f-8e9cb66d481f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:19.263627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34127d0d-19fb-4b17-ac0f-8e9cb66d481f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:19.296279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa6ab7-6b16-411e-a26c-ec71d7b25009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:19.296817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa6ab7-6b16-411e-a26c-ec71d7b25009 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:19.297095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa6ab7-6b16-411e-a26c-ec71d7b25009 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:19.297367 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa6ab7-6b16-411e-a26c-ec71d7b25009 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:19.298009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa6ab7-6b16-411e-a26c-ec71d7b25009 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:19.299519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa6ab7-6b16-411e-a26c-ec71d7b25009 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:19.403292 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 28/61] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:37:19 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:37:22.372387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a8d46-31fd-4715-b4cc-04b165e1f528 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:22.373374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a8d46-31fd-4715-b4cc-04b165e1f528 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:22.373855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a8d46-31fd-4715-b4cc-04b165e1f528 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:22.375710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 34/62] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:22.381269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d864b8d-eae3-4101-a151-82b19ea36bd7 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:22.382200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d864b8d-eae3-4101-a151-82b19ea36bd7 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:22.382673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d864b8d-eae3-4101-a151-82b19ea36bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:22.411866 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-1d864b8d-eae3-4101-a151-82b19ea36bd7 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:22.413574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1d864b8d-eae3-4101-a151-82b19ea36bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:22.425391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:22.481464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f550a2c-69c4-4c16-8b35-a7ca39c5eac5 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:22.482103 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f550a2c-69c4-4c16-8b35-a7ca39c5eac5 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:22.482570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f550a2c-69c4-4c16-8b35-a7ca39c5eac5 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:22.484156 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 35/63] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:37:22.500518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b145c87-383c-4852-9df1-7dd4c60d237e None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:22.501082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b145c87-383c-4852-9df1-7dd4c60d237e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:22.501575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b145c87-383c-4852-9df1-7dd4c60d237e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:22.503325 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 29/64] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:22.535855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-1b145c87-383c-4852-9df1-7dd4c60d237e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:22.537298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1b145c87-383c-4852-9df1-7dd4c60d237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:22.640279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 36/65] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:22.768165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e9110-01de-40ac-bc5f-05934b346160 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:22.768786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e9110-01de-40ac-bc5f-05934b346160 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:22.769283 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e9110-01de-40ac-bc5f-05934b346160 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:22.770834 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 30/66] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:22.775998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3fad-4730-49a4-93ae-a3aabe8d0f6e None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:22.776286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3fad-4730-49a4-93ae-a3aabe8d0f6e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:22.776565 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3fad-4730-49a4-93ae-a3aabe8d0f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:22.803079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-628e3fad-4730-49a4-93ae-a3aabe8d0f6e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:22.804271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-628e3fad-4730-49a4-93ae-a3aabe8d0f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:22.824569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26339f5-d229-440c-9940-2564aadaa8a7 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:22.824886 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26339f5-d229-440c-9940-2564aadaa8a7 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:22.825131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26339f5-d229-440c-9940-2564aadaa8a7 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:22.826955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 31/67] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:37:22.831327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26339f5-d229-440c-9940-2564aadaa8a7 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:22.889337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 37/68] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:22.891425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3217c-ac21-4b42-8847-6baa4163670c None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:22.892455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3217c-ac21-4b42-8847-6baa4163670c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:22.892946 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3217c-ac21-4b42-8847-6baa4163670c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:22.913246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-51f3217c-ac21-4b42-8847-6baa4163670c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:22.914824 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-51f3217c-ac21-4b42-8847-6baa4163670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:22.935029 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:22.983832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26339f5-d229-440c-9940-2564aadaa8a7 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:22.996098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 38/69] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:22.997232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3217c-ac21-4b42-8847-6baa4163670c None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:23.038344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044dc2f-58c5-4a86-a287-508951ae6b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:23.039021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044dc2f-58c5-4a86-a287-508951ae6b88 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.039309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044dc2f-58c5-4a86-a287-508951ae6b88 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.039586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044dc2f-58c5-4a86-a287-508951ae6b88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.060073 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044dc2f-58c5-4a86-a287-508951ae6b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-f044dc2f-58c5-4a86-a287-508951ae6b88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:23.075362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:23.076247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:23.082530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 32/70] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:37:23.092263 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044dc2f-58c5-4a86-a287-508951ae6b88 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:23.110257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:23.114940 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3217c-ac21-4b42-8847-6baa4163670c None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:23.153355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bbeac-d22f-4b7a-88da-dd36ddddefe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:23.154315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bbeac-d22f-4b7a-88da-dd36ddddefe1 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.154796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bbeac-d22f-4b7a-88da-dd36ddddefe1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.155307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bbeac-d22f-4b7a-88da-dd36ddddefe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.166641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bbeac-d22f-4b7a-88da-dd36ddddefe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-e31bbeac-d22f-4b7a-88da-dd36ddddefe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:23.171862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:23.172700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:23.173500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:23.173500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:23.173500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:23.173500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:23.173500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:23.173500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:23.173500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:23.173500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:23.173500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:23.173500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:23.173500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:23.173500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:23.175723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 39/71] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:37:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:23.182143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bbeac-d22f-4b7a-88da-dd36ddddefe1 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:23.199427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:23.259231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044dc2f-58c5-4a86-a287-508951ae6b88 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:23.294446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bbeac-d22f-4b7a-88da-dd36ddddefe1 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:23.296106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcde2bf-3bba-403d-a95f-2afa0c7e9274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:23.296887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde2bf-3bba-403d-a95f-2afa0c7e9274 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.297165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde2bf-3bba-403d-a95f-2afa0c7e9274 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.297438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde2bf-3bba-403d-a95f-2afa0c7e9274 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.298187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcde2bf-3bba-403d-a95f-2afa0c7e9274 None admin] RBAC: Adding query filter params (name=member) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:23.298502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcde2bf-3bba-403d-a95f-2afa0c7e9274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:23.300092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcde2bf-3bba-403d-a95f-2afa0c7e9274 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:23.308948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 33/72] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:23.309675 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcde2bf-3bba-403d-a95f-2afa0c7e9274 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:23.336286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688ad2d-1295-4671-8a4c-4955d8345236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:23.336901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688ad2d-1295-4671-8a4c-4955d8345236 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.337183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688ad2d-1295-4671-8a4c-4955d8345236 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.337454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688ad2d-1295-4671-8a4c-4955d8345236 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.338144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688ad2d-1295-4671-8a4c-4955d8345236 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:23.338450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688ad2d-1295-4671-8a4c-4955d8345236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:23.339854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688ad2d-1295-4671-8a4c-4955d8345236 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:23.348348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 40/73] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:23.348348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa330-9af8-4670-b2fc-bc5c7a95de01 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.348348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa330-9af8-4670-b2fc-bc5c7a95de01 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.348348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa330-9af8-4670-b2fc-bc5c7a95de01 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.348348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 41/74] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:23.356074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aa330-9af8-4670-b2fc-bc5c7a95de01 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:23.385563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:23.418719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcde2bf-3bba-403d-a95f-2afa0c7e9274 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:23.431985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:23.453454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecddab-3421-4933-a60c-07d1a06bb2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:23.454092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecddab-3421-4933-a60c-07d1a06bb2a2 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.454371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecddab-3421-4933-a60c-07d1a06bb2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.454686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecddab-3421-4933-a60c-07d1a06bb2a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.457920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aa330-9af8-4670-b2fc-bc5c7a95de01 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:23.464858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecddab-3421-4933-a60c-07d1a06bb2a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-10ecddab-3421-4933-a60c-07d1a06bb2a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:23.470302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:23.471362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 34/75] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:23.476038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecddab-3421-4933-a60c-07d1a06bb2a2 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:23.492558 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16526a4-9be9-4e9a-ae29-d105e2b73f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:23.493193 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16526a4-9be9-4e9a-ae29-d105e2b73f11 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.493478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16526a4-9be9-4e9a-ae29-d105e2b73f11 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.493756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16526a4-9be9-4e9a-ae29-d105e2b73f11 None admin] PATH_INFO: `/v3/users/e791ee39a92340d6a13ec523db2e5b9b` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.508173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16526a4-9be9-4e9a-ae29-d105e2b73f11 None admin] RBAC: Authorizing `identity:get_user(user_id=e791ee39a92340d6a13ec523db2e5b9b)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:23.509626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16526a4-9be9-4e9a-ae29-d105e2b73f11 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:23.511302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 42/76] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:23 2022] GET /identity/v3/users/e791ee39a92340d6a13ec523db2e5b9b => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:23.512594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ace61-8da7-42fd-bd87-27c4b7ef369c None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.512886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ace61-8da7-42fd-bd87-27c4b7ef369c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.513164 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ace61-8da7-42fd-bd87-27c4b7ef369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.530701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-2d6ace61-8da7-42fd-bd87-27c4b7ef369c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:23.531952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2d6ace61-8da7-42fd-bd87-27c4b7ef369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:23.573272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecddab-3421-4933-a60c-07d1a06bb2a2 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:23.596585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 43/77] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:23.597584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ace61-8da7-42fd-bd87-27c4b7ef369c None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:23.607597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15b7e4-9244-4fca-bb48-9ec40666e29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:23.608227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15b7e4-9244-4fca-bb48-9ec40666e29e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.608509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15b7e4-9244-4fca-bb48-9ec40666e29e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.608782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15b7e4-9244-4fca-bb48-9ec40666e29e None admin] PATH_INFO: `/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.609907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15b7e4-9244-4fca-bb48-9ec40666e29e None admin] RBAC: Authorizing `identity:get_user(user_id=8c4ae54dfe2844c3bb1795a2873a02d4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:23.611880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15b7e4-9244-4fca-bb48-9ec40666e29e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:23.613454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 35/78] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:23 2022] GET /identity/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:23.614208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15b7e4-9244-4fca-bb48-9ec40666e29e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:23.615736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:23.678219 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:23.719235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ace61-8da7-42fd-bd87-27c4b7ef369c None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:23.725685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15b7e4-9244-4fca-bb48-9ec40666e29e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:23.757394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c3725-5b55-4dec-b791-245f649056e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:23.758028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c3725-5b55-4dec-b791-245f649056e4 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.758308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c3725-5b55-4dec-b791-245f649056e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.758591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c3725-5b55-4dec-b791-245f649056e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.769011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c3725-5b55-4dec-b791-245f649056e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:23.771353 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ad67f-0f5f-42c0-b17f-46d6c8cbe105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:23.772175 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ad67f-0f5f-42c0-b17f-46d6c8cbe105 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.772688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ad67f-0f5f-42c0-b17f-46d6c8cbe105 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.773137 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ad67f-0f5f-42c0-b17f-46d6c8cbe105 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-298c3725-5b55-4dec-b791-245f649056e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:23.773953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:23.774807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:23.775614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 44/79] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:37:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:23.776236 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ad67f-0f5f-42c0-b17f-46d6c8cbe105 None admin] RBAC: Adding query filter params (name=member) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:23.776301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c3725-5b55-4dec-b791-245f649056e4 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:23.776372 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ad67f-0f5f-42c0-b17f-46d6c8cbe105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:23.777407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ad67f-0f5f-42c0-b17f-46d6c8cbe105 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:23.786750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 36/80] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:23.791904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ad67f-0f5f-42c0-b17f-46d6c8cbe105 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:23.852607 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:23.888530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c3725-5b55-4dec-b791-245f649056e4 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:23.896959 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ad67f-0f5f-42c0-b17f-46d6c8cbe105 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:23.911487 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:23.922563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869b609-bdca-43ae-901b-ef0d32294f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:23.923211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869b609-bdca-43ae-901b-ef0d32294f16 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.923489 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869b609-bdca-43ae-901b-ef0d32294f16 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.923762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869b609-bdca-43ae-901b-ef0d32294f16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.931231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be37ce-8d5b-4998-be26-a1a213fbeeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:23.931783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be37ce-8d5b-4998-be26-a1a213fbeeaa None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:23.932060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be37ce-8d5b-4998-be26-a1a213fbeeaa None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:23.932332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be37ce-8d5b-4998-be26-a1a213fbeeaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:23.992057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869b609-bdca-43ae-901b-ef0d32294f16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:23.993560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869b609-bdca-43ae-901b-ef0d32294f16 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:23.998836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be37ce-8d5b-4998-be26-a1a213fbeeaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:24.000287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be37ce-8d5b-4998-be26-a1a213fbeeaa None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:24.055574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:24.091982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 45/81] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:24.092646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869b609-bdca-43ae-901b-ef0d32294f16 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:24.102451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 37/82] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:24.102451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be37ce-8d5b-4998-be26-a1a213fbeeaa None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:24.117262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:24.192574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869b609-bdca-43ae-901b-ef0d32294f16 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:24.197615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be37ce-8d5b-4998-be26-a1a213fbeeaa None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:24.225992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c162c2e-7bfe-4093-b393-794e7887b965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:24.226621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c162c2e-7bfe-4093-b393-794e7887b965 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:24.226929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c162c2e-7bfe-4093-b393-794e7887b965 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:24.227210 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c162c2e-7bfe-4093-b393-794e7887b965 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:24.227875 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c162c2e-7bfe-4093-b393-794e7887b965 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:24.228182 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c162c2e-7bfe-4093-b393-794e7887b965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:24.229559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c162c2e-7bfe-4093-b393-794e7887b965 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:24.231116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09783c0f-824a-4468-b6ab-91c17b2d1652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:24.231750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09783c0f-824a-4468-b6ab-91c17b2d1652 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:24.232040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09783c0f-824a-4468-b6ab-91c17b2d1652 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:24.232309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09783c0f-824a-4468-b6ab-91c17b2d1652 None admin] PATH_INFO: `/v3/users/e791ee39a92340d6a13ec523db2e5b9b` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:24.233443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09783c0f-824a-4468-b6ab-91c17b2d1652 None admin] RBAC: Authorizing `identity:get_user(user_id=e791ee39a92340d6a13ec523db2e5b9b)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:24.234868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09783c0f-824a-4468-b6ab-91c17b2d1652 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:24.236520 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 38/83] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:24 2022] GET /identity/v3/users/e791ee39a92340d6a13ec523db2e5b9b => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:24.237287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09783c0f-824a-4468-b6ab-91c17b2d1652 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:24.237998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 46/84] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:37:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:24.239783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c162c2e-7bfe-4093-b393-794e7887b965 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:24.266254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:24.323930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:24.339085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09783c0f-824a-4468-b6ab-91c17b2d1652 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:24.339948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c162c2e-7bfe-4093-b393-794e7887b965 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:24.372617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60e3a8-e7d9-4e5d-bd89-2797dc9c28a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:24.373253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60e3a8-e7d9-4e5d-bd89-2797dc9c28a6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:24.373450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1ae1e-e35b-4e3f-adf0-e64bc5c919e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:24.373589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60e3a8-e7d9-4e5d-bd89-2797dc9c28a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:24.373804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60e3a8-e7d9-4e5d-bd89-2797dc9c28a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:24.374076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1ae1e-e35b-4e3f-adf0-e64bc5c919e9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:24.374357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1ae1e-e35b-4e3f-adf0-e64bc5c919e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:24.374629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1ae1e-e35b-4e3f-adf0-e64bc5c919e9 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:24.374947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60e3a8-e7d9-4e5d-bd89-2797dc9c28a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:24.375804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1ae1e-e35b-4e3f-adf0-e64bc5c919e9 None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:24.376935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60e3a8-e7d9-4e5d-bd89-2797dc9c28a6 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:24.377770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1ae1e-e35b-4e3f-adf0-e64bc5c919e9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:24.378672 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 39/85] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:24.379303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60e3a8-e7d9-4e5d-bd89-2797dc9c28a6 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:24.379421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 47/86] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:24 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:24.380168 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1ae1e-e35b-4e3f-adf0-e64bc5c919e9 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:24.472080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:24.478129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1ae1e-e35b-4e3f-adf0-e64bc5c919e9 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:24.478545 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60e3a8-e7d9-4e5d-bd89-2797dc9c28a6 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:24.511375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebc203-4dd2-4fc7-b196-e7ed76bf5976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:24.511983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebc203-4dd2-4fc7-b196-e7ed76bf5976 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:24.512186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb6bc3-df5e-466a-9f1e-328c9f7c41d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:24.512288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebc203-4dd2-4fc7-b196-e7ed76bf5976 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:24.512526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebc203-4dd2-4fc7-b196-e7ed76bf5976 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:24.512815 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb6bc3-df5e-466a-9f1e-328c9f7c41d6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:24.513101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb6bc3-df5e-466a-9f1e-328c9f7c41d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:24.513374 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb6bc3-df5e-466a-9f1e-328c9f7c41d6 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:24.514495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb6bc3-df5e-466a-9f1e-328c9f7c41d6 None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:24.516055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb6bc3-df5e-466a-9f1e-328c9f7c41d6 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:24.518276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 40/87] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:24 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:24.519068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb6bc3-df5e-466a-9f1e-328c9f7c41d6 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:24.535058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:24.581188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebc203-4dd2-4fc7-b196-e7ed76bf5976 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:24.582659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebc203-4dd2-4fc7-b196-e7ed76bf5976 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:24.616797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb6bc3-df5e-466a-9f1e-328c9f7c41d6 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:24.650025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9902eaa-25ca-44b7-b5b1-8fcac450a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:24.650646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9902eaa-25ca-44b7-b5b1-8fcac450a368 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:24.650956 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9902eaa-25ca-44b7-b5b1-8fcac450a368 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:24.651232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9902eaa-25ca-44b7-b5b1-8fcac450a368 None admin] PATH_INFO: `/v3/users/e791ee39a92340d6a13ec523db2e5b9b` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:24.652342 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9902eaa-25ca-44b7-b5b1-8fcac450a368 None admin] RBAC: Authorizing `identity:get_user(user_id=e791ee39a92340d6a13ec523db2e5b9b)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:24.653746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9902eaa-25ca-44b7-b5b1-8fcac450a368 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:24.655345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 41/88] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:24 2022] GET /identity/v3/users/e791ee39a92340d6a13ec523db2e5b9b => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:24.656104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9902eaa-25ca-44b7-b5b1-8fcac450a368 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:24.686192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 48/89] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:24.686192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebc203-4dd2-4fc7-b196-e7ed76bf5976 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:24.687305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:24.737992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:24.756347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9902eaa-25ca-44b7-b5b1-8fcac450a368 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:24.786630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebc203-4dd2-4fc7-b196-e7ed76bf5976 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:24.791450 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83841dbf-78c7-4ad3-962a-919ff3013fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:24.792062 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83841dbf-78c7-4ad3-962a-919ff3013fca None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:24.792347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83841dbf-78c7-4ad3-962a-919ff3013fca None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:24.792624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83841dbf-78c7-4ad3-962a-919ff3013fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:24.793345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83841dbf-78c7-4ad3-962a-919ff3013fca None admin] RBAC: Adding query filter params (role.id=aaefcf4fc05547caa577d6f4db32e1b5, scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a, user.id=e791ee39a92340d6a13ec523db2e5b9b) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:24.793667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83841dbf-78c7-4ad3-962a-919ff3013fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:24.795124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83841dbf-78c7-4ad3-962a-919ff3013fca None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:24.803968 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 42/90] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:24 2022] GET /identity/v3/role_assignments?user.id=e791ee39a92340d6a13ec523db2e5b9b&scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a&role.id=aaefcf4fc05547caa577d6f4db32e1b5 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:24.815098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83841dbf-78c7-4ad3-962a-919ff3013fca None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:24.821208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec5486-1317-4e33-805e-867609f7b2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:24.821854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec5486-1317-4e33-805e-867609f7b2fa None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:24.822124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec5486-1317-4e33-805e-867609f7b2fa None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:24.822395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec5486-1317-4e33-805e-867609f7b2fa None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:24.823093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec5486-1317-4e33-805e-867609f7b2fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:24.824619 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec5486-1317-4e33-805e-867609f7b2fa None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:24.912496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 49/91] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:37:24 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:37:24.913604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec5486-1317-4e33-805e-867609f7b2fa None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:24.939542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:24.952169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83841dbf-78c7-4ad3-962a-919ff3013fca None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:25.005686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0d2dd-104c-4ad2-bddd-18ddf5766374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:25.006856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0d2dd-104c-4ad2-bddd-18ddf5766374 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:25.007391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0d2dd-104c-4ad2-bddd-18ddf5766374 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:25.008064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0d2dd-104c-4ad2-bddd-18ddf5766374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:25.009452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0d2dd-104c-4ad2-bddd-18ddf5766374 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a, user.id=8c4ae54dfe2844c3bb1795a2873a02d4) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:25.010204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0d2dd-104c-4ad2-bddd-18ddf5766374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:25.011897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0d2dd-104c-4ad2-bddd-18ddf5766374 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:25.021138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 43/92] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:24 2022] GET /identity/v3/role_assignments?user.id=8c4ae54dfe2844c3bb1795a2873a02d4&scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:25.022715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0d2dd-104c-4ad2-bddd-18ddf5766374 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:25.060302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec5486-1317-4e33-805e-867609f7b2fa None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:25.072808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:25.114985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51522aae-f4d1-476a-bca6-6c7909b59ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:25.115197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522aae-f4d1-476a-bca6-6c7909b59ae0 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:25.115492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522aae-f4d1-476a-bca6-6c7909b59ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:25.115772 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522aae-f4d1-476a-bca6-6c7909b59ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:25.151593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0d2dd-104c-4ad2-bddd-18ddf5766374 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:25.202654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51522aae-f4d1-476a-bca6-6c7909b59ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:25.204382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51522aae-f4d1-476a-bca6-6c7909b59ae0 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:25.246538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272193cd-d22f-4761-b6fa-f597a0b81919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:25.247595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272193cd-d22f-4761-b6fa-f597a0b81919 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:25.248100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272193cd-d22f-4761-b6fa-f597a0b81919 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:25.248574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272193cd-d22f-4761-b6fa-f597a0b81919 None admin] PATH_INFO: `/v3/projects/b49b4c9310df495fb073a7240fdff8d6` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:25.250485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272193cd-d22f-4761-b6fa-f597a0b81919 None admin] RBAC: Authorizing `identity:get_project(project_id=b49b4c9310df495fb073a7240fdff8d6)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:25.252862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272193cd-d22f-4761-b6fa-f597a0b81919 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:25.255093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 44/93] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:25 2022] GET /identity/v3/projects/b49b4c9310df495fb073a7240fdff8d6 => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:25.260980 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272193cd-d22f-4761-b6fa-f597a0b81919 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:25.291687 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:25.319762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 50/94] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:25.325699 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51522aae-f4d1-476a-bca6-6c7909b59ae0 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:25.347639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:25.392911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272193cd-d22f-4761-b6fa-f597a0b81919 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:25.438974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8f606-a31e-4cb5-b55f-ff4da0cced0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:25.439596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8f606-a31e-4cb5-b55f-ff4da0cced0e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:25.439874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8f606-a31e-4cb5-b55f-ff4da0cced0e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:25.440145 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8f606-a31e-4cb5-b55f-ff4da0cced0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:25.440881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8f606-a31e-4cb5-b55f-ff4da0cced0e None admin] RBAC: Adding query filter params (role.id=aaefcf4fc05547caa577d6f4db32e1b5, scope.project.id=b49b4c9310df495fb073a7240fdff8d6, user.id=e791ee39a92340d6a13ec523db2e5b9b) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:25.441183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8f606-a31e-4cb5-b55f-ff4da0cced0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:25.442607 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8f606-a31e-4cb5-b55f-ff4da0cced0e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:25.450414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 45/95] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:25 2022] GET /identity/v3/role_assignments?user.id=e791ee39a92340d6a13ec523db2e5b9b&scope.project.id=b49b4c9310df495fb073a7240fdff8d6&role.id=aaefcf4fc05547caa577d6f4db32e1b5 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:25.474867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51522aae-f4d1-476a-bca6-6c7909b59ae0 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:25.516092 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595703e8-a817-43c4-8112-f7932f13de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:25.516711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595703e8-a817-43c4-8112-f7932f13de63 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:25.517510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595703e8-a817-43c4-8112-f7932f13de63 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:25.517792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595703e8-a817-43c4-8112-f7932f13de63 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:25.519133 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595703e8-a817-43c4-8112-f7932f13de63 None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:25.520640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595703e8-a817-43c4-8112-f7932f13de63 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:25.522816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 51/96] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:25 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:25.529091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8f606-a31e-4cb5-b55f-ff4da0cced0e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:25.660439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:25.670518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8f606-a31e-4cb5-b55f-ff4da0cced0e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:25.712932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc46a9-35cf-4cce-944a-65c9c39587b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:25.713821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc46a9-35cf-4cce-944a-65c9c39587b3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:25.714245 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc46a9-35cf-4cce-944a-65c9c39587b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:25.714661 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc46a9-35cf-4cce-944a-65c9c39587b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:25.715554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc46a9-35cf-4cce-944a-65c9c39587b3 None admin] RBAC: Adding query filter params (role.id=06cbbfa32c9549ffa2d1fd68736820a1, scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a, user.id=e791ee39a92340d6a13ec523db2e5b9b) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:25.716008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc46a9-35cf-4cce-944a-65c9c39587b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:25.717601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc46a9-35cf-4cce-944a-65c9c39587b3 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:25.727460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 46/97] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:25 2022] GET /identity/v3/role_assignments?user.id=e791ee39a92340d6a13ec523db2e5b9b&scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a&role.id=06cbbfa32c9549ffa2d1fd68736820a1 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:27.159513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38553d9f-998e-49e6-bc00-319d87eaf84f None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:27.160027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38553d9f-998e-49e6-bc00-319d87eaf84f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:27.160130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38553d9f-998e-49e6-bc00-319d87eaf84f None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:27.161693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 52/98] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:27.166767 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b1591-5e96-46d9-888c-0a92f4672446 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:27.167197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b1591-5e96-46d9-888c-0a92f4672446 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:27.167378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b1591-5e96-46d9-888c-0a92f4672446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:27.191951 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-301b1591-5e96-46d9-888c-0a92f4672446 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:27.193199 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-301b1591-5e96-46d9-888c-0a92f4672446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:27.282002 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 47/99] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:27.808879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e60a-c37f-4ec6-9e07-34f263e7f668 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:27.809487 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e60a-c37f-4ec6-9e07-34f263e7f668 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:27.809946 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e60a-c37f-4ec6-9e07-34f263e7f668 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:27.811787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 53/100] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:27.817497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcea6c-0c8f-4f6a-adfb-d9d9e349b2ef None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:27.818026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcea6c-0c8f-4f6a-adfb-d9d9e349b2ef None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:27.818522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcea6c-0c8f-4f6a-adfb-d9d9e349b2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:27.826508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e60a-c37f-4ec6-9e07-34f263e7f668 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:27.845952 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-cbbcea6c-0c8f-4f6a-adfb-d9d9e349b2ef None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:27.847696 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-cbbcea6c-0c8f-4f6a-adfb-d9d9e349b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:27.948901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 48/101] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:27.950016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8135592-f911-4873-a881-789ab92f75a8 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:27.950308 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8135592-f911-4873-a881-789ab92f75a8 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:27.950588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8135592-f911-4873-a881-789ab92f75a8 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:27.960974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 49/102] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:27.979050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d3f48-4aec-4f25-ac80-bb1d0f2feb12 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:27.979522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d3f48-4aec-4f25-ac80-bb1d0f2feb12 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:27.979823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d3f48-4aec-4f25-ac80-bb1d0f2feb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.019245 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:28.024853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4c0d3f48-4aec-4f25-ac80-bb1d0f2feb12 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:28.026070 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4c0d3f48-4aec-4f25-ac80-bb1d0f2feb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:28.051239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:28.071352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e60a-c37f-4ec6-9e07-34f263e7f668 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:28.149021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38e939-22b4-4f0a-8918-2b65660ceb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:28.149674 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38e939-22b4-4f0a-8918-2b65660ceb9b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:28.149958 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38e939-22b4-4f0a-8918-2b65660ceb9b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:28.150234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38e939-22b4-4f0a-8918-2b65660ceb9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.183799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38e939-22b4-4f0a-8918-2b65660ceb9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-ec38e939-22b4-4f0a-8918-2b65660ceb9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:28.189397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:28.190220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:28.191069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 54/103] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:37:28.198835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38e939-22b4-4f0a-8918-2b65660ceb9b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:28.199275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 50/104] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:28.254302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d3f48-4aec-4f25-ac80-bb1d0f2feb12 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:28.355079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38e939-22b4-4f0a-8918-2b65660ceb9b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:28.398759 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7462e-6de3-47f5-ba29-322e644f22f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:28.399418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7462e-6de3-47f5-ba29-322e644f22f0 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:28.399976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7462e-6de3-47f5-ba29-322e644f22f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:28.400274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7462e-6de3-47f5-ba29-322e644f22f0 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.400957 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7462e-6de3-47f5-ba29-322e644f22f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:28.401430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7462e-6de3-47f5-ba29-322e644f22f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:28.402848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7462e-6de3-47f5-ba29-322e644f22f0 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:28.407815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:28.422250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 55/105] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:28.435486 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7462e-6de3-47f5-ba29-322e644f22f0 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:28.513533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d3f48-4aec-4f25-ac80-bb1d0f2feb12 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:28.559865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ad34d-6fb1-4ba3-9e18-e3e29a4cca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:28.560526 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ad34d-6fb1-4ba3-9e18-e3e29a4cca06 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:28.560813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ad34d-6fb1-4ba3-9e18-e3e29a4cca06 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:28.561019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7462e-6de3-47f5-ba29-322e644f22f0 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:28.561113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ad34d-6fb1-4ba3-9e18-e3e29a4cca06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.574401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ad34d-6fb1-4ba3-9e18-e3e29a4cca06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-ae8ad34d-6fb1-4ba3-9e18-e3e29a4cca06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:28.581294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:28.582134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:28.582928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 51/106] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:37:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:28.584304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf42d-2ad9-45e7-913e-6335409cb7bd None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:28.584409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf42d-2ad9-45e7-913e-6335409cb7bd None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:28.587536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf42d-2ad9-45e7-913e-6335409cb7bd None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.587536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 52/107] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:28.587536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223baf8-bc6c-4d5b-9c66-4d979587f383 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:28.587536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223baf8-bc6c-4d5b-9c66-4d979587f383 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:28.587800 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223baf8-bc6c-4d5b-9c66-4d979587f383 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.588983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 53/108] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:28.595509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223baf8-bc6c-4d5b-9c66-4d979587f383 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:28.601194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:28.612534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5025ec3-23de-4494-a099-919f0fef2158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:28.612534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5025ec3-23de-4494-a099-919f0fef2158 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:28.612534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5025ec3-23de-4494-a099-919f0fef2158 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:28.612534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5025ec3-23de-4494-a099-919f0fef2158 None admin] PATH_INFO: `/v3/users/e791ee39a92340d6a13ec523db2e5b9b` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.612948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5025ec3-23de-4494-a099-919f0fef2158 None admin] RBAC: Authorizing `identity:get_user(user_id=e791ee39a92340d6a13ec523db2e5b9b)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:28.612948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5025ec3-23de-4494-a099-919f0fef2158 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:28.613637 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 56/109] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:28 2022] GET /identity/v3/users/e791ee39a92340d6a13ec523db2e5b9b => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:28.616363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca86ce-7818-4dc3-be67-9d7815a4fd6a None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:28.616986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca86ce-7818-4dc3-be67-9d7815a4fd6a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:28.617721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca86ce-7818-4dc3-be67-9d7815a4fd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.635943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-9eca86ce-7818-4dc3-be67-9d7815a4fd6a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:28.637402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9eca86ce-7818-4dc3-be67-9d7815a4fd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:28.700523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:28.718909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 57/110] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:28.718909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225d953-b1d0-485f-9f1f-b2444e0731ea None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:28.718909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225d953-b1d0-485f-9f1f-b2444e0731ea None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:28.718909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225d953-b1d0-485f-9f1f-b2444e0731ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.719310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223baf8-bc6c-4d5b-9c66-4d979587f383 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:28.727907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-7225d953-b1d0-485f-9f1f-b2444e0731ea None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:28.731853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7225d953-b1d0-485f-9f1f-b2444e0731ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:28.755898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aec6f2-a2c0-4bd1-a6c4-17859c85707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:28.756541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aec6f2-a2c0-4bd1-a6c4-17859c85707c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:28.756819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aec6f2-a2c0-4bd1-a6c4-17859c85707c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:28.757088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aec6f2-a2c0-4bd1-a6c4-17859c85707c None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.757751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aec6f2-a2c0-4bd1-a6c4-17859c85707c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:28.758050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aec6f2-a2c0-4bd1-a6c4-17859c85707c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:28.759580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aec6f2-a2c0-4bd1-a6c4-17859c85707c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:28.768350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 54/111] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:28.773832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aec6f2-a2c0-4bd1-a6c4-17859c85707c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:28.802558 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 58/112] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:28.803446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225d953-b1d0-485f-9f1f-b2444e0731ea None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:28.853839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:28.891091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aec6f2-a2c0-4bd1-a6c4-17859c85707c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:28.928748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6acf07-181a-4d52-a781-96aada1b56cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:28.929741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6acf07-181a-4d52-a781-96aada1b56cf None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:28.930213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6acf07-181a-4d52-a781-96aada1b56cf None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:28.930747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6acf07-181a-4d52-a781-96aada1b56cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.932081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6acf07-181a-4d52-a781-96aada1b56cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:28.933773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6acf07-181a-4d52-a781-96aada1b56cf None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:28.935606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 55/113] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:28.940786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225d953-b1d0-485f-9f1f-b2444e0731ea None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:28.942387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd06e-07cb-4b7f-bad2-db4ccb49fca2 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:28.942941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd06e-07cb-4b7f-bad2-db4ccb49fca2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:28.943432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd06e-07cb-4b7f-bad2-db4ccb49fca2 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.945053 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 56/114] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:28.945944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cd06e-07cb-4b7f-bad2-db4ccb49fca2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:28.978255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:28.988365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87600b4-a3e8-4ffe-93c7-79f52950df66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:28.989076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87600b4-a3e8-4ffe-93c7-79f52950df66 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:28.993047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87600b4-a3e8-4ffe-93c7-79f52950df66 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:28.993047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87600b4-a3e8-4ffe-93c7-79f52950df66 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:28.993047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87600b4-a3e8-4ffe-93c7-79f52950df66 None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:28.993047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87600b4-a3e8-4ffe-93c7-79f52950df66 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:28.998834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 59/115] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:28 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:28.998834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87600b4-a3e8-4ffe-93c7-79f52950df66 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:29.059795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cd06e-07cb-4b7f-bad2-db4ccb49fca2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:29.093348 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8f91c-dbe5-4af8-ae66-8ca644636116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:29.093978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8f91c-dbe5-4af8-ae66-8ca644636116 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:29.094262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8f91c-dbe5-4af8-ae66-8ca644636116 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:29.094539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8f91c-dbe5-4af8-ae66-8ca644636116 None admin] PATH_INFO: `/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:29.095735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8f91c-dbe5-4af8-ae66-8ca644636116 None admin] RBAC: Authorizing `identity:get_user(user_id=8c4ae54dfe2844c3bb1795a2873a02d4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:29.097180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8f91c-dbe5-4af8-ae66-8ca644636116 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:29.102559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 57/116] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:28 2022] GET /identity/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:29.102559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632db0b-7a1d-4b08-bb65-a97e8d180f96 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:29.102559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632db0b-7a1d-4b08-bb65-a97e8d180f96 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:29.102559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632db0b-7a1d-4b08-bb65-a97e8d180f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:29.106528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:29.111571 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87600b4-a3e8-4ffe-93c7-79f52950df66 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:29.119235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d632db0b-7a1d-4b08-bb65-a97e8d180f96 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:29.120569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d632db0b-7a1d-4b08-bb65-a97e8d180f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:29.146216 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89606671-17fa-4709-b6e3-bb9236915575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:29.146758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89606671-17fa-4709-b6e3-bb9236915575 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:29.147084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89606671-17fa-4709-b6e3-bb9236915575 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:29.147359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89606671-17fa-4709-b6e3-bb9236915575 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:29.148004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89606671-17fa-4709-b6e3-bb9236915575 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:29.149455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89606671-17fa-4709-b6e3-bb9236915575 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:29.186989 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 58/117] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:29.187955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632db0b-7a1d-4b08-bb65-a97e8d180f96 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:29.217224 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 60/118] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:37:28 2022] POST /identity/v3/projects => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:37:29.218580 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89606671-17fa-4709-b6e3-bb9236915575 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:29.296059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:29.320775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632db0b-7a1d-4b08-bb65-a97e8d180f96 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:29.363996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89606671-17fa-4709-b6e3-bb9236915575 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:29.368605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:29.376667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7645c52-d7d7-4f30-a4eb-351cf46dcd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:29.377321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7645c52-d7d7-4f30-a4eb-351cf46dcd86 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:29.377604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7645c52-d7d7-4f30-a4eb-351cf46dcd86 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:29.377878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7645c52-d7d7-4f30-a4eb-351cf46dcd86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:29.396213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7645c52-d7d7-4f30-a4eb-351cf46dcd86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-a7645c52-d7d7-4f30-a4eb-351cf46dcd86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:29.400859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:29.401714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 59/119] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:29.402510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7645c52-d7d7-4f30-a4eb-351cf46dcd86 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:29.426327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3ad6f-2928-446f-a5cd-4a5138c8b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:29.428480 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ad6f-2928-446f-a5cd-4a5138c8b738 None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:29.428480 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ad6f-2928-446f-a5cd-4a5138c8b738 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:29.428480 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ad6f-2928-446f-a5cd-4a5138c8b738 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a/users/e791ee39a92340d6a13ec523db2e5b9b/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:29.431115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3ad6f-2928-446f-a5cd-4a5138c8b738 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e69c872645b4f5db659d7dbfa42dd7a, user_id=e791ee39a92340d6a13ec523db2e5b9b, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:29.432576 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3ad6f-2928-446f-a5cd-4a5138c8b738 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:29.508510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 61/120] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:37:29 2022] PUT /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a/users/e791ee39a92340d6a13ec523db2e5b9b/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:29.509401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3ad6f-2928-446f-a5cd-4a5138c8b738 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:29.520662 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7645c52-d7d7-4f30-a4eb-351cf46dcd86 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:29.561823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8a703-951a-41c7-bb2a-d158f13e80df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:29.562488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a703-951a-41c7-bb2a-d158f13e80df None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:29.563880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a703-951a-41c7-bb2a-d158f13e80df None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:29.564195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a703-951a-41c7-bb2a-d158f13e80df None admin] PATH_INFO: `/v3/roles/member` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:29.579336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8a703-951a-41c7-bb2a-d158f13e80df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-68a8a703-951a-41c7-bb2a-d158f13e80df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:29.586154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:29.587163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:29.587902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 60/121] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:29.588532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8a703-951a-41c7-bb2a-d158f13e80df None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:29.667218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:29.671753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3ad6f-2928-446f-a5cd-4a5138c8b738 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:29.680214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:29.715897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf89de0-ee16-455f-80e1-6812cf0890e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:29.716904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89de0-ee16-455f-80e1-6812cf0890e4 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:29.717389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89de0-ee16-455f-80e1-6812cf0890e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:29.717858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89de0-ee16-455f-80e1-6812cf0890e4 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:29.719441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf89de0-ee16-455f-80e1-6812cf0890e4 None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:29.721113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf89de0-ee16-455f-80e1-6812cf0890e4 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:29.724160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 62/122] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:29 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:29.724160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf89de0-ee16-455f-80e1-6812cf0890e4 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:29.734169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8a703-951a-41c7-bb2a-d158f13e80df None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:29.782749 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b151c-3df4-4270-9bd2-6585019dce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:29.783620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b151c-3df4-4270-9bd2-6585019dce8c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:29.783973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b151c-3df4-4270-9bd2-6585019dce8c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:29.784320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b151c-3df4-4270-9bd2-6585019dce8c None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:29.785552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b151c-3df4-4270-9bd2-6585019dce8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:29.785955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b151c-3df4-4270-9bd2-6585019dce8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:29.787792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b151c-3df4-4270-9bd2-6585019dce8c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:29.799248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 61/123] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:29.800519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b151c-3df4-4270-9bd2-6585019dce8c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:29.841127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf89de0-ee16-455f-80e1-6812cf0890e4 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:29.892288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84b173-439d-4822-8596-d7539ce4dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:29.893319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84b173-439d-4822-8596-d7539ce4dee1 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:29.893675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84b173-439d-4822-8596-d7539ce4dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:29.894026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84b173-439d-4822-8596-d7539ce4dee1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:29.909077 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84b173-439d-4822-8596-d7539ce4dee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-ad84b173-439d-4822-8596-d7539ce4dee1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:29.916346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:29.917281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:29.918045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 63/124] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:37:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:29.919948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84b173-439d-4822-8596-d7539ce4dee1 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:29.928799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b151c-3df4-4270-9bd2-6585019dce8c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:29.943988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:29.965710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557b2f2-0297-43b4-89b7-b0c6953c2c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:29.966036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:29.967313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557b2f2-0297-43b4-89b7-b0c6953c2c62 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:29.967609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557b2f2-0297-43b4-89b7-b0c6953c2c62 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:29.967972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557b2f2-0297-43b4-89b7-b0c6953c2c62 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:29.968643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557b2f2-0297-43b4-89b7-b0c6953c2c62 None admin] RBAC: Adding query filter params (name=member) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:29.968949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557b2f2-0297-43b4-89b7-b0c6953c2c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:29.970619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557b2f2-0297-43b4-89b7-b0c6953c2c62 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:29.981041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 62/125] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:29.982052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557b2f2-0297-43b4-89b7-b0c6953c2c62 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:30.046440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84b173-439d-4822-8596-d7539ce4dee1 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:30.084792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f81fff-5b2c-4b2e-9863-daa2c735e1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:30.085519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81fff-5b2c-4b2e-9863-daa2c735e1a6 None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:30.085804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81fff-5b2c-4b2e-9863-daa2c735e1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:30.086136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81fff-5b2c-4b2e-9863-daa2c735e1a6 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a/users/8c4ae54dfe2844c3bb1795a2873a02d4/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:30.088194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f81fff-5b2c-4b2e-9863-daa2c735e1a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e69c872645b4f5db659d7dbfa42dd7a, user_id=8c4ae54dfe2844c3bb1795a2873a02d4, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:30.089696 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f81fff-5b2c-4b2e-9863-daa2c735e1a6 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:30.112329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557b2f2-0297-43b4-89b7-b0c6953c2c62 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:30.150057 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3480c5-76d6-47a2-a847-8e86c287ca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:30.150689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3480c5-76d6-47a2-a847-8e86c287ca42 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:30.151005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3480c5-76d6-47a2-a847-8e86c287ca42 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:30.151281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3480c5-76d6-47a2-a847-8e86c287ca42 None admin] PATH_INFO: `/v3/users/a4f46011cf3c4444947e1206626b2c1f` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:30.167089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3480c5-76d6-47a2-a847-8e86c287ca42 None admin] RBAC: Authorizing `identity:get_user(user_id=a4f46011cf3c4444947e1206626b2c1f)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:30.168753 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3480c5-76d6-47a2-a847-8e86c287ca42 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:30.175017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 63/126] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:29 2022] GET /identity/v3/users/a4f46011cf3c4444947e1206626b2c1f => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:30.175017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3480c5-76d6-47a2-a847-8e86c287ca42 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:30.176847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 64/127] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:37:29 2022] PUT /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a/users/8c4ae54dfe2844c3bb1795a2873a02d4/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:30.182137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f81fff-5b2c-4b2e-9863-daa2c735e1a6 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:30.229809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:30.337176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3480c5-76d6-47a2-a847-8e86c287ca42 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:30.352967 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:30.373074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f81fff-5b2c-4b2e-9863-daa2c735e1a6 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:30.379006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892f199-9a8c-4d0c-89df-89350f5a48b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:30.379944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892f199-9a8c-4d0c-89df-89350f5a48b9 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:30.380369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892f199-9a8c-4d0c-89df-89350f5a48b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:30.380792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892f199-9a8c-4d0c-89df-89350f5a48b9 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:30.381608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892f199-9a8c-4d0c-89df-89350f5a48b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:30.381912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892f199-9a8c-4d0c-89df-89350f5a48b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:30.383331 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892f199-9a8c-4d0c-89df-89350f5a48b9 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:30.393333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 64/128] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:37:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:30.393967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892f199-9a8c-4d0c-89df-89350f5a48b9 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:30.429642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29327e-48d8-43cc-9a6e-56816b7506d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:30.430636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29327e-48d8-43cc-9a6e-56816b7506d5 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:30.431178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29327e-48d8-43cc-9a6e-56816b7506d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:30.431911 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29327e-48d8-43cc-9a6e-56816b7506d5 None admin] PATH_INFO: `/v3/users/e791ee39a92340d6a13ec523db2e5b9b` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:30.433692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29327e-48d8-43cc-9a6e-56816b7506d5 None admin] RBAC: Authorizing `identity:get_user(user_id=e791ee39a92340d6a13ec523db2e5b9b)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:30.435886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29327e-48d8-43cc-9a6e-56816b7506d5 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:30.439423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 65/129] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:30 2022] GET /identity/v3/users/e791ee39a92340d6a13ec523db2e5b9b => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:30.440105 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29327e-48d8-43cc-9a6e-56816b7506d5 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:30.510637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:30.523330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892f199-9a8c-4d0c-89df-89350f5a48b9 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:30.568537 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29327e-48d8-43cc-9a6e-56816b7506d5 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:30.596676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b688659-d288-47d7-94ca-a13001305b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:30.597406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b688659-d288-47d7-94ca-a13001305b40 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:30.597697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b688659-d288-47d7-94ca-a13001305b40 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:30.597977 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b688659-d288-47d7-94ca-a13001305b40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:30.609250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322d513-66a8-40d6-a567-adbf7f4a289d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:30.609903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322d513-66a8-40d6-a567-adbf7f4a289d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:30.610191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322d513-66a8-40d6-a567-adbf7f4a289d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:30.611066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322d513-66a8-40d6-a567-adbf7f4a289d None admin] PATH_INFO: `/v3/users/e791ee39a92340d6a13ec523db2e5b9b` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:30.612268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322d513-66a8-40d6-a567-adbf7f4a289d None admin] RBAC: Authorizing `identity:get_user(user_id=e791ee39a92340d6a13ec523db2e5b9b)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:30.614289 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322d513-66a8-40d6-a567-adbf7f4a289d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:30.616254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 66/130] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:30 2022] GET /identity/v3/users/e791ee39a92340d6a13ec523db2e5b9b => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:30.617052 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322d513-66a8-40d6-a567-adbf7f4a289d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:30.653736 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:30.746769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322d513-66a8-40d6-a567-adbf7f4a289d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:30.752220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b688659-d288-47d7-94ca-a13001305b40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:30.753711 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b688659-d288-47d7-94ca-a13001305b40 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:30.786997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb22f9-bd6c-4920-9193-568cd4a22efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:30.787941 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb22f9-bd6c-4920-9193-568cd4a22efc None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:30.789501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb22f9-bd6c-4920-9193-568cd4a22efc None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:30.789501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb22f9-bd6c-4920-9193-568cd4a22efc None admin] PATH_INFO: `/v3/projects/b49b4c9310df495fb073a7240fdff8d6` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:30.790127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb22f9-bd6c-4920-9193-568cd4a22efc None admin] RBAC: Authorizing `identity:get_project(project_id=b49b4c9310df495fb073a7240fdff8d6)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:30.792034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb22f9-bd6c-4920-9193-568cd4a22efc None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:30.794524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 67/131] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:30 2022] GET /identity/v3/projects/b49b4c9310df495fb073a7240fdff8d6 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:30.794524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb22f9-bd6c-4920-9193-568cd4a22efc None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:30.914771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb22f9-bd6c-4920-9193-568cd4a22efc None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:30.927275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:30.938363 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:30.949624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 65/132] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:30.950462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b688659-d288-47d7-94ca-a13001305b40 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:30.965655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba833e-87c1-43f7-a6c1-a4320ca5705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:30.966316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba833e-87c1-43f7-a6c1-a4320ca5705f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:30.966603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba833e-87c1-43f7-a6c1-a4320ca5705f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:30.967012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba833e-87c1-43f7-a6c1-a4320ca5705f None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:30.972639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba833e-87c1-43f7-a6c1-a4320ca5705f None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:30.972639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba833e-87c1-43f7-a6c1-a4320ca5705f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:30.972639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 68/133] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:30 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:30.973442 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba833e-87c1-43f7-a6c1-a4320ca5705f None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:31.092383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba833e-87c1-43f7-a6c1-a4320ca5705f None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:31.132031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b2b28-7fb7-40a0-b483-a20fff5d8451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:31.132685 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b2b28-7fb7-40a0-b483-a20fff5d8451 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:31.132969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b2b28-7fb7-40a0-b483-a20fff5d8451 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:31.133245 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b2b28-7fb7-40a0-b483-a20fff5d8451 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:31.134635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b2b28-7fb7-40a0-b483-a20fff5d8451 None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:31.136905 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b2b28-7fb7-40a0-b483-a20fff5d8451 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:31.138852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 69/134] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:30 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:31.140076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b2b28-7fb7-40a0-b483-a20fff5d8451 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:31.179550 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:31.241532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b688659-d288-47d7-94ca-a13001305b40 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:31.253986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b2b28-7fb7-40a0-b483-a20fff5d8451 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:31.292195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0796505-60d8-4980-8a62-ca30e36955c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:31.292872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0796505-60d8-4980-8a62-ca30e36955c2 None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:31.293162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0796505-60d8-4980-8a62-ca30e36955c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:31.293446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0796505-60d8-4980-8a62-ca30e36955c2 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a/users/e791ee39a92340d6a13ec523db2e5b9b/roles/06cbbfa32c9549ffa2d1fd68736820a1` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:31.295950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0796505-60d8-4980-8a62-ca30e36955c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e69c872645b4f5db659d7dbfa42dd7a, user_id=e791ee39a92340d6a13ec523db2e5b9b, role_id=06cbbfa32c9549ffa2d1fd68736820a1)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:31.297906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0796505-60d8-4980-8a62-ca30e36955c2 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:31.317830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7e6d8-0ef0-48d4-9191-3bba155c7636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:31.318500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7e6d8-0ef0-48d4-9191-3bba155c7636 None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:31.318789 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7e6d8-0ef0-48d4-9191-3bba155c7636 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:31.319103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7e6d8-0ef0-48d4-9191-3bba155c7636 None admin] PATH_INFO: `/v3/projects/b49b4c9310df495fb073a7240fdff8d6/users/e791ee39a92340d6a13ec523db2e5b9b/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:31.321091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7e6d8-0ef0-48d4-9191-3bba155c7636 None admin] RBAC: Authorizing `identity:create_grant(project_id=b49b4c9310df495fb073a7240fdff8d6, user_id=e791ee39a92340d6a13ec523db2e5b9b, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:31.322601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7e6d8-0ef0-48d4-9191-3bba155c7636 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:31.370737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 70/135] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:37:31 2022] PUT /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a/users/e791ee39a92340d6a13ec523db2e5b9b/roles/06cbbfa32c9549ffa2d1fd68736820a1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:31.375477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0796505-60d8-4980-8a62-ca30e36955c2 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:31.401281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 66/136] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:37:30 2022] PUT /identity/v3/projects/b49b4c9310df495fb073a7240fdff8d6/users/e791ee39a92340d6a13ec523db2e5b9b/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:31.415715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231fb7d-00a8-4d37-9195-3d6975425b18 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:31.416359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231fb7d-00a8-4d37-9195-3d6975425b18 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:31.416863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231fb7d-00a8-4d37-9195-3d6975425b18 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:31.423333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 67/137] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:31.425167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4109d-83c9-45c7-bf9d-2e69546b3044 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:31.425674 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4109d-83c9-45c7-bf9d-2e69546b3044 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:31.426174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4109d-83c9-45c7-bf9d-2e69546b3044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:31.464075 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-32f4109d-83c9-45c7-bf9d-2e69546b3044 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:31.465803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-32f4109d-83c9-45c7-bf9d-2e69546b3044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:31.541782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:31.565712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 68/138] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:31.607479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:31.612356 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0796505-60d8-4980-8a62-ca30e36955c2 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:31.651237 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655ce45-b03e-4c7f-b0b6-871e035772aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:31.652206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655ce45-b03e-4c7f-b0b6-871e035772aa None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:31.652748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655ce45-b03e-4c7f-b0b6-871e035772aa None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:31.653218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655ce45-b03e-4c7f-b0b6-871e035772aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:31.654219 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655ce45-b03e-4c7f-b0b6-871e035772aa None admin] RBAC: Adding query filter params (role.id=3567c7c724ee489eae05cd3b2a321a7f, scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a, user.id=a4f46011cf3c4444947e1206626b2c1f) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:31.654748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655ce45-b03e-4c7f-b0b6-871e035772aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:31.656652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655ce45-b03e-4c7f-b0b6-871e035772aa None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:31.663459 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 71/139] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:31 2022] GET /identity/v3/role_assignments?user.id=a4f46011cf3c4444947e1206626b2c1f&scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a&role.id=3567c7c724ee489eae05cd3b2a321a7f => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:31.670534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3746e-288e-4892-95e7-880b69634943 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:31.671131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3746e-288e-4892-95e7-880b69634943 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:31.685730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3746e-288e-4892-95e7-880b69634943 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:31.685730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 69/140] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:31.685917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548068a-e218-4cbe-96c4-5ef073e4bf49 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:31.685917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548068a-e218-4cbe-96c4-5ef073e4bf49 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:31.685917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548068a-e218-4cbe-96c4-5ef073e4bf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:31.704289 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e548068a-e218-4cbe-96c4-5ef073e4bf49 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:31.705536 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e548068a-e218-4cbe-96c4-5ef073e4bf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:31.792615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 72/141] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:31.949756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3746e-288e-4892-95e7-880b69634943 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:32.088140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3746e-288e-4892-95e7-880b69634943 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:32.098139 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548068a-e218-4cbe-96c4-5ef073e4bf49 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:32.137523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466eee-5e00-4b7c-8e8d-ee1c97a00775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:32.138498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466eee-5e00-4b7c-8e8d-ee1c97a00775 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:32.138498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466eee-5e00-4b7c-8e8d-ee1c97a00775 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:32.138782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466eee-5e00-4b7c-8e8d-ee1c97a00775 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:32.140636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11466eee-5e00-4b7c-8e8d-ee1c97a00775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:32.142238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11466eee-5e00-4b7c-8e8d-ee1c97a00775 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:32.143965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 70/142] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:32.149399 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466eee-5e00-4b7c-8e8d-ee1c97a00775 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:32.246444 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:32.261060 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548068a-e218-4cbe-96c4-5ef073e4bf49 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:32.290618 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:32.314920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbee7cc-eaa5-4f12-a2ed-b17f299f8228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:32.315542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbee7cc-eaa5-4f12-a2ed-b17f299f8228 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:32.315815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbee7cc-eaa5-4f12-a2ed-b17f299f8228 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:32.316077 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbee7cc-eaa5-4f12-a2ed-b17f299f8228 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:32.332624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbee7cc-eaa5-4f12-a2ed-b17f299f8228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-afbee7cc-eaa5-4f12-a2ed-b17f299f8228 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:32.337567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:32.338611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:32.339391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:32.339391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:32.339391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:32.339391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:32.339391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:32.339391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:32.339391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:32.339391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:32.339391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:32.339391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:32.339391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:32.339391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:32.344109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 73/143] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:32.350380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbee7cc-eaa5-4f12-a2ed-b17f299f8228 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:32.410277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466eee-5e00-4b7c-8e8d-ee1c97a00775 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:32.467713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d43ab0-08cb-4352-9446-0b57c9163034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:32.468318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d43ab0-08cb-4352-9446-0b57c9163034 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:32.468603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d43ab0-08cb-4352-9446-0b57c9163034 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:32.468880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d43ab0-08cb-4352-9446-0b57c9163034 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:32.469554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d43ab0-08cb-4352-9446-0b57c9163034 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:32.471084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d43ab0-08cb-4352-9446-0b57c9163034 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:32.529712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbee7cc-eaa5-4f12-a2ed-b17f299f8228 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:32.573148 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 71/144] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:37:32 2022] POST /identity/v3/users => generated 283 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:37:32.589245 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afc763-0422-4f83-aa1f-82b8eb148660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:32.590559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afc763-0422-4f83-aa1f-82b8eb148660 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:32.594996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afc763-0422-4f83-aa1f-82b8eb148660 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:32.594996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afc763-0422-4f83-aa1f-82b8eb148660 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:32.594996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afc763-0422-4f83-aa1f-82b8eb148660 None admin] RBAC: Adding query filter params (name=member) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:32.594996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afc763-0422-4f83-aa1f-82b8eb148660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:32.594996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afc763-0422-4f83-aa1f-82b8eb148660 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:32.607698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 74/145] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:32.613295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d43ab0-08cb-4352-9446-0b57c9163034 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:32.781124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d43ab0-08cb-4352-9446-0b57c9163034 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:32.802336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:32.841080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe3645-c278-497c-b252-36370ae5354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:32.841751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe3645-c278-497c-b252-36370ae5354c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:32.842030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe3645-c278-497c-b252-36370ae5354c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:32.842299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe3645-c278-497c-b252-36370ae5354c None admin] PATH_INFO: `/v3/users/e791ee39a92340d6a13ec523db2e5b9b` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:32.843478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe3645-c278-497c-b252-36370ae5354c None admin] RBAC: Authorizing `identity:get_user(user_id=e791ee39a92340d6a13ec523db2e5b9b)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:32.845509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe3645-c278-497c-b252-36370ae5354c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:32.847130 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 72/146] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:32 2022] GET /identity/v3/users/e791ee39a92340d6a13ec523db2e5b9b => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:32.852780 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afc763-0422-4f83-aa1f-82b8eb148660 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:32.880066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:32.996765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afc763-0422-4f83-aa1f-82b8eb148660 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:33.039356 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2de10-7c37-491e-b44b-f634d15d46fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:33.040232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2de10-7c37-491e-b44b-f634d15d46fb None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:33.040652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2de10-7c37-491e-b44b-f634d15d46fb None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:33.041160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2de10-7c37-491e-b44b-f634d15d46fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:33.123019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2de10-7c37-491e-b44b-f634d15d46fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:33.124706 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2de10-7c37-491e-b44b-f634d15d46fb None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:33.143525 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:33.160299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253e748-0513-4a7c-920e-ece76df8c5a8 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:33.160734 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253e748-0513-4a7c-920e-ece76df8c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:33.161132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253e748-0513-4a7c-920e-ece76df8c5a8 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:33.162806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 73/147] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:33.168750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa65994-db74-4aab-b855-01a9a5f0c20c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:33.169030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa65994-db74-4aab-b855-01a9a5f0c20c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:33.169300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa65994-db74-4aab-b855-01a9a5f0c20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:33.207524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-2fa65994-db74-4aab-b855-01a9a5f0c20c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:33.208875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2fa65994-db74-4aab-b855-01a9a5f0c20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:33.267991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 75/148] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:33.273012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2de10-7c37-491e-b44b-f634d15d46fb None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:33.345968 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 74/149] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:33.382119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2de10-7c37-491e-b44b-f634d15d46fb None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:33.393796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:33.418762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9980a0-1cb4-47cc-91d9-3340382e6eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:33.420018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9980a0-1cb4-47cc-91d9-3340382e6eb1 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:33.420496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9980a0-1cb4-47cc-91d9-3340382e6eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:33.420959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9980a0-1cb4-47cc-91d9-3340382e6eb1 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:33.422399 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9980a0-1cb4-47cc-91d9-3340382e6eb1 None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:33.424720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9980a0-1cb4-47cc-91d9-3340382e6eb1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:33.426980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 76/150] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:33 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:33.437005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa65994-db74-4aab-b855-01a9a5f0c20c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:33.566235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa65994-db74-4aab-b855-01a9a5f0c20c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:33.578058 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:33.607665 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65278b44-e5c1-4002-a366-45163b8de67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:33.608210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65278b44-e5c1-4002-a366-45163b8de67a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:33.608489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65278b44-e5c1-4002-a366-45163b8de67a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:33.608761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65278b44-e5c1-4002-a366-45163b8de67a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:33.609491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65278b44-e5c1-4002-a366-45163b8de67a None admin] RBAC: Adding query filter params (role.id=aaefcf4fc05547caa577d6f4db32e1b5, scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a, user.id=e791ee39a92340d6a13ec523db2e5b9b) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:33.609793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65278b44-e5c1-4002-a366-45163b8de67a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:33.611306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65278b44-e5c1-4002-a366-45163b8de67a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:33.617671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 75/151] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:33 2022] GET /identity/v3/role_assignments?user.id=e791ee39a92340d6a13ec523db2e5b9b&scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a&role.id=aaefcf4fc05547caa577d6f4db32e1b5 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:33.816916 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9980a0-1cb4-47cc-91d9-3340382e6eb1 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:33.935129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9980a0-1cb4-47cc-91d9-3340382e6eb1 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:33.978244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c4ada-0738-459f-99a7-7ab220dd59f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:33.978903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c4ada-0738-459f-99a7-7ab220dd59f9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:33.979192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c4ada-0738-459f-99a7-7ab220dd59f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:33.979469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c4ada-0738-459f-99a7-7ab220dd59f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:33.992373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c4ada-0738-459f-99a7-7ab220dd59f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-dc6c4ada-0738-459f-99a7-7ab220dd59f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:33.997360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:33.998208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:33.999031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 77/152] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:37:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:34.005697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65278b44-e5c1-4002-a366-45163b8de67a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:34.064944 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad912f9-850a-41a1-8676-ad9ba9192796 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.065266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad912f9-850a-41a1-8676-ad9ba9192796 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.065488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad912f9-850a-41a1-8676-ad9ba9192796 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.070301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 78/153] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:34.076642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049251b-cb4e-4133-a582-b9e6fdf2a634 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.076642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049251b-cb4e-4133-a582-b9e6fdf2a634 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.076965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049251b-cb4e-4133-a582-b9e6fdf2a634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.121268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-6049251b-cb4e-4133-a582-b9e6fdf2a634 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:34.122499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6049251b-cb4e-4133-a582-b9e6fdf2a634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:34.143676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65278b44-e5c1-4002-a366-45163b8de67a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:34.178428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:34.209523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f6a1c-4ccf-4bb1-8244-ad6279b4fd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:34.210101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f6a1c-4ccf-4bb1-8244-ad6279b4fd40 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.210385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f6a1c-4ccf-4bb1-8244-ad6279b4fd40 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.210669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f6a1c-4ccf-4bb1-8244-ad6279b4fd40 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.211367 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f6a1c-4ccf-4bb1-8244-ad6279b4fd40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:34.211638 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f6a1c-4ccf-4bb1-8244-ad6279b4fd40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:34.213042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f6a1c-4ccf-4bb1-8244-ad6279b4fd40 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:34.227029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 76/154] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:34.229772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f6a1c-4ccf-4bb1-8244-ad6279b4fd40 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:34.251930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 79/155] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:34.291355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:34.372307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f6a1c-4ccf-4bb1-8244-ad6279b4fd40 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:34.424075 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a521ffb-ae5b-4c34-9900-3288c4391d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:34.424716 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a521ffb-ae5b-4c34-9900-3288c4391d7e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.424996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a521ffb-ae5b-4c34-9900-3288c4391d7e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.425269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a521ffb-ae5b-4c34-9900-3288c4391d7e None admin] PATH_INFO: `/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.426429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a521ffb-ae5b-4c34-9900-3288c4391d7e None admin] RBAC: Authorizing `identity:get_user(user_id=8c4ae54dfe2844c3bb1795a2873a02d4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:34.427901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a521ffb-ae5b-4c34-9900-3288c4391d7e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:34.429803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 77/156] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:34 2022] GET /identity/v3/users/8c4ae54dfe2844c3bb1795a2873a02d4 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:34.435406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049251b-cb4e-4133-a582-b9e6fdf2a634 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:34.554726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049251b-cb4e-4133-a582-b9e6fdf2a634 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:34.593749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94d904-f84d-4376-bb81-a11398bcbdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:34.594373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94d904-f84d-4376-bb81-a11398bcbdbe None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.594683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94d904-f84d-4376-bb81-a11398bcbdbe None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.595011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94d904-f84d-4376-bb81-a11398bcbdbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.633529 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:34.674045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94d904-f84d-4376-bb81-a11398bcbdbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:34.675816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94d904-f84d-4376-bb81-a11398bcbdbe None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:34.679611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af69ed4-f3fc-44dd-b278-d4ad7d7c61bb None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.680080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af69ed4-f3fc-44dd-b278-d4ad7d7c61bb None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.680155 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af69ed4-f3fc-44dd-b278-d4ad7d7c61bb None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.681664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 78/157] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:37:34.697019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650418-994c-4e2b-8298-ddb6abafc2a9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.697301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650418-994c-4e2b-8298-ddb6abafc2a9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.697572 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650418-994c-4e2b-8298-ddb6abafc2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.727944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f4650418-994c-4e2b-8298-ddb6abafc2a9 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:34.729207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f4650418-994c-4e2b-8298-ddb6abafc2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:34.855549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 80/158] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:34.856811 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460885d7-80a7-41c0-a7d0-8e348e971675 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.857097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460885d7-80a7-41c0-a7d0-8e348e971675 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.857375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460885d7-80a7-41c0-a7d0-8e348e971675 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.858634 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 81/159] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:34.859366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460885d7-80a7-41c0-a7d0-8e348e971675 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:34.874065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 79/160] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:34.875140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ebb5-57ef-47b5-a03a-43976eb7cf24 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.875428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ebb5-57ef-47b5-a03a-43976eb7cf24 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.875985 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ebb5-57ef-47b5-a03a-43976eb7cf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.911615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-3b43ebb5-57ef-47b5-a03a-43976eb7cf24 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:34.912904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3b43ebb5-57ef-47b5-a03a-43976eb7cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:34.965737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:34.992114 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:35.034028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460885d7-80a7-41c0-a7d0-8e348e971675 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:35.060200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 80/161] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:35.061391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43ebb5-57ef-47b5-a03a-43976eb7cf24 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:35.077518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acba5c-bc9b-40a0-b8bf-21ea729d9dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:35.078522 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acba5c-bc9b-40a0-b8bf-21ea729d9dca None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:35.079597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acba5c-bc9b-40a0-b8bf-21ea729d9dca None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:35.080044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acba5c-bc9b-40a0-b8bf-21ea729d9dca None admin] PATH_INFO: `/v3/roles/member` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:35.093671 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acba5c-bc9b-40a0-b8bf-21ea729d9dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-04acba5c-bc9b-40a0-b8bf-21ea729d9dca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:35.100243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:35.101122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:35.101959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:35.101959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:35.101959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:35.101959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:35.101959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:35.101959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:35.101959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:35.101959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:35.101959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:35.101959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:35.101959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:35.101959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:35.105019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 82/162] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:35.112567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acba5c-bc9b-40a0-b8bf-21ea729d9dca None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:35.269951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acba5c-bc9b-40a0-b8bf-21ea729d9dca None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:35.316803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43ebb5-57ef-47b5-a03a-43976eb7cf24 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:35.331314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:35.344134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c43c8c-e6d8-4030-819c-f2ff97e9a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:35.346108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c43c8c-e6d8-4030-819c-f2ff97e9a298 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:35.346390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c43c8c-e6d8-4030-819c-f2ff97e9a298 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:35.346665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c43c8c-e6d8-4030-819c-f2ff97e9a298 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:35.347365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c43c8c-e6d8-4030-819c-f2ff97e9a298 None admin] RBAC: Adding query filter params (name=member) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:35.347671 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c43c8c-e6d8-4030-819c-f2ff97e9a298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:35.349063 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c43c8c-e6d8-4030-819c-f2ff97e9a298 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:35.366190 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 83/163] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:35.367388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c43c8c-e6d8-4030-819c-f2ff97e9a298 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:35.383082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41bfbd-37b4-435a-9be3-e5b46718a440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:35.383700 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41bfbd-37b4-435a-9be3-e5b46718a440 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:35.383986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41bfbd-37b4-435a-9be3-e5b46718a440 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:35.384321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41bfbd-37b4-435a-9be3-e5b46718a440 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:35.385920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41bfbd-37b4-435a-9be3-e5b46718a440 None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:35.387418 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41bfbd-37b4-435a-9be3-e5b46718a440 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:35.389370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 81/164] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:35 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:35.389976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41bfbd-37b4-435a-9be3-e5b46718a440 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:35.427527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:35.482383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c43c8c-e6d8-4030-819c-f2ff97e9a298 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:35.518140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41bfbd-37b4-435a-9be3-e5b46718a440 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:35.519721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700f835-867a-48ba-bb17-ed9331df22ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:35.520621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700f835-867a-48ba-bb17-ed9331df22ea None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:35.521106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700f835-867a-48ba-bb17-ed9331df22ea None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:35.521590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700f835-867a-48ba-bb17-ed9331df22ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:35.539824 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700f835-867a-48ba-bb17-ed9331df22ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-7700f835-867a-48ba-bb17-ed9331df22ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:35.545595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:35.546455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:35.547351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:35.547351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:35.547351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:35.547351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:35.547351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:35.547351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:35.547351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:35.547351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:35.547351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:35.547351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:35.547351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:37:35.547351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:35.550429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 84/165] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:37:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:35.557736 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700f835-867a-48ba-bb17-ed9331df22ea None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:35.573194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50da83-ab92-4564-89b1-2958aa09fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:35.573841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50da83-ab92-4564-89b1-2958aa09fb15 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:35.574122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50da83-ab92-4564-89b1-2958aa09fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:35.574392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50da83-ab92-4564-89b1-2958aa09fb15 None admin] PATH_INFO: `/v3/users/e791ee39a92340d6a13ec523db2e5b9b` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:35.576587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50da83-ab92-4564-89b1-2958aa09fb15 None admin] RBAC: Authorizing `identity:get_user(user_id=e791ee39a92340d6a13ec523db2e5b9b)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:35.578030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50da83-ab92-4564-89b1-2958aa09fb15 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:35.586502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 82/166] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:35 2022] GET /identity/v3/users/e791ee39a92340d6a13ec523db2e5b9b => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:35.587433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50da83-ab92-4564-89b1-2958aa09fb15 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:35.662702 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:35.721449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700f835-867a-48ba-bb17-ed9331df22ea None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:35.771344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a21f9-24c5-447c-b04e-28de410c50ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:35.772098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a21f9-24c5-447c-b04e-28de410c50ff None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:35.772386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a21f9-24c5-447c-b04e-28de410c50ff None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:35.772658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a21f9-24c5-447c-b04e-28de410c50ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:35.773390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a21f9-24c5-447c-b04e-28de410c50ff None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a, user.id=8c4ae54dfe2844c3bb1795a2873a02d4) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:35.773699 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a21f9-24c5-447c-b04e-28de410c50ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:35.775408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a21f9-24c5-447c-b04e-28de410c50ff None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:35.788044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 85/167] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:35 2022] GET /identity/v3/role_assignments?user.id=8c4ae54dfe2844c3bb1795a2873a02d4&scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:35.788873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a21f9-24c5-447c-b04e-28de410c50ff None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:35.789977 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:35.799285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50da83-ab92-4564-89b1-2958aa09fb15 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:35.910056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cebe4-4f17-4b67-9d24-7335f3275b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:35.910683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cebe4-4f17-4b67-9d24-7335f3275b10 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:35.910986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cebe4-4f17-4b67-9d24-7335f3275b10 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:35.911256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cebe4-4f17-4b67-9d24-7335f3275b10 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:35.911961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cebe4-4f17-4b67-9d24-7335f3275b10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:35.912322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cebe4-4f17-4b67-9d24-7335f3275b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:35.913839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cebe4-4f17-4b67-9d24-7335f3275b10 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:35.932639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 83/168] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:37:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:35.933396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cebe4-4f17-4b67-9d24-7335f3275b10 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:36.073043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a21f9-24c5-447c-b04e-28de410c50ff None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:36.089272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cebe4-4f17-4b67-9d24-7335f3275b10 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:36.104349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:36.134829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07196a78-fd92-48ec-ae98-d0eaade6d5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:36.135904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07196a78-fd92-48ec-ae98-d0eaade6d5c5 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:36.137342 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07196a78-fd92-48ec-ae98-d0eaade6d5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:36.140041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07196a78-fd92-48ec-ae98-d0eaade6d5c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:36.155327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9f9d7-b56d-4508-b1cc-cfa01dd38608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:36.156347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9f9d7-b56d-4508-b1cc-cfa01dd38608 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:36.158132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9f9d7-b56d-4508-b1cc-cfa01dd38608 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:36.158606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9f9d7-b56d-4508-b1cc-cfa01dd38608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:36.172222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07196a78-fd92-48ec-ae98-d0eaade6d5c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-07196a78-fd92-48ec-ae98-d0eaade6d5c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:36.178585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:36.181447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:36.182231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:36.182231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:36.182231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:36.182231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:36.182231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:36.182231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:36.182231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:36.182231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:36.182231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:36.182231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:36.182231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:36.182231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:36.184101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 84/169] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:36.185266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07196a78-fd92-48ec-ae98-d0eaade6d5c5 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:36.216773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:36.251222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9f9d7-b56d-4508-b1cc-cfa01dd38608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:36.253235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9f9d7-b56d-4508-b1cc-cfa01dd38608 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:36.323842 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07196a78-fd92-48ec-ae98-d0eaade6d5c5 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:36.361886 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd836d-88df-4604-ab27-fa2b6479c8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:36.362581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd836d-88df-4604-ab27-fa2b6479c8c1 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:36.362868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd836d-88df-4604-ab27-fa2b6479c8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:36.363163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd836d-88df-4604-ab27-fa2b6479c8c1 None admin] PATH_INFO: `/v3/users/e791ee39a92340d6a13ec523db2e5b9b` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:36.364344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd836d-88df-4604-ab27-fa2b6479c8c1 None admin] RBAC: Authorizing `identity:get_user(user_id=e791ee39a92340d6a13ec523db2e5b9b)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:36.364578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 86/170] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:36.365782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9f9d7-b56d-4508-b1cc-cfa01dd38608 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:36.365888 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd836d-88df-4604-ab27-fa2b6479c8c1 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:36.367871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 85/171] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:36 2022] GET /identity/v3/users/e791ee39a92340d6a13ec523db2e5b9b => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:36.369034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ce06d-8323-4d80-b865-a193d5acd18a None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:36.369320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ce06d-8323-4d80-b865-a193d5acd18a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:36.369595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ce06d-8323-4d80-b865-a193d5acd18a None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:36.370984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 86/172] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:36.371545 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ce06d-8323-4d80-b865-a193d5acd18a None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:36.384254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:36.471953 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:36.476858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9f9d7-b56d-4508-b1cc-cfa01dd38608 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:36.486332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ce06d-8323-4d80-b865-a193d5acd18a None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:36.514324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69459e73-7958-4f76-bae4-c74a78103a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:36.515328 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459e73-7958-4f76-bae4-c74a78103a67 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:36.515905 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459e73-7958-4f76-bae4-c74a78103a67 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:36.516440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459e73-7958-4f76-bae4-c74a78103a67 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:36.517798 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69459e73-7958-4f76-bae4-c74a78103a67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:36.518295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69459e73-7958-4f76-bae4-c74a78103a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:36.519898 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69459e73-7958-4f76-bae4-c74a78103a67 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:36.525286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e506a9d-3b1f-4de4-9565-aa2d09a7f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:36.526021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e506a9d-3b1f-4de4-9565-aa2d09a7f285 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:36.526233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e506a9d-3b1f-4de4-9565-aa2d09a7f285 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:36.526472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e506a9d-3b1f-4de4-9565-aa2d09a7f285 None admin] PATH_INFO: `/v3/projects/b49b4c9310df495fb073a7240fdff8d6` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:36.527685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e506a9d-3b1f-4de4-9565-aa2d09a7f285 None admin] RBAC: Authorizing `identity:get_project(project_id=b49b4c9310df495fb073a7240fdff8d6)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:36.529180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e506a9d-3b1f-4de4-9565-aa2d09a7f285 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:36.530494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 87/173] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:36.530964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 87/174] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:36 2022] GET /identity/v3/projects/b49b4c9310df495fb073a7240fdff8d6 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:36.531783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e506a9d-3b1f-4de4-9565-aa2d09a7f285 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:36.532589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4093e-bce4-4ff9-9a88-df9c8c9d48c2 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:36.533118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4093e-bce4-4ff9-9a88-df9c8c9d48c2 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:36.533582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4093e-bce4-4ff9-9a88-df9c8c9d48c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:36.552928 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d4b4093e-bce4-4ff9-9a88-df9c8c9d48c2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:36.554451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d4b4093e-bce4-4ff9-9a88-df9c8c9d48c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:36.625537 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 88/175] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:36.627380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4093e-bce4-4ff9-9a88-df9c8c9d48c2 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:36.635735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:36.643946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e506a9d-3b1f-4de4-9565-aa2d09a7f285 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:36.680854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532d493-71dd-4735-81d8-3e57c41bfb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:36.681567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532d493-71dd-4735-81d8-3e57c41bfb14 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:36.681850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532d493-71dd-4735-81d8-3e57c41bfb14 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:36.682170 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532d493-71dd-4735-81d8-3e57c41bfb14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:36.721801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:36.734298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4093e-bce4-4ff9-9a88-df9c8c9d48c2 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:36.788134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c7e46-8087-4d59-8c38-6525a7dc9324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:36.788905 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532d493-71dd-4735-81d8-3e57c41bfb14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:36.789384 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c7e46-8087-4d59-8c38-6525a7dc9324 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:36.789857 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c7e46-8087-4d59-8c38-6525a7dc9324 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:36.790319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c7e46-8087-4d59-8c38-6525a7dc9324 None admin] PATH_INFO: `/v3/users/a4f46011cf3c4444947e1206626b2c1f` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:36.790419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532d493-71dd-4735-81d8-3e57c41bfb14 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:36.795576 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c7e46-8087-4d59-8c38-6525a7dc9324 None admin] RBAC: Authorizing `identity:get_user(user_id=a4f46011cf3c4444947e1206626b2c1f)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:36.797259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c7e46-8087-4d59-8c38-6525a7dc9324 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:36.800630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 89/176] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:36 2022] GET /identity/v3/users/a4f46011cf3c4444947e1206626b2c1f => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:36.801627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c7e46-8087-4d59-8c38-6525a7dc9324 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:36.899223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 88/177] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:36.900081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532d493-71dd-4735-81d8-3e57c41bfb14 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:36.901065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:36.929056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c7e46-8087-4d59-8c38-6525a7dc9324 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:36.959434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:36.965519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47258098-a25c-486e-b29a-679a83d40cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:36.966251 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258098-a25c-486e-b29a-679a83d40cef None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:36.966628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258098-a25c-486e-b29a-679a83d40cef None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:36.967045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258098-a25c-486e-b29a-679a83d40cef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:36.967878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47258098-a25c-486e-b29a-679a83d40cef None admin] RBAC: Adding query filter params (role.id=aaefcf4fc05547caa577d6f4db32e1b5, scope.project.id=b49b4c9310df495fb073a7240fdff8d6, user.id=e791ee39a92340d6a13ec523db2e5b9b) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:36.968289 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47258098-a25c-486e-b29a-679a83d40cef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:36.970504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47258098-a25c-486e-b29a-679a83d40cef None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:36.977785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 90/178] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:36 2022] GET /identity/v3/role_assignments?user.id=e791ee39a92340d6a13ec523db2e5b9b&scope.project.id=b49b4c9310df495fb073a7240fdff8d6&role.id=aaefcf4fc05547caa577d6f4db32e1b5 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:36.978683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d5799-d3bd-4e2e-8dae-7af4648dcef1 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:36.979115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d5799-d3bd-4e2e-8dae-7af4648dcef1 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:36.979545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d5799-d3bd-4e2e-8dae-7af4648dcef1 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:36.981180 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 91/179] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:36.982027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d5799-d3bd-4e2e-8dae-7af4648dcef1 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:37.014863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532d493-71dd-4735-81d8-3e57c41bfb14 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:37.054674 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fa5e4-2769-40e9-9192-3bf156009adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:37.055761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fa5e4-2769-40e9-9192-3bf156009adc None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:37.056295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fa5e4-2769-40e9-9192-3bf156009adc None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:37.056807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fa5e4-2769-40e9-9192-3bf156009adc None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:37.058189 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fa5e4-2769-40e9-9192-3bf156009adc None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:37.059853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fa5e4-2769-40e9-9192-3bf156009adc None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:37.061837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 89/180] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:36 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:37.063287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5a8f5-5db0-4360-937c-572b5a235f5d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:37.063813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5a8f5-5db0-4360-937c-572b5a235f5d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:37.064290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5a8f5-5db0-4360-937c-572b5a235f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:37.084412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-74d5a8f5-5db0-4360-937c-572b5a235f5d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:37.086161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-74d5a8f5-5db0-4360-937c-572b5a235f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:37.097886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d5799-d3bd-4e2e-8dae-7af4648dcef1 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:37.136318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fba32d-00db-45ba-9919-b47643719562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:37.137004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba32d-00db-45ba-9919-b47643719562 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:37.137281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba32d-00db-45ba-9919-b47643719562 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:37.137553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba32d-00db-45ba-9919-b47643719562 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:37.138746 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fba32d-00db-45ba-9919-b47643719562 None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:37.140289 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fba32d-00db-45ba-9919-b47643719562 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:37.142074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 92/181] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:36 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:37.142936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fba32d-00db-45ba-9919-b47643719562 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:37.156814 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:37.175982 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 90/182] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:37.177007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5a8f5-5db0-4360-937c-572b5a235f5d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:37.250085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:37.283244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fba32d-00db-45ba-9919-b47643719562 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:37.309251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5a8f5-5db0-4360-937c-572b5a235f5d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:37.322786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9039d6-e0e1-4bee-a962-66eea2c48632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:37.323579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9039d6-e0e1-4bee-a962-66eea2c48632 None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:37.323929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9039d6-e0e1-4bee-a962-66eea2c48632 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:37.324291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9039d6-e0e1-4bee-a962-66eea2c48632 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a/users/a4f46011cf3c4444947e1206626b2c1f/roles/3567c7c724ee489eae05cd3b2a321a7f` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:37.326282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9039d6-e0e1-4bee-a962-66eea2c48632 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e69c872645b4f5db659d7dbfa42dd7a, user_id=a4f46011cf3c4444947e1206626b2c1f, role_id=3567c7c724ee489eae05cd3b2a321a7f)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:37.327761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9039d6-e0e1-4bee-a962-66eea2c48632 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:37.347568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b47b5-107d-4cbb-8488-0f31bd356d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:37.348191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b47b5-107d-4cbb-8488-0f31bd356d5f None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:37.348471 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b47b5-107d-4cbb-8488-0f31bd356d5f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:37.348743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b47b5-107d-4cbb-8488-0f31bd356d5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:37.358943 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b47b5-107d-4cbb-8488-0f31bd356d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-914b47b5-107d-4cbb-8488-0f31bd356d5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:37.363911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:37.364954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:37.365930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 91/183] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:37:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:37.366726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fd349-12d8-4224-8398-a4b60feeb05e None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:37.366726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fd349-12d8-4224-8398-a4b60feeb05e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:37.366726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fd349-12d8-4224-8398-a4b60feeb05e None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:37.368085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 92/184] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:37.373008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fd349-12d8-4224-8398-a4b60feeb05e None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:37.398101 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 93/185] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:37:37 2022] PUT /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a/users/a4f46011cf3c4444947e1206626b2c1f/roles/3567c7c724ee489eae05cd3b2a321a7f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:37.408968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9039d6-e0e1-4bee-a962-66eea2c48632 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:37.487858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fd349-12d8-4224-8398-a4b60feeb05e None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:37.499355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:37.505104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:37.528209 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86edea-5ac9-4121-a912-730de8787daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:37.528998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86edea-5ac9-4121-a912-730de8787daa None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:37.529349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86edea-5ac9-4121-a912-730de8787daa None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:37.529683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86edea-5ac9-4121-a912-730de8787daa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:37.530491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86edea-5ac9-4121-a912-730de8787daa None admin] RBAC: Adding query filter params (role.id=06cbbfa32c9549ffa2d1fd68736820a1, scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a, user.id=e791ee39a92340d6a13ec523db2e5b9b) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:37.530963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86edea-5ac9-4121-a912-730de8787daa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:37.533636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86edea-5ac9-4121-a912-730de8787daa None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:37.541294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9039d6-e0e1-4bee-a962-66eea2c48632 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:37.544708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 93/186] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:37 2022] GET /identity/v3/role_assignments?user.id=e791ee39a92340d6a13ec523db2e5b9b&scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a&role.id=06cbbfa32c9549ffa2d1fd68736820a1 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:37.546053 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccbfc2-6373-446e-8e94-4fabe394cf9f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:37.546335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccbfc2-6373-446e-8e94-4fabe394cf9f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:37.546609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccbfc2-6373-446e-8e94-4fabe394cf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:37.572569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-e9ccbfc2-6373-446e-8e94-4fabe394cf9f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:37.573895 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e9ccbfc2-6373-446e-8e94-4fabe394cf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:37.586869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c9664-7d25-4b1b-8ae3-4fe9b9ead059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:37.587961 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9664-7d25-4b1b-8ae3-4fe9b9ead059 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:37.588311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9664-7d25-4b1b-8ae3-4fe9b9ead059 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:37.588877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9664-7d25-4b1b-8ae3-4fe9b9ead059 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:37.589643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c9664-7d25-4b1b-8ae3-4fe9b9ead059 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:37.589956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c9664-7d25-4b1b-8ae3-4fe9b9ead059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:37.592681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c9664-7d25-4b1b-8ae3-4fe9b9ead059 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:37.605897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 94/187] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:37.607766 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c9664-7d25-4b1b-8ae3-4fe9b9ead059 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:37.652561 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 94/188] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:37.653442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccbfc2-6373-446e-8e94-4fabe394cf9f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:37.767845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c9664-7d25-4b1b-8ae3-4fe9b9ead059 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:37.796542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:37.801787 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccbfc2-6373-446e-8e94-4fabe394cf9f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:37.805115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15fc07-5587-41c4-9a8f-266a8e13f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:37.805859 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15fc07-5587-41c4-9a8f-266a8e13f791 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:37.806204 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15fc07-5587-41c4-9a8f-266a8e13f791 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:37.819517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15fc07-5587-41c4-9a8f-266a8e13f791 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:37.819732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:37.819969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15fc07-5587-41c4-9a8f-266a8e13f791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-ea15fc07-5587-41c4-9a8f-266a8e13f791 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:37.826348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:37.827427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:37.828380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:37.828380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:37.828380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:37.828380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:37.828380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:37.828380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:37.828380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:37.828380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:37.828380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:37.828380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:37.828380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:37:37.828380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:37.830260 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 95/189] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:37:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:37.835785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15fc07-5587-41c4-9a8f-266a8e13f791 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:37.839054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75570163-7c48-468e-822e-a3d2382ede50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:37.839759 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75570163-7c48-468e-822e-a3d2382ede50 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:37.840040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75570163-7c48-468e-822e-a3d2382ede50 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:37.840318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75570163-7c48-468e-822e-a3d2382ede50 None admin] PATH_INFO: `/v3/users/9c94935b555245e8b653c9312f1ca9d3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:37.855917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75570163-7c48-468e-822e-a3d2382ede50 None admin] RBAC: Authorizing `identity:get_user(user_id=9c94935b555245e8b653c9312f1ca9d3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:37.857476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75570163-7c48-468e-822e-a3d2382ede50 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:37.859237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 95/190] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:37 2022] GET /identity/v3/users/9c94935b555245e8b653c9312f1ca9d3 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:37.866545 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75570163-7c48-468e-822e-a3d2382ede50 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:37.977581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15fc07-5587-41c4-9a8f-266a8e13f791 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:38.015831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75570163-7c48-468e-822e-a3d2382ede50 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:38.016082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0691ad4-d1b6-4924-adbc-bdd7e276ba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:38.016725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0691ad4-d1b6-4924-adbc-bdd7e276ba63 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:38.017008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0691ad4-d1b6-4924-adbc-bdd7e276ba63 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:38.017283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0691ad4-d1b6-4924-adbc-bdd7e276ba63 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:38.017959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0691ad4-d1b6-4924-adbc-bdd7e276ba63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:38.018260 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0691ad4-d1b6-4924-adbc-bdd7e276ba63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:38.019724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0691ad4-d1b6-4924-adbc-bdd7e276ba63 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:38.028067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 96/191] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:37:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:38.033793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0691ad4-d1b6-4924-adbc-bdd7e276ba63 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:38.053190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27042e-fe37-45ab-96f9-075e3bef7047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:38.053806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27042e-fe37-45ab-96f9-075e3bef7047 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:38.054157 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27042e-fe37-45ab-96f9-075e3bef7047 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:38.054493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27042e-fe37-45ab-96f9-075e3bef7047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:38.086523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:38.092463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:38.127102 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27042e-fe37-45ab-96f9-075e3bef7047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:38.128691 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27042e-fe37-45ab-96f9-075e3bef7047 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:38.140853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0691ad4-d1b6-4924-adbc-bdd7e276ba63 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:38.176299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855d63b-b6b4-4b2b-ae0b-0d7f7fe5f91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:38.176992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855d63b-b6b4-4b2b-ae0b-0d7f7fe5f91b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:38.177265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855d63b-b6b4-4b2b-ae0b-0d7f7fe5f91b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:38.177546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855d63b-b6b4-4b2b-ae0b-0d7f7fe5f91b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:38.178801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855d63b-b6b4-4b2b-ae0b-0d7f7fe5f91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:38.180281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855d63b-b6b4-4b2b-ae0b-0d7f7fe5f91b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:38.181849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 97/192] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:38.186580 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855d63b-b6b4-4b2b-ae0b-0d7f7fe5f91b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:38.235006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 96/193] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:38.236058 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27042e-fe37-45ab-96f9-075e3bef7047 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:38.298746 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855d63b-b6b4-4b2b-ae0b-0d7f7fe5f91b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:38.305278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:38.317605 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:38.335269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e75ff-40da-4fe9-ac2f-78d0efdb4d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:38.335983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e75ff-40da-4fe9-ac2f-78d0efdb4d5c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:38.336262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e75ff-40da-4fe9-ac2f-78d0efdb4d5c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:38.336541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e75ff-40da-4fe9-ac2f-78d0efdb4d5c None admin] PATH_INFO: `/v3/users/9c94935b555245e8b653c9312f1ca9d3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:38.337710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e75ff-40da-4fe9-ac2f-78d0efdb4d5c None admin] RBAC: Authorizing `identity:get_user(user_id=9c94935b555245e8b653c9312f1ca9d3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:38.339266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e75ff-40da-4fe9-ac2f-78d0efdb4d5c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:38.340251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27042e-fe37-45ab-96f9-075e3bef7047 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:38.341053 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 98/194] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:38 2022] GET /identity/v3/users/9c94935b555245e8b653c9312f1ca9d3 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:38.346863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e75ff-40da-4fe9-ac2f-78d0efdb4d5c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:38.377620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32148f3-b142-4e59-8c5e-737de21fd11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:38.378339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32148f3-b142-4e59-8c5e-737de21fd11d None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:38.378625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32148f3-b142-4e59-8c5e-737de21fd11d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:38.378915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32148f3-b142-4e59-8c5e-737de21fd11d None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:38.379567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32148f3-b142-4e59-8c5e-737de21fd11d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:38.381078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32148f3-b142-4e59-8c5e-737de21fd11d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:38.456121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e75ff-40da-4fe9-ac2f-78d0efdb4d5c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:38.482690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 97/195] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:37:38 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:37:38.492410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32148f3-b142-4e59-8c5e-737de21fd11d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:38.492861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f0e91-4c3a-42a7-8c8f-74af31d503f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:38.493744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f0e91-4c3a-42a7-8c8f-74af31d503f5 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:38.494195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f0e91-4c3a-42a7-8c8f-74af31d503f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:38.494703 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f0e91-4c3a-42a7-8c8f-74af31d503f5 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:38.496238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f0e91-4c3a-42a7-8c8f-74af31d503f5 None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:38.498050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f0e91-4c3a-42a7-8c8f-74af31d503f5 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:38.500299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 99/196] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:38 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:38.510894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f0e91-4c3a-42a7-8c8f-74af31d503f5 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:38.574023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:38.637872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32148f3-b142-4e59-8c5e-737de21fd11d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:38.646831 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f0e91-4c3a-42a7-8c8f-74af31d503f5 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:38.666265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:38.681723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff616b40-14db-415d-b807-e9bdde332ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:38.682355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff616b40-14db-415d-b807-e9bdde332ea8 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:38.682627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff616b40-14db-415d-b807-e9bdde332ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:38.682991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff616b40-14db-415d-b807-e9bdde332ea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:38.685393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c72bb-75ef-4a25-9dc1-d9c7ea3ef1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:38.686187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c72bb-75ef-4a25-9dc1-d9c7ea3ef1e8 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:38.686625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c72bb-75ef-4a25-9dc1-d9c7ea3ef1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:38.686952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c72bb-75ef-4a25-9dc1-d9c7ea3ef1e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:38.689277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c72bb-75ef-4a25-9dc1-d9c7ea3ef1e8 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c, user.id=9c94935b555245e8b653c9312f1ca9d3) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:38.689277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c72bb-75ef-4a25-9dc1-d9c7ea3ef1e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:38.689976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c72bb-75ef-4a25-9dc1-d9c7ea3ef1e8 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:38.696275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 100/197] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:38 2022] GET /identity/v3/role_assignments?user.id=9c94935b555245e8b653c9312f1ca9d3&scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:38.783472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff616b40-14db-415d-b807-e9bdde332ea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:38.785271 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff616b40-14db-415d-b807-e9bdde332ea8 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:38.904259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 98/198] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:38.909879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c72bb-75ef-4a25-9dc1-d9c7ea3ef1e8 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:39.025488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c72bb-75ef-4a25-9dc1-d9c7ea3ef1e8 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:39.044694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:39.064743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc0eb6-4938-480a-9f06-4124bee73bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:39.065687 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc0eb6-4938-480a-9f06-4124bee73bd1 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:39.066115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc0eb6-4938-480a-9f06-4124bee73bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:39.066562 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc0eb6-4938-480a-9f06-4124bee73bd1 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:39.067952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc0eb6-4938-480a-9f06-4124bee73bd1 None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:39.069762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc0eb6-4938-480a-9f06-4124bee73bd1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:39.071990 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 101/199] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:38 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:39.077575 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff616b40-14db-415d-b807-e9bdde332ea8 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:39.112640 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:39.209755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff616b40-14db-415d-b807-e9bdde332ea8 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:39.264585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7c46-5703-4646-9a14-575ab4ebd980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:39.265214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7c46-5703-4646-9a14-575ab4ebd980 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:39.265494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7c46-5703-4646-9a14-575ab4ebd980 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:39.265769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7c46-5703-4646-9a14-575ab4ebd980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:39.266546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e7c46-5703-4646-9a14-575ab4ebd980 None admin] RBAC: Adding query filter params (role.id=06cbbfa32c9549ffa2d1fd68736820a1, scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c, user.id=9c94935b555245e8b653c9312f1ca9d3) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:39.266855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e7c46-5703-4646-9a14-575ab4ebd980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:39.268320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e7c46-5703-4646-9a14-575ab4ebd980 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:39.274712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 99/200] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:39 2022] GET /identity/v3/role_assignments?user.id=9c94935b555245e8b653c9312f1ca9d3&scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c&role.id=06cbbfa32c9549ffa2d1fd68736820a1 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:39.538211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfdd3b-1b75-45fb-8814-4eab6788cdd1 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:39.539252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfdd3b-1b75-45fb-8814-4eab6788cdd1 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:39.539858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfdd3b-1b75-45fb-8814-4eab6788cdd1 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:39.541502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 102/201] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:39.546860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cae57-b630-498a-8cb5-a41dee476612 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:39.547175 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cae57-b630-498a-8cb5-a41dee476612 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:39.547502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cae57-b630-498a-8cb5-a41dee476612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:39.575874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-134cae57-b630-498a-8cb5-a41dee476612 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:39.577103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-134cae57-b630-498a-8cb5-a41dee476612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:39.665639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 100/202] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:40.058860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfdd3b-1b75-45fb-8814-4eab6788cdd1 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:40.185959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfdd3b-1b75-45fb-8814-4eab6788cdd1 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:40.222613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946e254-610a-4de2-a373-fa0b433d1287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:40.223664 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946e254-610a-4de2-a373-fa0b433d1287 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:40.224176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946e254-610a-4de2-a373-fa0b433d1287 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:40.224655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946e254-610a-4de2-a373-fa0b433d1287 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:40.235892 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946e254-610a-4de2-a373-fa0b433d1287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-d946e254-610a-4de2-a373-fa0b433d1287 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:40.241758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:40.242705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:40.243646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:40.243646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:40.243646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:40.243646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:40.243646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:40.243646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:40.243646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:40.243646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:40.243646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:40.243646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:40.243646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:40.243646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:40.245995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 103/203] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:40.252954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cae57-b630-498a-8cb5-a41dee476612 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:40.277329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:40.365583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cae57-b630-498a-8cb5-a41dee476612 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:40.407772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310c481-444f-482f-a9cf-4289a0a83c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:40.408813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310c481-444f-482f-a9cf-4289a0a83c0e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:40.409364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310c481-444f-482f-a9cf-4289a0a83c0e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:40.409841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310c481-444f-482f-a9cf-4289a0a83c0e None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:40.410707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310c481-444f-482f-a9cf-4289a0a83c0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:40.411243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310c481-444f-482f-a9cf-4289a0a83c0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:40.412827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310c481-444f-482f-a9cf-4289a0a83c0e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:40.424891 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 101/204] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:40.430635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946e254-610a-4de2-a373-fa0b433d1287 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:40.481143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:40.539645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946e254-610a-4de2-a373-fa0b433d1287 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:40.576702 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63d034-0688-4312-a09a-a86d1a1f140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:40.577724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63d034-0688-4312-a09a-a86d1a1f140d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:40.578212 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63d034-0688-4312-a09a-a86d1a1f140d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:40.578726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63d034-0688-4312-a09a-a86d1a1f140d None admin] PATH_INFO: `/v3/users/a4f46011cf3c4444947e1206626b2c1f` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:40.580168 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63d034-0688-4312-a09a-a86d1a1f140d None admin] RBAC: Authorizing `identity:get_user(user_id=a4f46011cf3c4444947e1206626b2c1f)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:40.581900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63d034-0688-4312-a09a-a86d1a1f140d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:40.583751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 104/205] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:40 2022] GET /identity/v3/users/a4f46011cf3c4444947e1206626b2c1f => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:40.591431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310c481-444f-482f-a9cf-4289a0a83c0e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:40.691222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:40.712957 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310c481-444f-482f-a9cf-4289a0a83c0e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:40.766437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a229c-a1f8-4464-ba8e-67af370244ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:40.767086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a229c-a1f8-4464-ba8e-67af370244ff None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:40.767370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a229c-a1f8-4464-ba8e-67af370244ff None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:40.767651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a229c-a1f8-4464-ba8e-67af370244ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:40.866162 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a229c-a1f8-4464-ba8e-67af370244ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:40.867668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a229c-a1f8-4464-ba8e-67af370244ff None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:40.964343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:40.995344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 102/206] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:41.000893 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63d034-0688-4312-a09a-a86d1a1f140d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:41.085280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57f8f7-9d4c-4189-91e4-9761d12e6e31 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.085619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57f8f7-9d4c-4189-91e4-9761d12e6e31 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.085836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57f8f7-9d4c-4189-91e4-9761d12e6e31 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.087430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 103/207] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:37:41.092664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6958e-8e62-4067-a3e6-e69be22ae8e9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.092946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6958e-8e62-4067-a3e6-e69be22ae8e9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.093220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6958e-8e62-4067-a3e6-e69be22ae8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.123166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-b2c6958e-8e62-4067-a3e6-e69be22ae8e9 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:41.124747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b2c6958e-8e62-4067-a3e6-e69be22ae8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:41.162983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63d034-0688-4312-a09a-a86d1a1f140d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:41.223828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:41.225214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 104/208] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:41.226504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fa9eb-b418-42a8-9202-e17ac4bf4952 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.226792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fa9eb-b418-42a8-9202-e17ac4bf4952 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.227101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fa9eb-b418-42a8-9202-e17ac4bf4952 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.228493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 105/209] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:41.235929 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753724d-766b-46e4-ae17-c4ba58335a30 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.236264 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753724d-766b-46e4-ae17-c4ba58335a30 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.236486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753724d-766b-46e4-ae17-c4ba58335a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.243317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f85b9-362d-45be-a053-6d7a6c39628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:41.247007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f85b9-362d-45be-a053-6d7a6c39628c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.247007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f85b9-362d-45be-a053-6d7a6c39628c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.247007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f85b9-362d-45be-a053-6d7a6c39628c None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.247007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f85b9-362d-45be-a053-6d7a6c39628c None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:41.248112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f85b9-362d-45be-a053-6d7a6c39628c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:41.250021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 105/210] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:40 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:41.256703 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f85b9-362d-45be-a053-6d7a6c39628c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:41.269810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4753724d-766b-46e4-ae17-c4ba58335a30 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:41.273377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4753724d-766b-46e4-ae17-c4ba58335a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:41.350649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 106/211] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:41.358906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7438c-cfdc-44eb-acbf-13195396a812 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.359269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7438c-cfdc-44eb-acbf-13195396a812 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.359609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7438c-cfdc-44eb-acbf-13195396a812 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.361009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 107/212] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:41.372195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a517f-eb84-4557-970e-46ec50f33174 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.372557 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a517f-eb84-4557-970e-46ec50f33174 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.372895 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a517f-eb84-4557-970e-46ec50f33174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.381506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f85b9-362d-45be-a053-6d7a6c39628c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:41.403395 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f11a517f-eb84-4557-970e-46ec50f33174 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:41.404717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f11a517f-eb84-4557-970e-46ec50f33174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:41.430936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3abdee-a43f-429e-be0e-9fcc481700dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:41.431815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3abdee-a43f-429e-be0e-9fcc481700dd None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.433810 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3abdee-a43f-429e-be0e-9fcc481700dd None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.434237 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3abdee-a43f-429e-be0e-9fcc481700dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.435151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3abdee-a43f-429e-be0e-9fcc481700dd None admin] RBAC: Adding query filter params (role.id=3567c7c724ee489eae05cd3b2a321a7f, scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a, user.id=a4f46011cf3c4444947e1206626b2c1f) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:41.436637 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3abdee-a43f-429e-be0e-9fcc481700dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:41.438837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3abdee-a43f-429e-be0e-9fcc481700dd None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:41.452792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 106/213] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:41 2022] GET /identity/v3/role_assignments?user.id=a4f46011cf3c4444947e1206626b2c1f&scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a&role.id=3567c7c724ee489eae05cd3b2a321a7f => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:41.462808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:41.505531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 108/214] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:41.534971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3abdee-a43f-429e-be0e-9fcc481700dd None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:41.601745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:41.669986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3abdee-a43f-429e-be0e-9fcc481700dd None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:41.701722 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a517f-eb84-4557-970e-46ec50f33174 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:41.709239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9683e7-198a-473a-966f-b323c2ec260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:41.709885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9683e7-198a-473a-966f-b323c2ec260e None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.710162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9683e7-198a-473a-966f-b323c2ec260e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.710434 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9683e7-198a-473a-966f-b323c2ec260e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.722956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9683e7-198a-473a-966f-b323c2ec260e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-9c9683e7-198a-473a-966f-b323c2ec260e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:41.728381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:41.729252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:41.730314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 107/215] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:37:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:41.735694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9683e7-198a-473a-966f-b323c2ec260e None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:41.839667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a517f-eb84-4557-970e-46ec50f33174 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:41.841164 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9683e7-198a-473a-966f-b323c2ec260e None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:41.849268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:41.876754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25986b57-fbc0-414a-974d-95164e8a12b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:41.877391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25986b57-fbc0-414a-974d-95164e8a12b8 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.877677 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25986b57-fbc0-414a-974d-95164e8a12b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.877961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25986b57-fbc0-414a-974d-95164e8a12b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.879408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a7c6e-b3a7-47d5-b5a4-a8e62cca0679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:41.880009 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a7c6e-b3a7-47d5-b5a4-a8e62cca0679 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.880282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a7c6e-b3a7-47d5-b5a4-a8e62cca0679 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.880546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a7c6e-b3a7-47d5-b5a4-a8e62cca0679 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.881201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a7c6e-b3a7-47d5-b5a4-a8e62cca0679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:41.881503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a7c6e-b3a7-47d5-b5a4-a8e62cca0679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:41.882857 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a7c6e-b3a7-47d5-b5a4-a8e62cca0679 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:41.888764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25986b57-fbc0-414a-974d-95164e8a12b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:41.890918 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 108/216] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:41.893365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24d215-2572-4c81-9ea5-e34b75069ef7 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.893653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24d215-2572-4c81-9ea5-e34b75069ef7 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-25986b57-fbc0-414a-974d-95164e8a12b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:41.893827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:41.894681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:41.895843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:41.895843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:41.895843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:41.895843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:41.895843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:41.895843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:41.895843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:41.895843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:41.895843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:41.895843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:41.895843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:41.895843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:41.896482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24d215-2572-4c81-9ea5-e34b75069ef7 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.896482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 109/218] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:41.896598 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 109/218] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:37:41.899959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24d215-2572-4c81-9ea5-e34b75069ef7 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:41.900690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eed6d-a610-4435-92c4-a76552a1b62d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:41.900979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eed6d-a610-4435-92c4-a76552a1b62d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:41.901254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eed6d-a610-4435-92c4-a76552a1b62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:41.918534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-282eed6d-a610-4435-92c4-a76552a1b62d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:41.919765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-282eed6d-a610-4435-92c4-a76552a1b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:41.943297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:41.986804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 110/219] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:41.987662 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eed6d-a610-4435-92c4-a76552a1b62d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:42.010840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24d215-2572-4c81-9ea5-e34b75069ef7 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:42.048625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1945e-1ee3-4f61-b378-92f90456936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:42.049252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1945e-1ee3-4f61-b378-92f90456936e None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:42.049529 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1945e-1ee3-4f61-b378-92f90456936e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:42.049801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1945e-1ee3-4f61-b378-92f90456936e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:42.050907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1945e-1ee3-4f61-b378-92f90456936e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:42.052331 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1945e-1ee3-4f61-b378-92f90456936e None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:42.054187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 110/220] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:42.054974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1945e-1ee3-4f61-b378-92f90456936e None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:42.091162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:42.095498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eed6d-a610-4435-92c4-a76552a1b62d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:42.132797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59656f33-571a-4234-bbd0-e22539317ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:42.133748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59656f33-571a-4234-bbd0-e22539317ced None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:42.134016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59656f33-571a-4234-bbd0-e22539317ced None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:42.134282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59656f33-571a-4234-bbd0-e22539317ced None admin] PATH_INFO: `/v3/users/9c94935b555245e8b653c9312f1ca9d3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:42.135434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59656f33-571a-4234-bbd0-e22539317ced None admin] RBAC: Authorizing `identity:get_user(user_id=9c94935b555245e8b653c9312f1ca9d3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:42.136861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59656f33-571a-4234-bbd0-e22539317ced None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:42.138437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 111/221] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:41 2022] GET /identity/v3/users/9c94935b555245e8b653c9312f1ca9d3 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:42.139286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59656f33-571a-4234-bbd0-e22539317ced None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:42.163669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1945e-1ee3-4f61-b378-92f90456936e None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:42.167452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:42.202042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1df3c-c751-49e8-883a-a6bb0878c860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:42.202660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1df3c-c751-49e8-883a-a6bb0878c860 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:42.203108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1df3c-c751-49e8-883a-a6bb0878c860 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:42.203379 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1df3c-c751-49e8-883a-a6bb0878c860 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:42.204623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1df3c-c751-49e8-883a-a6bb0878c860 None admin] RBAC: Adding query filter params (name=member) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:42.204930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1df3c-c751-49e8-883a-a6bb0878c860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:42.206296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1df3c-c751-49e8-883a-a6bb0878c860 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:42.217145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 111/222] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:42.220282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1df3c-c751-49e8-883a-a6bb0878c860 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:42.247506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59656f33-571a-4234-bbd0-e22539317ced None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:42.283059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb1f38-2497-455c-bd01-5500bf0974da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:42.283675 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1f38-2497-455c-bd01-5500bf0974da None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:42.283933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1f38-2497-455c-bd01-5500bf0974da None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:42.284207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1f38-2497-455c-bd01-5500bf0974da None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:42.284924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb1f38-2497-455c-bd01-5500bf0974da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:42.286277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb1f38-2497-455c-bd01-5500bf0974da None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:42.315694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:42.319542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1df3c-c751-49e8-883a-a6bb0878c860 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:42.351897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cad47e-52c9-439a-ba0c-b6bd3c3e5bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:42.352464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cad47e-52c9-439a-ba0c-b6bd3c3e5bbd None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:42.352743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cad47e-52c9-439a-ba0c-b6bd3c3e5bbd None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:42.353017 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cad47e-52c9-439a-ba0c-b6bd3c3e5bbd None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:42.354122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cad47e-52c9-439a-ba0c-b6bd3c3e5bbd None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:42.355883 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cad47e-52c9-439a-ba0c-b6bd3c3e5bbd None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:42.361353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 112/223] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:42 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:42.361353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cad47e-52c9-439a-ba0c-b6bd3c3e5bbd None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:42.407164 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 112/224] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:37:42 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:37:42.407164 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb1f38-2497-455c-bd01-5500bf0974da None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:42.470734 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cad47e-52c9-439a-ba0c-b6bd3c3e5bbd None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:42.490793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:42.511929 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb1f38-2497-455c-bd01-5500bf0974da None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:42.512638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81750707-1313-4290-a72c-9e398b3e1e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:42.513299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750707-1313-4290-a72c-9e398b3e1e72 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:42.513767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750707-1313-4290-a72c-9e398b3e1e72 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:42.514051 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750707-1313-4290-a72c-9e398b3e1e72 None admin] PATH_INFO: `/v3/users/ed0d2bc4054c40379a91836c77b3d487` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:42.530326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81750707-1313-4290-a72c-9e398b3e1e72 None admin] RBAC: Authorizing `identity:get_user(user_id=ed0d2bc4054c40379a91836c77b3d487)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:42.532374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81750707-1313-4290-a72c-9e398b3e1e72 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:42.534137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 113/225] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:42 2022] GET /identity/v3/users/ed0d2bc4054c40379a91836c77b3d487 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:42.539863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81750707-1313-4290-a72c-9e398b3e1e72 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:42.553266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61a44c-e7f8-4a54-947b-2742b00398b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:42.554443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61a44c-e7f8-4a54-947b-2742b00398b9 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:42.554443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61a44c-e7f8-4a54-947b-2742b00398b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:42.554443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61a44c-e7f8-4a54-947b-2742b00398b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:42.567594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61a44c-e7f8-4a54-947b-2742b00398b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:42.568168 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-de61a44c-e7f8-4a54-947b-2742b00398b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:42.573713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:42.574590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 113/226] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:37:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:42.579414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61a44c-e7f8-4a54-947b-2742b00398b9 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:42.666745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81750707-1313-4290-a72c-9e398b3e1e72 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:42.704126 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61a44c-e7f8-4a54-947b-2742b00398b9 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:42.708556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51bb41-83c6-44d3-80f8-e996f68fffcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:42.709373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51bb41-83c6-44d3-80f8-e996f68fffcd None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:42.709652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51bb41-83c6-44d3-80f8-e996f68fffcd None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:42.709979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51bb41-83c6-44d3-80f8-e996f68fffcd None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c/users/9c94935b555245e8b653c9312f1ca9d3/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:42.713045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51bb41-83c6-44d3-80f8-e996f68fffcd None admin] RBAC: Authorizing `identity:create_grant(project_id=977fa7acdb0b47bfb8fc7727e2878e1c, user_id=9c94935b555245e8b653c9312f1ca9d3, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:42.714498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51bb41-83c6-44d3-80f8-e996f68fffcd None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:42.745401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a08678-166c-4dcb-9881-288acca683fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:42.746018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08678-166c-4dcb-9881-288acca683fc None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:42.746296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08678-166c-4dcb-9881-288acca683fc None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:42.746564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08678-166c-4dcb-9881-288acca683fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:42.760158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:42.783068 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 114/227] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:37:42 2022] PUT /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c/users/9c94935b555245e8b653c9312f1ca9d3/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:42.785197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51bb41-83c6-44d3-80f8-e996f68fffcd None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:42.833722 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a08678-166c-4dcb-9881-288acca683fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:42.835236 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a08678-166c-4dcb-9881-288acca683fc None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:42.913383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:42.937210 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51bb41-83c6-44d3-80f8-e996f68fffcd None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:42.961916 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 114/228] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:42.967832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a08678-166c-4dcb-9881-288acca683fc None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:42.985640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165a4a4-93b5-4134-8c40-3a8c15270d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:42.986578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a4a4-93b5-4134-8c40-3a8c15270d02 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:42.987095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a4a4-93b5-4134-8c40-3a8c15270d02 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:42.988120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a4a4-93b5-4134-8c40-3a8c15270d02 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:42.989009 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165a4a4-93b5-4134-8c40-3a8c15270d02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:42.989496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165a4a4-93b5-4134-8c40-3a8c15270d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:42.991165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165a4a4-93b5-4134-8c40-3a8c15270d02 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:43.001979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 115/229] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:37:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:43.011957 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165a4a4-93b5-4134-8c40-3a8c15270d02 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:43.051206 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:43.141410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a08678-166c-4dcb-9881-288acca683fc None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:43.155663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165a4a4-93b5-4134-8c40-3a8c15270d02 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:43.252123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e9945-3d5b-47a9-a2f9-796b6a0af4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:43.252775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e9945-3d5b-47a9-a2f9-796b6a0af4b3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:43.253052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e9945-3d5b-47a9-a2f9-796b6a0af4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:43.253321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e9945-3d5b-47a9-a2f9-796b6a0af4b3 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:43.254173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca89f9-41db-4caf-8c37-34b210a911ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:43.254862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca89f9-41db-4caf-8c37-34b210a911ec None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:43.255167 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca89f9-41db-4caf-8c37-34b210a911ec None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:43.255441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca89f9-41db-4caf-8c37-34b210a911ec None admin] PATH_INFO: `/v3/users/9c94935b555245e8b653c9312f1ca9d3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:43.256671 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca89f9-41db-4caf-8c37-34b210a911ec None admin] RBAC: Authorizing `identity:get_user(user_id=9c94935b555245e8b653c9312f1ca9d3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:43.258127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca89f9-41db-4caf-8c37-34b210a911ec None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:43.258603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e9945-3d5b-47a9-a2f9-796b6a0af4b3 None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:43.259776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 116/230] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:43 2022] GET /identity/v3/users/9c94935b555245e8b653c9312f1ca9d3 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:43.260420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e9945-3d5b-47a9-a2f9-796b6a0af4b3 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:43.262328 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 115/231] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:42 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:43.265149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca89f9-41db-4caf-8c37-34b210a911ec None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:43.268257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e9945-3d5b-47a9-a2f9-796b6a0af4b3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:43.283840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:43.376561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca89f9-41db-4caf-8c37-34b210a911ec None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:43.442495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d8624-7d92-41bc-bf8e-e771f68279c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:43.443195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d8624-7d92-41bc-bf8e-e771f68279c3 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:43.443496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d8624-7d92-41bc-bf8e-e771f68279c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:43.443769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d8624-7d92-41bc-bf8e-e771f68279c3 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:43.445057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d8624-7d92-41bc-bf8e-e771f68279c3 None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:43.446517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d8624-7d92-41bc-bf8e-e771f68279c3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:43.448370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 117/232] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:43 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:43.454506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d8624-7d92-41bc-bf8e-e771f68279c3 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:43.465839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e9945-3d5b-47a9-a2f9-796b6a0af4b3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:43.486528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:43.528976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc5cb1-f84e-454a-b03c-e971decc9bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:43.529614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc5cb1-f84e-454a-b03c-e971decc9bc7 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:43.529899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc5cb1-f84e-454a-b03c-e971decc9bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:43.530279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc5cb1-f84e-454a-b03c-e971decc9bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:43.531045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc5cb1-f84e-454a-b03c-e971decc9bc7 None admin] RBAC: Adding query filter params (role.id=aaefcf4fc05547caa577d6f4db32e1b5, scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c, user.id=ed0d2bc4054c40379a91836c77b3d487) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:43.531355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc5cb1-f84e-454a-b03c-e971decc9bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:43.533361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc5cb1-f84e-454a-b03c-e971decc9bc7 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:43.545899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:43.547884 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 116/233] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:43 2022] GET /identity/v3/role_assignments?user.id=ed0d2bc4054c40379a91836c77b3d487&scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c&role.id=aaefcf4fc05547caa577d6f4db32e1b5 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:43.563724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d8624-7d92-41bc-bf8e-e771f68279c3 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:43.601890 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092f8c1-b997-4938-993a-2e4496cd608e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:43.602562 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092f8c1-b997-4938-993a-2e4496cd608e None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:43.602842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092f8c1-b997-4938-993a-2e4496cd608e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:43.603147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092f8c1-b997-4938-993a-2e4496cd608e None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c/users/9c94935b555245e8b653c9312f1ca9d3/roles/06cbbfa32c9549ffa2d1fd68736820a1` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:43.605789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092f8c1-b997-4938-993a-2e4496cd608e None admin] RBAC: Authorizing `identity:create_grant(project_id=977fa7acdb0b47bfb8fc7727e2878e1c, user_id=9c94935b555245e8b653c9312f1ca9d3, role_id=06cbbfa32c9549ffa2d1fd68736820a1)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:43.607274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092f8c1-b997-4938-993a-2e4496cd608e None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:43.713255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 118/234] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:37:43 2022] PUT /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c/users/9c94935b555245e8b653c9312f1ca9d3/roles/06cbbfa32c9549ffa2d1fd68736820a1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:44.852388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47a950-ae6a-45d8-96d7-1bcee0a77799 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:44.853397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47a950-ae6a-45d8-96d7-1bcee0a77799 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:44.853883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47a950-ae6a-45d8-96d7-1bcee0a77799 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:44.855890 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 117/235] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:44.868144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4df95-463e-42d9-84c7-5ffdfa8a7fa8 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:44.868555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4df95-463e-42d9-84c7-5ffdfa8a7fa8 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:44.868759 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4df95-463e-42d9-84c7-5ffdfa8a7fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:44.895828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-fcc4df95-463e-42d9-84c7-5ffdfa8a7fa8 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:44.897054 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-fcc4df95-463e-42d9-84c7-5ffdfa8a7fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:44.981741 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 119/236] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:45.068430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c006f3-24fd-43d1-bd7e-44d41dbc2d16 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:45.069091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c006f3-24fd-43d1-bd7e-44d41dbc2d16 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:45.069569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c006f3-24fd-43d1-bd7e-44d41dbc2d16 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:45.071171 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 118/237] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:45.086999 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff0911-43a3-4cd3-84d9-94d6ad0469f5 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:45.087286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff0911-43a3-4cd3-84d9-94d6ad0469f5 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:45.087563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff0911-43a3-4cd3-84d9-94d6ad0469f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:45.111883 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-07ff0911-43a3-4cd3-84d9-94d6ad0469f5 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:45.113083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-07ff0911-43a3-4cd3-84d9-94d6ad0469f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:45.157285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127a110-badd-4157-ad77-c308c37e6436 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:45.157927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127a110-badd-4157-ad77-c308c37e6436 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:45.158446 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127a110-badd-4157-ad77-c308c37e6436 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:45.165402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 119/238] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:37:45.172251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e39e36-a383-4148-9a3f-09932fccfebd None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:45.172670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e39e36-a383-4148-9a3f-09932fccfebd None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:45.173046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e39e36-a383-4148-9a3f-09932fccfebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:45.196992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 120/239] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:45.207657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-64e39e36-a383-4148-9a3f-09932fccfebd None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:45.211600 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-64e39e36-a383-4148-9a3f-09932fccfebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:45.321594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 120/240] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:45.391419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff0911-43a3-4cd3-84d9-94d6ad0469f5 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:45.394404 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:45.522851 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff0911-43a3-4cd3-84d9-94d6ad0469f5 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:45.545246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e39e36-a383-4148-9a3f-09932fccfebd None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:45.579095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379f256-f325-4dfa-8ff6-59870b65d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:45.581092 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379f256-f325-4dfa-8ff6-59870b65d943 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:45.582303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379f256-f325-4dfa-8ff6-59870b65d943 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:45.582802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379f256-f325-4dfa-8ff6-59870b65d943 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:45.598838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379f256-f325-4dfa-8ff6-59870b65d943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-1379f256-f325-4dfa-8ff6-59870b65d943 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:45.604003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:45.605162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:45.605948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 121/241] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:45.606597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc23875-3844-4b23-a5ee-4f14cb2dd4bf None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:45.611244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc23875-3844-4b23-a5ee-4f14cb2dd4bf None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:45.611244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc23875-3844-4b23-a5ee-4f14cb2dd4bf None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:45.611244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 122/242] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:45.614350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3af4-cc13-49e3-b004-5b1b61456bf8 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:45.614631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3af4-cc13-49e3-b004-5b1b61456bf8 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:45.614926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3af4-cc13-49e3-b004-5b1b61456bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:45.634804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-baed3af4-cc13-49e3-b004-5b1b61456bf8 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:45.636018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-baed3af4-cc13-49e3-b004-5b1b61456bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:45.676521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e39e36-a383-4148-9a3f-09932fccfebd None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:45.678844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:45.697376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:45.708760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 123/243] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:45.709851 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3af4-cc13-49e3-b004-5b1b61456bf8 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:45.714106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be72843-a776-441e-949d-16f6d07e2539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:45.714750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be72843-a776-441e-949d-16f6d07e2539 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:45.726202 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be72843-a776-441e-949d-16f6d07e2539 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:45.726202 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be72843-a776-441e-949d-16f6d07e2539 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:45.727319 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be72843-a776-441e-949d-16f6d07e2539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-5be72843-a776-441e-949d-16f6d07e2539 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:45.732613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:45.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:45.734299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 121/244] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:37:45.735509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be72843-a776-441e-949d-16f6d07e2539 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:45.825802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3af4-cc13-49e3-b004-5b1b61456bf8 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:45.862793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf056b7-b75b-43d8-9024-3de02be360a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:45.863340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf056b7-b75b-43d8-9024-3de02be360a5 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:45.863615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf056b7-b75b-43d8-9024-3de02be360a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:45.863829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be72843-a776-441e-949d-16f6d07e2539 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:45.864262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf056b7-b75b-43d8-9024-3de02be360a5 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:45.864533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf056b7-b75b-43d8-9024-3de02be360a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:45.864832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf056b7-b75b-43d8-9024-3de02be360a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:45.866206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf056b7-b75b-43d8-9024-3de02be360a5 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:45.878681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 124/245] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:45.880413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf056b7-b75b-43d8-9024-3de02be360a5 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:45.904226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df68961-6407-4523-8d63-078c50e3a86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:45.904860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df68961-6407-4523-8d63-078c50e3a86e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:45.905259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df68961-6407-4523-8d63-078c50e3a86e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:45.905556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df68961-6407-4523-8d63-078c50e3a86e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:45.907161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df68961-6407-4523-8d63-078c50e3a86e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:45.909433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df68961-6407-4523-8d63-078c50e3a86e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:45.911297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 122/246] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:45.912466 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df68961-6407-4523-8d63-078c50e3a86e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:45.946121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:45.956970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:46.006575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf056b7-b75b-43d8-9024-3de02be360a5 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:46.033306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df68961-6407-4523-8d63-078c50e3a86e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:46.048564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2ddad-13b1-4225-9ebe-93c221bd76e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:46.049171 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2ddad-13b1-4225-9ebe-93c221bd76e9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:46.049446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2ddad-13b1-4225-9ebe-93c221bd76e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:46.049713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2ddad-13b1-4225-9ebe-93c221bd76e9 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:46.050366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2ddad-13b1-4225-9ebe-93c221bd76e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:46.050662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2ddad-13b1-4225-9ebe-93c221bd76e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:46.052210 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2ddad-13b1-4225-9ebe-93c221bd76e9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:46.064904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 125/247] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:46.064904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2ddad-13b1-4225-9ebe-93c221bd76e9 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:46.074984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6885-e5ac-4c98-ad40-97661876fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:46.075628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6885-e5ac-4c98-ad40-97661876fe1d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:46.075906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6885-e5ac-4c98-ad40-97661876fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:46.076173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6885-e5ac-4c98-ad40-97661876fe1d None admin] PATH_INFO: `/v3/users/ccaffe5178214361abee5e22c0d86097` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:46.090309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a6885-e5ac-4c98-ad40-97661876fe1d None admin] RBAC: Authorizing `identity:get_user(user_id=ccaffe5178214361abee5e22c0d86097)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:46.091967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a6885-e5ac-4c98-ad40-97661876fe1d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:46.093757 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 123/248] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:45 2022] GET /identity/v3/users/ccaffe5178214361abee5e22c0d86097 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:46.095713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6885-e5ac-4c98-ad40-97661876fe1d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:46.172240 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2ddad-13b1-4225-9ebe-93c221bd76e9 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:46.189971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:46.194383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:46.206712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6885-e5ac-4c98-ad40-97661876fe1d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:46.209640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fe01c-c202-43a9-872a-1917d624b8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:46.210058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fe01c-c202-43a9-872a-1917d624b8a1 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:46.210336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fe01c-c202-43a9-872a-1917d624b8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:46.210607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fe01c-c202-43a9-872a-1917d624b8a1 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:46.211282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fe01c-c202-43a9-872a-1917d624b8a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:46.212756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fe01c-c202-43a9-872a-1917d624b8a1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:46.240400 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff00c53-8073-4dc9-96f0-a56f6e898e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:46.241033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff00c53-8073-4dc9-96f0-a56f6e898e92 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:46.241314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff00c53-8073-4dc9-96f0-a56f6e898e92 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:46.241587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff00c53-8073-4dc9-96f0-a56f6e898e92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:46.252387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff00c53-8073-4dc9-96f0-a56f6e898e92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-cff00c53-8073-4dc9-96f0-a56f6e898e92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:46.257256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:46.258277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:46.259114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 124/249] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:46.260287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff00c53-8073-4dc9-96f0-a56f6e898e92 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:46.311488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 126/250] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:37:46 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:37:46.312658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fe01c-c202-43a9-872a-1917d624b8a1 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:46.366268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff00c53-8073-4dc9-96f0-a56f6e898e92 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:46.404509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d636a40-3faa-4c60-83c5-6ee7b56f7b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:46.405161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d636a40-3faa-4c60-83c5-6ee7b56f7b15 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:46.405443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d636a40-3faa-4c60-83c5-6ee7b56f7b15 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:46.405714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d636a40-3faa-4c60-83c5-6ee7b56f7b15 None admin] PATH_INFO: `/v3/users/9c94935b555245e8b653c9312f1ca9d3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:46.406955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d636a40-3faa-4c60-83c5-6ee7b56f7b15 None admin] RBAC: Authorizing `identity:get_user(user_id=9c94935b555245e8b653c9312f1ca9d3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:46.408404 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d636a40-3faa-4c60-83c5-6ee7b56f7b15 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:46.410056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 125/251] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:46 2022] GET /identity/v3/users/9c94935b555245e8b653c9312f1ca9d3 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:46.410943 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d636a40-3faa-4c60-83c5-6ee7b56f7b15 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:46.429705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fe01c-c202-43a9-872a-1917d624b8a1 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:46.438411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:46.479151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371d43a-9df6-41df-8f3a-9cba131dc7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:46.480454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371d43a-9df6-41df-8f3a-9cba131dc7e6 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:46.480843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371d43a-9df6-41df-8f3a-9cba131dc7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:46.481120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371d43a-9df6-41df-8f3a-9cba131dc7e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:46.526195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:46.531006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d636a40-3faa-4c60-83c5-6ee7b56f7b15 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:46.558143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371d43a-9df6-41df-8f3a-9cba131dc7e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:46.559899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371d43a-9df6-41df-8f3a-9cba131dc7e6 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:46.581928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e414cb-746d-4f98-9ad5-790135dd53ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:46.582542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e414cb-746d-4f98-9ad5-790135dd53ac None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:46.582820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e414cb-746d-4f98-9ad5-790135dd53ac None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:46.583974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e414cb-746d-4f98-9ad5-790135dd53ac None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:46.583974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e414cb-746d-4f98-9ad5-790135dd53ac None admin] RBAC: Adding query filter params (name=member) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:46.584156 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e414cb-746d-4f98-9ad5-790135dd53ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:46.585566 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e414cb-746d-4f98-9ad5-790135dd53ac None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:46.596121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 126/252] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:46.597392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4883-7194-4734-b2b9-294fc8671101 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:46.597676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4883-7194-4734-b2b9-294fc8671101 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:46.597949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4883-7194-4734-b2b9-294fc8671101 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:46.599233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 127/253] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:46.599915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba4883-7194-4734-b2b9-294fc8671101 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:46.700104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 127/254] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:46.701325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371d43a-9df6-41df-8f3a-9cba131dc7e6 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:46.707257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:46.726794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba4883-7194-4734-b2b9-294fc8671101 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:46.765475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71690106-754b-454d-b847-4a649d33c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:46.766125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71690106-754b-454d-b847-4a649d33c568 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:46.766404 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71690106-754b-454d-b847-4a649d33c568 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:46.766670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71690106-754b-454d-b847-4a649d33c568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:46.790568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:46.821853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371d43a-9df6-41df-8f3a-9cba131dc7e6 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:46.839963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71690106-754b-454d-b847-4a649d33c568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:46.841415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71690106-754b-454d-b847-4a649d33c568 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:46.861810 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4e1f7-f04a-42d1-a74b-b767d2a07628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:46.862783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4e1f7-f04a-42d1-a74b-b767d2a07628 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:46.863355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4e1f7-f04a-42d1-a74b-b767d2a07628 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:46.863838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4e1f7-f04a-42d1-a74b-b767d2a07628 None admin] PATH_INFO: `/v3/users/ed0d2bc4054c40379a91836c77b3d487` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:46.865288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4e1f7-f04a-42d1-a74b-b767d2a07628 None admin] RBAC: Authorizing `identity:get_user(user_id=ed0d2bc4054c40379a91836c77b3d487)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:46.867264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4e1f7-f04a-42d1-a74b-b767d2a07628 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:46.873811 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 128/255] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:46 2022] GET /identity/v3/users/ed0d2bc4054c40379a91836c77b3d487 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:46.875340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f205c-5330-4526-aa7b-e7f852c73ed4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:46.875986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f205c-5330-4526-aa7b-e7f852c73ed4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:46.876551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f205c-5330-4526-aa7b-e7f852c73ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:46.903796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-605f205c-5330-4526-aa7b-e7f852c73ed4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:46.905034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-605f205c-5330-4526-aa7b-e7f852c73ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:46.955555 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 128/256] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:46.956064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:46.957119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71690106-754b-454d-b847-4a649d33c568 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:46.976902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 129/257] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:46.977930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f205c-5330-4526-aa7b-e7f852c73ed4 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:47.051662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:47.071211 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71690106-754b-454d-b847-4a649d33c568 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:47.083040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f205c-5330-4526-aa7b-e7f852c73ed4 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:47.107337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb188eb-6f71-464d-b4d6-a51626c306cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:47.108716 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb188eb-6f71-464d-b4d6-a51626c306cc None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:47.109204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb188eb-6f71-464d-b4d6-a51626c306cc None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:47.110200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb188eb-6f71-464d-b4d6-a51626c306cc None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:47.111768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb188eb-6f71-464d-b4d6-a51626c306cc None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:47.113412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb188eb-6f71-464d-b4d6-a51626c306cc None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:47.115505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 129/258] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:46 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:47.116729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb188eb-6f71-464d-b4d6-a51626c306cc None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:47.126677 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9592f-eea7-4050-94e7-af1015e67ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:47.127400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9592f-eea7-4050-94e7-af1015e67ffa None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:47.127625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9592f-eea7-4050-94e7-af1015e67ffa None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:47.127898 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9592f-eea7-4050-94e7-af1015e67ffa None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:47.130247 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9592f-eea7-4050-94e7-af1015e67ffa None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:47.132145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9592f-eea7-4050-94e7-af1015e67ffa None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:47.135431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 130/259] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:46 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:47.136225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9592f-eea7-4050-94e7-af1015e67ffa None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:47.191671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:47.271433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9592f-eea7-4050-94e7-af1015e67ffa None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:47.278104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb188eb-6f71-464d-b4d6-a51626c306cc None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:47.319792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4191d6-220e-4b87-90a6-e2facc5f7eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:47.321867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4191d6-220e-4b87-90a6-e2facc5f7eac None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:47.322159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4191d6-220e-4b87-90a6-e2facc5f7eac None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:47.322500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4191d6-220e-4b87-90a6-e2facc5f7eac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:47.323271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4191d6-220e-4b87-90a6-e2facc5f7eac None admin] RBAC: Adding query filter params (role.id=3567c7c724ee489eae05cd3b2a321a7f, scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c, user.id=ccaffe5178214361abee5e22c0d86097) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:47.323586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4191d6-220e-4b87-90a6-e2facc5f7eac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:47.325031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4191d6-220e-4b87-90a6-e2facc5f7eac None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:47.339786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 131/260] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:47 2022] GET /identity/v3/role_assignments?user.id=ccaffe5178214361abee5e22c0d86097&scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c&role.id=3567c7c724ee489eae05cd3b2a321a7f => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:47.340435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4191d6-220e-4b87-90a6-e2facc5f7eac None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:47.342072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e1634-c021-471e-bede-e4a0f87f0729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:47.342790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e1634-c021-471e-bede-e4a0f87f0729 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:47.347231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e1634-c021-471e-bede-e4a0f87f0729 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:47.347531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e1634-c021-471e-bede-e4a0f87f0729 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:47.351017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e1634-c021-471e-bede-e4a0f87f0729 None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:47.352483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e1634-c021-471e-bede-e4a0f87f0729 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:47.353022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:47.356038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 130/261] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:47 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:47.357058 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e1634-c021-471e-bede-e4a0f87f0729 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:47.477063 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4191d6-220e-4b87-90a6-e2facc5f7eac None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:47.517135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce83ee-d9ec-4cdb-91b7-f5fe237c42d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:47.517821 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce83ee-d9ec-4cdb-91b7-f5fe237c42d1 None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:47.518106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce83ee-d9ec-4cdb-91b7-f5fe237c42d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:47.518385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce83ee-d9ec-4cdb-91b7-f5fe237c42d1 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c/users/ed0d2bc4054c40379a91836c77b3d487/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:47.521566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce83ee-d9ec-4cdb-91b7-f5fe237c42d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=977fa7acdb0b47bfb8fc7727e2878e1c, user_id=ed0d2bc4054c40379a91836c77b3d487, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:47.523415 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce83ee-d9ec-4cdb-91b7-f5fe237c42d1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:47.596169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e1634-c021-471e-bede-e4a0f87f0729 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:47.603788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 132/262] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:37:47 2022] PUT /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c/users/ed0d2bc4054c40379a91836c77b3d487/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:47.604409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce83ee-d9ec-4cdb-91b7-f5fe237c42d1 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:47.636175 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:47.654452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba3787-9660-42ab-ac9a-e93c6d08ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:47.655136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba3787-9660-42ab-ac9a-e93c6d08ac0e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:47.655419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba3787-9660-42ab-ac9a-e93c6d08ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:47.655745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba3787-9660-42ab-ac9a-e93c6d08ac0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:47.683664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba3787-9660-42ab-ac9a-e93c6d08ac0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-06ba3787-9660-42ab-ac9a-e93c6d08ac0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:47.689277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:47.690221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:47.691296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 131/263] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:37:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:47.700004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba3787-9660-42ab-ac9a-e93c6d08ac0e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:47.738642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:47.811136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce83ee-d9ec-4cdb-91b7-f5fe237c42d1 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:47.878101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba3787-9660-42ab-ac9a-e93c6d08ac0e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:47.914699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96e9fb-507b-4b1e-bb18-264b9310cc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:47.915476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96e9fb-507b-4b1e-bb18-264b9310cc05 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:47.915779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96e9fb-507b-4b1e-bb18-264b9310cc05 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:47.916061 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96e9fb-507b-4b1e-bb18-264b9310cc05 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:47.916733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96e9fb-507b-4b1e-bb18-264b9310cc05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:47.917060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96e9fb-507b-4b1e-bb18-264b9310cc05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:47.918571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96e9fb-507b-4b1e-bb18-264b9310cc05 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:47.926575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cf713-a795-4a01-83fc-525036b8fc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:47.927860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cf713-a795-4a01-83fc-525036b8fc50 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:47.928348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cf713-a795-4a01-83fc-525036b8fc50 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:47.928817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cf713-a795-4a01-83fc-525036b8fc50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:47.929134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 132/264] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:37:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:47.929926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704cf713-a795-4a01-83fc-525036b8fc50 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c, user.id=9c94935b555245e8b653c9312f1ca9d3) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:47.930371 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704cf713-a795-4a01-83fc-525036b8fc50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:47.931996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704cf713-a795-4a01-83fc-525036b8fc50 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:47.941417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96e9fb-507b-4b1e-bb18-264b9310cc05 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:47.944908 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 133/265] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:47 2022] GET /identity/v3/role_assignments?user.id=9c94935b555245e8b653c9312f1ca9d3&scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 608 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:48.008430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:48.068799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96e9fb-507b-4b1e-bb18-264b9310cc05 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:48.105137 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a842c-acf3-484d-9c89-75f5e5127f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:48.105837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a842c-acf3-484d-9c89-75f5e5127f56 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:48.106186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a842c-acf3-484d-9c89-75f5e5127f56 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:48.106464 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a842c-acf3-484d-9c89-75f5e5127f56 None admin] PATH_INFO: `/v3/users/9c94935b555245e8b653c9312f1ca9d3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:48.107680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a842c-acf3-484d-9c89-75f5e5127f56 None admin] RBAC: Authorizing `identity:get_user(user_id=9c94935b555245e8b653c9312f1ca9d3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:48.109189 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a842c-acf3-484d-9c89-75f5e5127f56 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:48.111712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 133/266] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:47 2022] GET /identity/v3/users/9c94935b555245e8b653c9312f1ca9d3 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:48.117443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cf713-a795-4a01-83fc-525036b8fc50 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:48.290788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cf713-a795-4a01-83fc-525036b8fc50 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:48.323129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:48.335906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746aeb8-16b2-4bc8-99fc-e9cd58d61564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:48.338862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746aeb8-16b2-4bc8-99fc-e9cd58d61564 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:48.338862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746aeb8-16b2-4bc8-99fc-e9cd58d61564 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:48.338862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746aeb8-16b2-4bc8-99fc-e9cd58d61564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:48.448192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746aeb8-16b2-4bc8-99fc-e9cd58d61564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:48.449681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746aeb8-16b2-4bc8-99fc-e9cd58d61564 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:48.587563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 134/267] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:48.593407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a842c-acf3-484d-9c89-75f5e5127f56 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:48.678590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9faf57-91ac-4c76-a2d7-fdcd5635dd6a None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:48.678999 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9faf57-91ac-4c76-a2d7-fdcd5635dd6a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:48.679351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9faf57-91ac-4c76-a2d7-fdcd5635dd6a None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:48.682123 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 135/268] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:48.687286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8352d-7221-40d3-9e8d-747edf009fda None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:48.687678 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8352d-7221-40d3-9e8d-747edf009fda None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:48.688160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8352d-7221-40d3-9e8d-747edf009fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:48.725307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a842c-acf3-484d-9c89-75f5e5127f56 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:48.735543 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-35b8352d-7221-40d3-9e8d-747edf009fda None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:48.736759 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-35b8352d-7221-40d3-9e8d-747edf009fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:48.755305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:48.775179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a88ac8-068c-406b-87d8-0aa6a5e1764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:48.776174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a88ac8-068c-406b-87d8-0aa6a5e1764d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:48.776659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a88ac8-068c-406b-87d8-0aa6a5e1764d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:48.777145 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a88ac8-068c-406b-87d8-0aa6a5e1764d None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:48.777386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:48.783620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a88ac8-068c-406b-87d8-0aa6a5e1764d None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:48.785331 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a88ac8-068c-406b-87d8-0aa6a5e1764d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:48.787269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 134/269] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:48 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:48.793369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a88ac8-068c-406b-87d8-0aa6a5e1764d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:48.835387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 136/270] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:48.989891 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a88ac8-068c-406b-87d8-0aa6a5e1764d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:49.039600 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9e99-0d92-48ee-94d1-831ccea977f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:49.040217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9e99-0d92-48ee-94d1-831ccea977f4 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:49.040469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9e99-0d92-48ee-94d1-831ccea977f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:49.040748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9e99-0d92-48ee-94d1-831ccea977f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:49.041478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f9e99-0d92-48ee-94d1-831ccea977f4 None admin] RBAC: Adding query filter params (role.id=06cbbfa32c9549ffa2d1fd68736820a1, scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c, user.id=9c94935b555245e8b653c9312f1ca9d3) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:49.041788 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f9e99-0d92-48ee-94d1-831ccea977f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:49.043248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f9e99-0d92-48ee-94d1-831ccea977f4 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:49.055731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 135/271] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:48 2022] GET /identity/v3/role_assignments?user.id=9c94935b555245e8b653c9312f1ca9d3&scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c&role.id=06cbbfa32c9549ffa2d1fd68736820a1 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:49.130438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8352d-7221-40d3-9e8d-747edf009fda None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:49.240814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ab46-2862-43fb-bc07-609f3643ad14 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:49.241110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ab46-2862-43fb-bc07-609f3643ad14 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:49.241284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ab46-2862-43fb-bc07-609f3643ad14 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:49.242912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 136/272] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:49.247252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8352d-7221-40d3-9e8d-747edf009fda None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:49.252337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730d21-2a5e-4cba-9210-bcea53887e2e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:49.252612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730d21-2a5e-4cba-9210-bcea53887e2e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:49.252896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730d21-2a5e-4cba-9210-bcea53887e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:49.288591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a7730d21-2a5e-4cba-9210-bcea53887e2e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:49.288936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fdd39-6ca0-4b98-9dbf-fbd123fdfea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:49.288936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fdd39-6ca0-4b98-9dbf-fbd123fdfea5 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:49.289243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a7730d21-2a5e-4cba-9210-bcea53887e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:49.289385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fdd39-6ca0-4b98-9dbf-fbd123fdfea5 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:49.289385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fdd39-6ca0-4b98-9dbf-fbd123fdfea5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:49.302125 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fdd39-6ca0-4b98-9dbf-fbd123fdfea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-701fdd39-6ca0-4b98-9dbf-fbd123fdfea5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:49.307223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:49.308577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:49.309365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:49.309365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:49.309365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:49.309365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:49.309365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:49.309365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:49.309365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:49.309365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:49.309365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:49.309365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:49.309365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:49.309365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:49.310455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 137/273] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:49.315093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fdd39-6ca0-4b98-9dbf-fbd123fdfea5 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:49.348430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:49.350016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:49.390111 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 137/274] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:49.447014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fdd39-6ca0-4b98-9dbf-fbd123fdfea5 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:49.483861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d41dc-e8fb-4194-8c6d-d66912eadee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:49.484502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d41dc-e8fb-4194-8c6d-d66912eadee0 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:49.484787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d41dc-e8fb-4194-8c6d-d66912eadee0 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:49.485061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d41dc-e8fb-4194-8c6d-d66912eadee0 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:49.485724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d41dc-e8fb-4194-8c6d-d66912eadee0 None admin] RBAC: Adding query filter params (name=member) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:49.486028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d41dc-e8fb-4194-8c6d-d66912eadee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:49.487507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d41dc-e8fb-4194-8c6d-d66912eadee0 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:49.496513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 138/275] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:49.501879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7730d21-2a5e-4cba-9210-bcea53887e2e None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:49.618510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7730d21-2a5e-4cba-9210-bcea53887e2e None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:49.659341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123eac3-46ec-4c82-8b51-9510cd50c8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:49.659981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123eac3-46ec-4c82-8b51-9510cd50c8b0 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:49.660262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123eac3-46ec-4c82-8b51-9510cd50c8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:49.660592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123eac3-46ec-4c82-8b51-9510cd50c8b0 None admin] PATH_INFO: `/v3/users/bae48fd722bc4d2c90731a4aecb65be2` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:49.676193 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123eac3-46ec-4c82-8b51-9510cd50c8b0 None admin] RBAC: Authorizing `identity:get_user(user_id=bae48fd722bc4d2c90731a4aecb65be2)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:49.677654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123eac3-46ec-4c82-8b51-9510cd50c8b0 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:49.679712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 138/276] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:49 2022] GET /identity/v3/users/bae48fd722bc4d2c90731a4aecb65be2 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:49.685574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d41dc-e8fb-4194-8c6d-d66912eadee0 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:49.690674 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123eac3-46ec-4c82-8b51-9510cd50c8b0 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:49.718727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:49.805710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:49.816958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123eac3-46ec-4c82-8b51-9510cd50c8b0 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:49.836470 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d41dc-e8fb-4194-8c6d-d66912eadee0 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:49.855381 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adc787-f9b3-43b8-a442-7b9af178ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:49.856002 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adc787-f9b3-43b8-a442-7b9af178ff14 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:49.856282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adc787-f9b3-43b8-a442-7b9af178ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:49.856552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adc787-f9b3-43b8-a442-7b9af178ff14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:49.857667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adc787-f9b3-43b8-a442-7b9af178ff14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:49.859131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adc787-f9b3-43b8-a442-7b9af178ff14 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:49.866122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 139/277] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:49.866952 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adc787-f9b3-43b8-a442-7b9af178ff14 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:49.883651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86110a8-15f6-44c8-8fb3-ed77c47861b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:49.884785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86110a8-15f6-44c8-8fb3-ed77c47861b2 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:49.885210 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86110a8-15f6-44c8-8fb3-ed77c47861b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:49.885833 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86110a8-15f6-44c8-8fb3-ed77c47861b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:49.887464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86110a8-15f6-44c8-8fb3-ed77c47861b2 None admin] RBAC: Adding query filter params (role.id=aaefcf4fc05547caa577d6f4db32e1b5, user.id=bae48fd722bc4d2c90731a4aecb65be2, scope.system=all) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:49.887951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86110a8-15f6-44c8-8fb3-ed77c47861b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:49.889434 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86110a8-15f6-44c8-8fb3-ed77c47861b2 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:49.895293 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 139/278] 10.222.0.73 () {56 vars in 1308 bytes} [Mon Aug 29 23:37:49 2022] GET /identity/v3/role_assignments?user.id=bae48fd722bc4d2c90731a4aecb65be2&scope.system=all&role.id=aaefcf4fc05547caa577d6f4db32e1b5 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:49.896562 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec66f4-1fbf-4bcc-8400-d8d1f1cc988a None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:49.896853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec66f4-1fbf-4bcc-8400-d8d1f1cc988a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:49.897179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec66f4-1fbf-4bcc-8400-d8d1f1cc988a None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:49.898679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 140/279] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:49.905905 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799edc9e-4325-40a7-8c14-d320ee6b127c None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:49.910935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799edc9e-4325-40a7-8c14-d320ee6b127c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:49.910935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799edc9e-4325-40a7-8c14-d320ee6b127c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:49.929378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-799edc9e-4325-40a7-8c14-d320ee6b127c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:49.930751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-799edc9e-4325-40a7-8c14-d320ee6b127c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:49.987736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:49.995624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adc787-f9b3-43b8-a442-7b9af178ff14 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:50.012034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 141/280] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:50.041242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d6b52-f595-4e0e-99dc-219bfc13b64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:50.041883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d6b52-f595-4e0e-99dc-219bfc13b64c None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:50.042295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d6b52-f595-4e0e-99dc-219bfc13b64c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:50.042643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d6b52-f595-4e0e-99dc-219bfc13b64c None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:50.043412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d6b52-f595-4e0e-99dc-219bfc13b64c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:50.044931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d6b52-f595-4e0e-99dc-219bfc13b64c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:50.071217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2239717-ad51-4cce-bb82-8fae9de7a870 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:50.071508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2239717-ad51-4cce-bb82-8fae9de7a870 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:50.071748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2239717-ad51-4cce-bb82-8fae9de7a870 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:50.073174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 142/281] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:37:50.078629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c33620-9dac-40e9-b641-f2aac5191c56 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:50.078947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c33620-9dac-40e9-b641-f2aac5191c56 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:50.079229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c33620-9dac-40e9-b641-f2aac5191c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:50.099277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-43c33620-9dac-40e9-b641-f2aac5191c56 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:50.100504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-43c33620-9dac-40e9-b641-f2aac5191c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:50.157760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 140/282] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:37:49 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:37:50.182215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 143/283] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:50.293038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d6b52-f595-4e0e-99dc-219bfc13b64c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:50.402791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d6b52-f595-4e0e-99dc-219bfc13b64c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:50.439365 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deecb5d-7dd8-47cd-bc51-20ad0cfd9453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:50.440005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deecb5d-7dd8-47cd-bc51-20ad0cfd9453 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:50.440288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deecb5d-7dd8-47cd-bc51-20ad0cfd9453 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:50.440557 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deecb5d-7dd8-47cd-bc51-20ad0cfd9453 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:50.452645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deecb5d-7dd8-47cd-bc51-20ad0cfd9453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-7deecb5d-7dd8-47cd-bc51-20ad0cfd9453 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:50.459230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:50.460112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:50.460889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:50.460889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:50.460889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:50.460889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:50.460889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:50.460889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:50.460889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:50.460889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:50.460889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:50.460889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:50.460889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:50.460889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:50.461506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 141/284] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:50.466784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c33620-9dac-40e9-b641-f2aac5191c56 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:50.469539 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:50.484905 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deecb5d-7dd8-47cd-bc51-20ad0cfd9453 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:50.497969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:50.596144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c33620-9dac-40e9-b641-f2aac5191c56 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:50.613589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deecb5d-7dd8-47cd-bc51-20ad0cfd9453 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:50.643918 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651d38f-6480-472c-a367-8c52da2387fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:50.644549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d38f-6480-472c-a367-8c52da2387fc None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:50.644827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d38f-6480-472c-a367-8c52da2387fc None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:50.645146 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d38f-6480-472c-a367-8c52da2387fc None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:50.645826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651d38f-6480-472c-a367-8c52da2387fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:50.646329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651d38f-6480-472c-a367-8c52da2387fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:50.649293 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651d38f-6480-472c-a367-8c52da2387fc None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:50.660272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 144/285] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:50.662317 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea838c-28f7-42a1-91e6-a4ae7e8f34c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:50.662987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea838c-28f7-42a1-91e6-a4ae7e8f34c0 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:50.663273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea838c-28f7-42a1-91e6-a4ae7e8f34c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:50.663547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea838c-28f7-42a1-91e6-a4ae7e8f34c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:50.665208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651d38f-6480-472c-a367-8c52da2387fc None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:50.682029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea838c-28f7-42a1-91e6-a4ae7e8f34c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-77ea838c-28f7-42a1-91e6-a4ae7e8f34c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:50.689373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:50.690232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:50.691548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 142/286] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:37:50.696450 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea838c-28f7-42a1-91e6-a4ae7e8f34c0 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:50.783496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:50.840256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:50.861887 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651d38f-6480-472c-a367-8c52da2387fc None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:50.896333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea838c-28f7-42a1-91e6-a4ae7e8f34c0 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:50.925983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32134700-e5e0-44e8-98c6-84d81e59df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:50.926619 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32134700-e5e0-44e8-98c6-84d81e59df80 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:50.927019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32134700-e5e0-44e8-98c6-84d81e59df80 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:50.927191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32134700-e5e0-44e8-98c6-84d81e59df80 None admin] PATH_INFO: `/v3/users/ccaffe5178214361abee5e22c0d86097` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:50.928396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32134700-e5e0-44e8-98c6-84d81e59df80 None admin] RBAC: Authorizing `identity:get_user(user_id=ccaffe5178214361abee5e22c0d86097)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:50.929836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32134700-e5e0-44e8-98c6-84d81e59df80 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:50.932025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 145/287] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:50 2022] GET /identity/v3/users/ccaffe5178214361abee5e22c0d86097 => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:50.937136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32134700-e5e0-44e8-98c6-84d81e59df80 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:50.945339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00826d4-9c01-4453-b6e8-4b4098c0ab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:50.946242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00826d4-9c01-4453-b6e8-4b4098c0ab11 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:50.946726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00826d4-9c01-4453-b6e8-4b4098c0ab11 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:50.947302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00826d4-9c01-4453-b6e8-4b4098c0ab11 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:50.948201 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00826d4-9c01-4453-b6e8-4b4098c0ab11 None admin] RBAC: Adding query filter params (name=member) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:50.948703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00826d4-9c01-4453-b6e8-4b4098c0ab11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:50.950281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00826d4-9c01-4453-b6e8-4b4098c0ab11 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:50.960193 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 143/288] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:50.966066 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00826d4-9c01-4453-b6e8-4b4098c0ab11 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:51.112617 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32134700-e5e0-44e8-98c6-84d81e59df80 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:51.167610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:51.169121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00826d4-9c01-4453-b6e8-4b4098c0ab11 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:51.181172 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cee31-d56f-4134-8448-627379f43827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:51.181746 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cee31-d56f-4134-8448-627379f43827 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:51.182028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cee31-d56f-4134-8448-627379f43827 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:51.182303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cee31-d56f-4134-8448-627379f43827 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:51.183704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cee31-d56f-4134-8448-627379f43827 None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:51.185230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cee31-d56f-4134-8448-627379f43827 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:51.187245 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 146/289] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:50 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:51.193355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cee31-d56f-4134-8448-627379f43827 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:51.235242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:51.242839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4d5b9-0136-4fe5-a0af-b59dda08cac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:51.243496 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d5b9-0136-4fe5-a0af-b59dda08cac6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:51.243777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d5b9-0136-4fe5-a0af-b59dda08cac6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:51.244049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d5b9-0136-4fe5-a0af-b59dda08cac6 None admin] PATH_INFO: `/v3/users/ed0d2bc4054c40379a91836c77b3d487` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:51.245305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4d5b9-0136-4fe5-a0af-b59dda08cac6 None admin] RBAC: Authorizing `identity:get_user(user_id=ed0d2bc4054c40379a91836c77b3d487)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:51.246757 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4d5b9-0136-4fe5-a0af-b59dda08cac6 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:51.248371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 144/290] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:50 2022] GET /identity/v3/users/ed0d2bc4054c40379a91836c77b3d487 => generated 297 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:51.253977 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4d5b9-0136-4fe5-a0af-b59dda08cac6 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:51.338688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cee31-d56f-4134-8448-627379f43827 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:51.400100 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a202f-5ea1-4aaf-ab59-9fe360206dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:51.400889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a202f-5ea1-4aaf-ab59-9fe360206dbe None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:51.401164 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a202f-5ea1-4aaf-ab59-9fe360206dbe None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:51.401439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a202f-5ea1-4aaf-ab59-9fe360206dbe None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c/users/ccaffe5178214361abee5e22c0d86097/roles/3567c7c724ee489eae05cd3b2a321a7f` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:51.407756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a202f-5ea1-4aaf-ab59-9fe360206dbe None admin] RBAC: Authorizing `identity:create_grant(project_id=977fa7acdb0b47bfb8fc7727e2878e1c, user_id=ccaffe5178214361abee5e22c0d86097, role_id=3567c7c724ee489eae05cd3b2a321a7f)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:51.409278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a202f-5ea1-4aaf-ab59-9fe360206dbe None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:51.423821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4d5b9-0136-4fe5-a0af-b59dda08cac6 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:51.459719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2d019-aac6-485e-8ef5-e1485dffc5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:51.460592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2d019-aac6-485e-8ef5-e1485dffc5d1 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:51.461032 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2d019-aac6-485e-8ef5-e1485dffc5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:51.461449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2d019-aac6-485e-8ef5-e1485dffc5d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:51.503498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 147/291] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:37:51 2022] PUT /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c/users/ccaffe5178214361abee5e22c0d86097/roles/3567c7c724ee489eae05cd3b2a321a7f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:51.535681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:51.543320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2d019-aac6-485e-8ef5-e1485dffc5d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:51.545086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2d019-aac6-485e-8ef5-e1485dffc5d1 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:51.658355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 145/292] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:51.664215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a202f-5ea1-4aaf-ab59-9fe360206dbe None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:51.757183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:51.815609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a202f-5ea1-4aaf-ab59-9fe360206dbe None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:51.856765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653764d-6786-491d-b138-74514cf724dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:51.857462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653764d-6786-491d-b138-74514cf724dc None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:51.857747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653764d-6786-491d-b138-74514cf724dc None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:51.858021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653764d-6786-491d-b138-74514cf724dc None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:51.859206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653764d-6786-491d-b138-74514cf724dc None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:51.860683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653764d-6786-491d-b138-74514cf724dc None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:51.862934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 148/293] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:51 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:51.868948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2d019-aac6-485e-8ef5-e1485dffc5d1 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:51.896934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86e537-64a4-431f-9c62-211f008fb8cd None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:51.897498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86e537-64a4-431f-9c62-211f008fb8cd None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:51.897945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86e537-64a4-431f-9c62-211f008fb8cd None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:51.899489 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 149/294] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:37:51.904748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80281e-4627-457d-96d4-6e5c06e136bc None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:51.905037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80281e-4627-457d-96d4-6e5c06e136bc None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:51.905312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80281e-4627-457d-96d4-6e5c06e136bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:51.939833 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-3f80281e-4627-457d-96d4-6e5c06e136bc None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:51.941046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-3f80281e-4627-457d-96d4-6e5c06e136bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:51.977713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:51.981134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2d019-aac6-485e-8ef5-e1485dffc5d1 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:52.016439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48679526-f296-4d07-9609-e438cc84874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:52.017395 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48679526-f296-4d07-9609-e438cc84874f None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:52.017903 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48679526-f296-4d07-9609-e438cc84874f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:52.018365 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48679526-f296-4d07-9609-e438cc84874f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:52.019372 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48679526-f296-4d07-9609-e438cc84874f None admin] RBAC: Adding query filter params (role.id=aaefcf4fc05547caa577d6f4db32e1b5, scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c, user.id=ed0d2bc4054c40379a91836c77b3d487) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:52.019876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48679526-f296-4d07-9609-e438cc84874f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:52.021501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48679526-f296-4d07-9609-e438cc84874f None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:52.028813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 146/295] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:51 2022] GET /identity/v3/role_assignments?user.id=ed0d2bc4054c40379a91836c77b3d487&scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c&role.id=aaefcf4fc05547caa577d6f4db32e1b5 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:52.053771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 150/296] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:52.420823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48679526-f296-4d07-9609-e438cc84874f None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:52.526067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48679526-f296-4d07-9609-e438cc84874f None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:52.567166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b65fb-01e4-4d42-8ecd-f4fd9cdc5157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:52.568164 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b65fb-01e4-4d42-8ecd-f4fd9cdc5157 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:52.568637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b65fb-01e4-4d42-8ecd-f4fd9cdc5157 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:52.569120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b65fb-01e4-4d42-8ecd-f4fd9cdc5157 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:52.584639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b65fb-01e4-4d42-8ecd-f4fd9cdc5157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-a96b65fb-01e4-4d42-8ecd-f4fd9cdc5157 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:52.589511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:52.590397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:52.591200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 147/297] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:52.598510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80281e-4627-457d-96d4-6e5c06e136bc None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:52.662463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:52.706229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80281e-4627-457d-96d4-6e5c06e136bc None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:52.716492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd4a6a-75c1-4f77-bd49-dfafe4ddbbfb None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:52.717166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd4a6a-75c1-4f77-bd49-dfafe4ddbbfb None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:52.717611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd4a6a-75c1-4f77-bd49-dfafe4ddbbfb None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:52.719638 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 148/298] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:52.720584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544d978-96bd-4a51-9299-6f0c07ea18ee None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:52.720869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544d978-96bd-4a51-9299-6f0c07ea18ee None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:52.721483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544d978-96bd-4a51-9299-6f0c07ea18ee None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:52.723248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 149/299] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:52.728847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656203ab-0d7b-4625-a7f8-4bfdbaa4c16d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:52.729488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656203ab-0d7b-4625-a7f8-4bfdbaa4c16d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:52.730222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656203ab-0d7b-4625-a7f8-4bfdbaa4c16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:52.745072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e7105-8127-46f8-86d7-8af834249e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:52.745688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e7105-8127-46f8-86d7-8af834249e79 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:52.745965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e7105-8127-46f8-86d7-8af834249e79 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:52.746233 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e7105-8127-46f8-86d7-8af834249e79 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:52.746904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e7105-8127-46f8-86d7-8af834249e79 None admin] RBAC: Adding query filter params (name=member) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:52.747629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e7105-8127-46f8-86d7-8af834249e79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:52.749071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e7105-8127-46f8-86d7-8af834249e79 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:52.753329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-656203ab-0d7b-4625-a7f8-4bfdbaa4c16d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:52.755005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-656203ab-0d7b-4625-a7f8-4bfdbaa4c16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:52.758929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 151/300] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:52.758929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba864b-6c62-445f-ae34-e58eba867831 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:52.759119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba864b-6c62-445f-ae34-e58eba867831 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:52.759971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba864b-6c62-445f-ae34-e58eba867831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:52.775970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:52.777454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-9cba864b-6c62-445f-ae34-e58eba867831 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:52.778639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9cba864b-6c62-445f-ae34-e58eba867831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:52.836511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 150/301] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:52.838012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656203ab-0d7b-4625-a7f8-4bfdbaa4c16d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:52.853262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 152/302] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:52.947465 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656203ab-0d7b-4625-a7f8-4bfdbaa4c16d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:52.994691 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7625-38f7-475b-b9a8-51bb67e646d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:52.996473 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7625-38f7-475b-b9a8-51bb67e646d1 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:52.996763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7625-38f7-475b-b9a8-51bb67e646d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:52.997041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7625-38f7-475b-b9a8-51bb67e646d1 None admin] PATH_INFO: `/v3/users/bae48fd722bc4d2c90731a4aecb65be2` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:53.004980 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be7625-38f7-475b-b9a8-51bb67e646d1 None admin] RBAC: Authorizing `identity:get_user(user_id=bae48fd722bc4d2c90731a4aecb65be2)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:53.006655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be7625-38f7-475b-b9a8-51bb67e646d1 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:53.008516 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 151/303] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:52 2022] GET /identity/v3/users/bae48fd722bc4d2c90731a4aecb65be2 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:53.017485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba864b-6c62-445f-ae34-e58eba867831 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:53.083124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:53.136120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba864b-6c62-445f-ae34-e58eba867831 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:53.158894 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7625-38f7-475b-b9a8-51bb67e646d1 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:53.179598 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7eeba-4507-48c5-b2a0-a4047c21955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:53.180292 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7eeba-4507-48c5-b2a0-a4047c21955c None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:53.180572 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7eeba-4507-48c5-b2a0-a4047c21955c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:53.180852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7eeba-4507-48c5-b2a0-a4047c21955c None admin] PATH_INFO: `/v3/system/users/bae48fd722bc4d2c90731a4aecb65be2/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:53.182364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7eeba-4507-48c5-b2a0-a4047c21955c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bae48fd722bc4d2c90731a4aecb65be2, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:53.183769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7eeba-4507-48c5-b2a0-a4047c21955c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:53.190608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:53.272154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7625-38f7-475b-b9a8-51bb67e646d1 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:53.277862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 153/304] 10.222.0.73 () {58 vars in 1334 bytes} [Mon Aug 29 23:37:53 2022] PUT /identity/v3/system/users/bae48fd722bc4d2c90731a4aecb65be2/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:53.278743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7eeba-4507-48c5-b2a0-a4047c21955c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:53.347454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20aed5f-fb90-4640-957d-b6bd4a341d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:53.348117 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aed5f-fb90-4640-957d-b6bd4a341d9b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:53.350940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aed5f-fb90-4640-957d-b6bd4a341d9b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:53.351955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aed5f-fb90-4640-957d-b6bd4a341d9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:53.391728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20aed5f-fb90-4640-957d-b6bd4a341d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-a20aed5f-fb90-4640-957d-b6bd4a341d9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:53.397422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:53.398362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:53.399210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:53.399210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:53.399210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:53.399210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:53.399210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:53.399210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:53.399210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:53.399210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:53.399210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:53.399210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:53.399210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:53.399210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:53.402338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 152/305] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:37:53.409193 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20aed5f-fb90-4640-957d-b6bd4a341d9b None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:53.434961 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7eeba-4507-48c5-b2a0-a4047c21955c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:53.452879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:53.484618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebf3ab-48c4-480e-a311-02d8b4f9b5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:53.485382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebf3ab-48c4-480e-a311-02d8b4f9b5d1 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:53.485669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebf3ab-48c4-480e-a311-02d8b4f9b5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:53.485943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebf3ab-48c4-480e-a311-02d8b4f9b5d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:53.487123 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebf3ab-48c4-480e-a311-02d8b4f9b5d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:53.488717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebf3ab-48c4-480e-a311-02d8b4f9b5d1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:53.490181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 154/306] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:53.497579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebf3ab-48c4-480e-a311-02d8b4f9b5d1 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:53.564016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:53.589662 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20aed5f-fb90-4640-957d-b6bd4a341d9b None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:53.633129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e0472-a32d-4a45-b001-c82126c81ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:53.633740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e0472-a32d-4a45-b001-c82126c81ce7 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:53.634020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e0472-a32d-4a45-b001-c82126c81ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:53.634293 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e0472-a32d-4a45-b001-c82126c81ce7 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:53.634979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e0472-a32d-4a45-b001-c82126c81ce7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:53.635284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e0472-a32d-4a45-b001-c82126c81ce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:53.636657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e0472-a32d-4a45-b001-c82126c81ce7 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:53.643963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebf3ab-48c4-480e-a311-02d8b4f9b5d1 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:53.650408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 153/307] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:53.651398 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e0472-a32d-4a45-b001-c82126c81ce7 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:53.692625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4412cc-ed77-4f89-9a45-0b4e9fd969b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:53.694217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4412cc-ed77-4f89-9a45-0b4e9fd969b2 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:53.694706 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4412cc-ed77-4f89-9a45-0b4e9fd969b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:53.695202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4412cc-ed77-4f89-9a45-0b4e9fd969b2 None admin] PATH_INFO: `/v3/groups` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:53.696513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4412cc-ed77-4f89-9a45-0b4e9fd969b2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:53.698970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4412cc-ed77-4f89-9a45-0b4e9fd969b2 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:53.763002 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e0472-a32d-4a45-b001-c82126c81ce7 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:53.801305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f04502-8283-48ce-b186-ba6f6dccec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:53.801992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04502-8283-48ce-b186-ba6f6dccec62 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:53.802252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04502-8283-48ce-b186-ba6f6dccec62 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:53.802522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04502-8283-48ce-b186-ba6f6dccec62 None admin] PATH_INFO: `/v3/users/cacce1e622b04b84b780cf979508e728` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:53.804526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 155/308] 10.222.0.73 () {60 vars in 1134 bytes} [Mon Aug 29 23:37:53 2022] POST /identity/v3/groups => generated 229 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:37:53.806939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bdd57-8802-494e-b664-1ea046193dca None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:53.807606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bdd57-8802-494e-b664-1ea046193dca None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:53.808032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bdd57-8802-494e-b664-1ea046193dca None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:53.809646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 156/309] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:53.819378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adfcc2-8d2b-43b3-8e9d-58fae261ef65 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:53.819378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adfcc2-8d2b-43b3-8e9d-58fae261ef65 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:53.819378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adfcc2-8d2b-43b3-8e9d-58fae261ef65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:53.820957 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f04502-8283-48ce-b186-ba6f6dccec62 None admin] RBAC: Authorizing `identity:get_user(user_id=cacce1e622b04b84b780cf979508e728)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:53.823003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f04502-8283-48ce-b186-ba6f6dccec62 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:53.831099 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 154/310] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:53 2022] GET /identity/v3/users/cacce1e622b04b84b780cf979508e728 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:53.834035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f04502-8283-48ce-b186-ba6f6dccec62 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:53.837256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:53.840927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a7adfcc2-8d2b-43b3-8e9d-58fae261ef65 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:53.842479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a7adfcc2-8d2b-43b3-8e9d-58fae261ef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:53.900238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:53.938048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 157/311] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:53.957176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f04502-8283-48ce-b186-ba6f6dccec62 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:53.996341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ec1ba-a9de-4f77-b692-8df512dda2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:53.997325 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ec1ba-a9de-4f77-b692-8df512dda2f0 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:53.997830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ec1ba-a9de-4f77-b692-8df512dda2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:53.998304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ec1ba-a9de-4f77-b692-8df512dda2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:53.999278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ec1ba-a9de-4f77-b692-8df512dda2f0 None admin] RBAC: Adding query filter params (role.id=3567c7c724ee489eae05cd3b2a321a7f, user.id=cacce1e622b04b84b780cf979508e728, scope.system=all) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:53.999863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ec1ba-a9de-4f77-b692-8df512dda2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:54.001987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ec1ba-a9de-4f77-b692-8df512dda2f0 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:54.007478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 155/312] 10.222.0.73 () {56 vars in 1308 bytes} [Mon Aug 29 23:37:53 2022] GET /identity/v3/role_assignments?user.id=cacce1e622b04b84b780cf979508e728&scope.system=all&role.id=3567c7c724ee489eae05cd3b2a321a7f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:54.207687 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adfcc2-8d2b-43b3-8e9d-58fae261ef65 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:54.314275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adfcc2-8d2b-43b3-8e9d-58fae261ef65 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:54.351637 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c8b89-13c6-4da6-95e2-77f642bc7f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:54.352659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c8b89-13c6-4da6-95e2-77f642bc7f24 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:54.353141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c8b89-13c6-4da6-95e2-77f642bc7f24 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:54.353610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c8b89-13c6-4da6-95e2-77f642bc7f24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:54.365731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c8b89-13c6-4da6-95e2-77f642bc7f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-cf5c8b89-13c6-4da6-95e2-77f642bc7f24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:54.370982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:54.371836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:54.372638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:54.372638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:54.372638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:54.372638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:54.372638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:54.372638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:54.372638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:54.372638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:54.372638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:54.372638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:54.372638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:54.372638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:37:54.375208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 158/313] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:54.384235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ec1ba-a9de-4f77-b692-8df512dda2f0 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:54.456962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:54.490627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ec1ba-a9de-4f77-b692-8df512dda2f0 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:54.525535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5859f-a571-4fb0-9cf7-6093d4d0e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:54.526149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5859f-a571-4fb0-9cf7-6093d4d0e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:54.526423 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5859f-a571-4fb0-9cf7-6093d4d0e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:54.526688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5859f-a571-4fb0-9cf7-6093d4d0e9d5 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:54.527370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5859f-a571-4fb0-9cf7-6093d4d0e9d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:54.527667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5859f-a571-4fb0-9cf7-6093d4d0e9d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:54.529008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5859f-a571-4fb0-9cf7-6093d4d0e9d5 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:54.539512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 156/314] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:54.544706 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c8b89-13c6-4da6-95e2-77f642bc7f24 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:54.580009 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:54.657684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c8b89-13c6-4da6-95e2-77f642bc7f24 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:54.693046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334c24e-4520-4c30-a23e-c94da0d1c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:54.693682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334c24e-4520-4c30-a23e-c94da0d1c1cb None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:54.693962 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334c24e-4520-4c30-a23e-c94da0d1c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:54.694238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334c24e-4520-4c30-a23e-c94da0d1c1cb None admin] PATH_INFO: `/v3/users/ccaffe5178214361abee5e22c0d86097` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:54.695423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334c24e-4520-4c30-a23e-c94da0d1c1cb None admin] RBAC: Authorizing `identity:get_user(user_id=ccaffe5178214361abee5e22c0d86097)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:54.696871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334c24e-4520-4c30-a23e-c94da0d1c1cb None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:54.698649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 159/315] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:54 2022] GET /identity/v3/users/ccaffe5178214361abee5e22c0d86097 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:54.704671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5859f-a571-4fb0-9cf7-6093d4d0e9d5 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:54.805487 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5859f-a571-4fb0-9cf7-6093d4d0e9d5 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:54.832143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:54.840429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60865461-33b6-48d7-99ff-757181c7703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:54.841047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865461-33b6-48d7-99ff-757181c7703c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:54.841328 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865461-33b6-48d7-99ff-757181c7703c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:54.841597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865461-33b6-48d7-99ff-757181c7703c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:54.913208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60865461-33b6-48d7-99ff-757181c7703c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:54.914773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60865461-33b6-48d7-99ff-757181c7703c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:55.018946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 157/316] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:37:55.027980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334c24e-4520-4c30-a23e-c94da0d1c1cb None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:55.132064 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:55.135823 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334c24e-4520-4c30-a23e-c94da0d1c1cb None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:55.176166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb469d-017c-473a-9a91-564819469029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:55.176791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb469d-017c-473a-9a91-564819469029 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:55.177070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb469d-017c-473a-9a91-564819469029 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:55.177375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb469d-017c-473a-9a91-564819469029 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:55.178501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb469d-017c-473a-9a91-564819469029 None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:55.179969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb469d-017c-473a-9a91-564819469029 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:55.181587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 160/317] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:37:55 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:55.187999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60865461-33b6-48d7-99ff-757181c7703c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:55.218225 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:55.293730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60865461-33b6-48d7-99ff-757181c7703c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:55.298520 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4a1ce-4769-4fcb-8c92-65fa3965694c None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:55.298806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4a1ce-4769-4fcb-8c92-65fa3965694c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:55.299118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4a1ce-4769-4fcb-8c92-65fa3965694c None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:55.300735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 161/318] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:37:55.305651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa264102-209a-4990-ae88-5c1377c065d3 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:55.305774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa264102-209a-4990-ae88-5c1377c065d3 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:55.306058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa264102-209a-4990-ae88-5c1377c065d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:55.323923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-fa264102-209a-4990-ae88-5c1377c065d3 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:55.325125 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-fa264102-209a-4990-ae88-5c1377c065d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:55.334794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b339c-28e9-41a7-8e5e-6713c05bef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:55.335443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b339c-28e9-41a7-8e5e-6713c05bef8e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:55.335725 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b339c-28e9-41a7-8e5e-6713c05bef8e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:55.335997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b339c-28e9-41a7-8e5e-6713c05bef8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:55.336823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b339c-28e9-41a7-8e5e-6713c05bef8e None admin] RBAC: Adding query filter params (role.id=3567c7c724ee489eae05cd3b2a321a7f, scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c, user.id=ccaffe5178214361abee5e22c0d86097) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:55.337131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b339c-28e9-41a7-8e5e-6713c05bef8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:55.338604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b339c-28e9-41a7-8e5e-6713c05bef8e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:55.345579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 158/319] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:37:55 2022] GET /identity/v3/role_assignments?user.id=ccaffe5178214361abee5e22c0d86097&scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c&role.id=3567c7c724ee489eae05cd3b2a321a7f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:55.404757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 162/320] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:55.675918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b339c-28e9-41a7-8e5e-6713c05bef8e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:55.775948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:55.785240 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b339c-28e9-41a7-8e5e-6713c05bef8e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:55.820251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585e977-9e98-4311-96c5-c7ebc883723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:55.821323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585e977-9e98-4311-96c5-c7ebc883723c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:55.822225 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585e977-9e98-4311-96c5-c7ebc883723c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:55.822496 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585e977-9e98-4311-96c5-c7ebc883723c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:55.832862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585e977-9e98-4311-96c5-c7ebc883723c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-3585e977-9e98-4311-96c5-c7ebc883723c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:55.837713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:55.838584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:55.844197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 159/321] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:55.845720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa264102-209a-4990-ae88-5c1377c065d3 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:55.935304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83030b-48dd-49aa-a274-9593523e4e1a None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:55.935629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83030b-48dd-49aa-a274-9593523e4e1a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:55.935799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83030b-48dd-49aa-a274-9593523e4e1a None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:55.937241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 160/322] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:37:55.941970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad36bf-4eb7-40b5-849e-0e69ab7f5a91 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:55.942255 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad36bf-4eb7-40b5-849e-0e69ab7f5a91 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:55.942560 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad36bf-4eb7-40b5-849e-0e69ab7f5a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:55.944881 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:55.949008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa264102-209a-4990-ae88-5c1377c065d3 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:55.961194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-b8ad36bf-4eb7-40b5-849e-0e69ab7f5a91 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:55.962394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b8ad36bf-4eb7-40b5-849e-0e69ab7f5a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:55.986928 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f77fb-bce3-4cdc-97e5-0c95ef17c1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:55.987549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f77fb-bce3-4cdc-97e5-0c95ef17c1c3 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:55.987827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f77fb-bce3-4cdc-97e5-0c95ef17c1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:55.988101 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f77fb-bce3-4cdc-97e5-0c95ef17c1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:55.988769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f77fb-bce3-4cdc-97e5-0c95ef17c1c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:55.989072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f77fb-bce3-4cdc-97e5-0c95ef17c1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:55.990442 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f77fb-bce3-4cdc-97e5-0c95ef17c1c3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:55.998974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 163/323] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:56.004176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f77fb-bce3-4cdc-97e5-0c95ef17c1c3 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:56.035479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 161/324] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:56.040236 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9331603-7cf0-4e95-9429-84a8aea276db None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:56.040528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9331603-7cf0-4e95-9429-84a8aea276db None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:56.040805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9331603-7cf0-4e95-9429-84a8aea276db None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:56.042200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 162/325] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:56.047755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac14d42-9e83-47f3-8423-d15f20d175a6 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:56.048218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac14d42-9e83-47f3-8423-d15f20d175a6 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:56.048334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac14d42-9e83-47f3-8423-d15f20d175a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:56.066234 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-1ac14d42-9e83-47f3-8423-d15f20d175a6 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:56.067463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1ac14d42-9e83-47f3-8423-d15f20d175a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:56.110729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f77fb-bce3-4cdc-97e5-0c95ef17c1c3 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:56.147195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 163/326] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:37:56.151839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d72535-9f1c-43e2-9d17-7aae130efebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:56.152625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d72535-9f1c-43e2-9d17-7aae130efebf None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:56.153118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d72535-9f1c-43e2-9d17-7aae130efebf None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:56.153527 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d72535-9f1c-43e2-9d17-7aae130efebf None admin] PATH_INFO: `/v3/users/bae48fd722bc4d2c90731a4aecb65be2` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:56.154837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d72535-9f1c-43e2-9d17-7aae130efebf None admin] RBAC: Authorizing `identity:get_user(user_id=bae48fd722bc4d2c90731a4aecb65be2)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:56.156997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d72535-9f1c-43e2-9d17-7aae130efebf None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:56.159103 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 164/327] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:56 2022] GET /identity/v3/users/bae48fd722bc4d2c90731a4aecb65be2 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:56.164674 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac14d42-9e83-47f3-8423-d15f20d175a6 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:56.179063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:56.262317 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac14d42-9e83-47f3-8423-d15f20d175a6 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:56.296865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49ecc3-adb5-47e8-8234-e9e4daff4423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:56.297473 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49ecc3-adb5-47e8-8234-e9e4daff4423 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:56.297758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49ecc3-adb5-47e8-8234-e9e4daff4423 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:56.298025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49ecc3-adb5-47e8-8234-e9e4daff4423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:56.298740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49ecc3-adb5-47e8-8234-e9e4daff4423 None admin] RBAC: Adding query filter params (role.id=aaefcf4fc05547caa577d6f4db32e1b5, user.id=bae48fd722bc4d2c90731a4aecb65be2, scope.system=all) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:56.299075 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49ecc3-adb5-47e8-8234-e9e4daff4423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:56.300489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49ecc3-adb5-47e8-8234-e9e4daff4423 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:56.303932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d72535-9f1c-43e2-9d17-7aae130efebf None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:56.313591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 164/328] 10.222.0.73 () {56 vars in 1308 bytes} [Mon Aug 29 23:37:56 2022] GET /identity/v3/role_assignments?user.id=bae48fd722bc4d2c90731a4aecb65be2&scope.system=all&role.id=aaefcf4fc05547caa577d6f4db32e1b5 => generated 510 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:56.339326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:56.418629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d72535-9f1c-43e2-9d17-7aae130efebf None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:56.419030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49ecc3-adb5-47e8-8234-e9e4daff4423 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:56.464628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00ec1e-ff98-443e-8fcb-9642d4bd2105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:56.465271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00ec1e-ff98-443e-8fcb-9642d4bd2105 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:56.465551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00ec1e-ff98-443e-8fcb-9642d4bd2105 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:56.467015 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00ec1e-ff98-443e-8fcb-9642d4bd2105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:56.467015 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00ec1e-ff98-443e-8fcb-9642d4bd2105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:56.468464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00ec1e-ff98-443e-8fcb-9642d4bd2105 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:56.470217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 165/329] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:37:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:56.476671 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00ec1e-ff98-443e-8fcb-9642d4bd2105 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:56.501240 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:56.533299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49ecc3-adb5-47e8-8234-e9e4daff4423 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:56.566964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d608b1-60a2-4f4f-a797-7dbb1410d1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:56.567646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d608b1-60a2-4f4f-a797-7dbb1410d1e2 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:56.567877 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d608b1-60a2-4f4f-a797-7dbb1410d1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:56.568150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d608b1-60a2-4f4f-a797-7dbb1410d1e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:56.578127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d608b1-60a2-4f4f-a797-7dbb1410d1e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:56.579397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-90d608b1-60a2-4f4f-a797-7dbb1410d1e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:56.583449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:56.584512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:56.585297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:56.585297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:56.585297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:56.585297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:56.585297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:56.585297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:56.585297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:56.585297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:56.585297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:56.585297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:56.585297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:37:56.585297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:56.585974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00ec1e-ff98-443e-8fcb-9642d4bd2105 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:56.589431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 165/330] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:37:56.590252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d608b1-60a2-4f4f-a797-7dbb1410d1e2 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:56.620083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2fc53-2565-48ff-8b04-0d60a723bf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:56.620691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2fc53-2565-48ff-8b04-0d60a723bf9d None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:56.620972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2fc53-2565-48ff-8b04-0d60a723bf9d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:56.621249 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2fc53-2565-48ff-8b04-0d60a723bf9d None admin] PATH_INFO: `/v3/groups` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:56.621900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2fc53-2565-48ff-8b04-0d60a723bf9d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:56.623385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2fc53-2565-48ff-8b04-0d60a723bf9d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:56.688887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d608b1-60a2-4f4f-a797-7dbb1410d1e2 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:56.705350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 166/331] 10.222.0.73 () {60 vars in 1134 bytes} [Mon Aug 29 23:37:56 2022] POST /identity/v3/groups => generated 226 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:37:56.717464 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:56.724042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9737b7-6b88-45d3-9ba3-b9df15676464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:56.724669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9737b7-6b88-45d3-9ba3-b9df15676464 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:56.724948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9737b7-6b88-45d3-9ba3-b9df15676464 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:56.725220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9737b7-6b88-45d3-9ba3-b9df15676464 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:56.725909 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9737b7-6b88-45d3-9ba3-b9df15676464 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:56.726232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9737b7-6b88-45d3-9ba3-b9df15676464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:56.727680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9737b7-6b88-45d3-9ba3-b9df15676464 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:56.744746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 166/332] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:56.745830 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2fc53-2565-48ff-8b04-0d60a723bf9d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:56.853333 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2fc53-2565-48ff-8b04-0d60a723bf9d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:56.889527 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c868513-df4c-4b0d-8845-d949dd2abc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:56.890177 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c868513-df4c-4b0d-8845-d949dd2abc92 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:56.890981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c868513-df4c-4b0d-8845-d949dd2abc92 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:56.891254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c868513-df4c-4b0d-8845-d949dd2abc92 None admin] PATH_INFO: `/v3/users/cacce1e622b04b84b780cf979508e728` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:56.892383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c868513-df4c-4b0d-8845-d949dd2abc92 None admin] RBAC: Authorizing `identity:get_user(user_id=cacce1e622b04b84b780cf979508e728)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:56.893813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c868513-df4c-4b0d-8845-d949dd2abc92 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:56.895433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 167/333] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:37:56 2022] GET /identity/v3/users/cacce1e622b04b84b780cf979508e728 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:37:56.901168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9737b7-6b88-45d3-9ba3-b9df15676464 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:57.011909 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9737b7-6b88-45d3-9ba3-b9df15676464 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:57.049719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7e42-9dc7-4a8d-afd2-db6d63dd97bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:57.050376 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7e42-9dc7-4a8d-afd2-db6d63dd97bb None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:57.050658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7e42-9dc7-4a8d-afd2-db6d63dd97bb None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:57.050963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7e42-9dc7-4a8d-afd2-db6d63dd97bb None admin] PATH_INFO: `/v3/system/users/cacce1e622b04b84b780cf979508e728/roles/3567c7c724ee489eae05cd3b2a321a7f` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:57.052480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe7e42-9dc7-4a8d-afd2-db6d63dd97bb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cacce1e622b04b84b780cf979508e728, role_id=3567c7c724ee489eae05cd3b2a321a7f)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:57.053846 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe7e42-9dc7-4a8d-afd2-db6d63dd97bb None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:57.124054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 167/334] 10.222.0.73 () {58 vars in 1334 bytes} [Mon Aug 29 23:37:56 2022] PUT /identity/v3/system/users/cacce1e622b04b84b780cf979508e728/roles/3567c7c724ee489eae05cd3b2a321a7f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:58.886739 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cdbaa-8c18-422f-b79e-ba591739d686 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:58.887264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cdbaa-8c18-422f-b79e-ba591739d686 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:58.887336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cdbaa-8c18-422f-b79e-ba591739d686 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:58.888974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 168/335] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:58.894584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e660e-24de-49d3-8772-46092b0073e0 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:58.895428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e660e-24de-49d3-8772-46092b0073e0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:58.895930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e660e-24de-49d3-8772-46092b0073e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:58.915098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-835e660e-24de-49d3-8772-46092b0073e0 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:58.916610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-835e660e-24de-49d3-8772-46092b0073e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:58.980661 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:58.998864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 168/336] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:59.262298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51335f17-6a05-44e6-b06d-0dd6746a1515 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:59.262590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51335f17-6a05-44e6-b06d-0dd6746a1515 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:59.262770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51335f17-6a05-44e6-b06d-0dd6746a1515 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:59.264376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 169/337] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:59.279186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67185fd-53be-456e-b533-71a2479a52fa None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:59.279479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67185fd-53be-456e-b533-71a2479a52fa None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:59.279750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67185fd-53be-456e-b533-71a2479a52fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:59.301264 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-b67185fd-53be-456e-b533-71a2479a52fa None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:59.302477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b67185fd-53be-456e-b533-71a2479a52fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:59.316383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1600c-4387-4836-b4c8-b49f29996868 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:59.316670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1600c-4387-4836-b4c8-b49f29996868 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:59.316931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1600c-4387-4836-b4c8-b49f29996868 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:59.318530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 170/338] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:59.323680 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff3744-515f-4656-abb9-7f19776253d6 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:59.324133 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff3744-515f-4656-abb9-7f19776253d6 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:59.324410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff3744-515f-4656-abb9-7f19776253d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:59.356205 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-33ff3744-515f-4656-abb9-7f19776253d6 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:59.357579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-33ff3744-515f-4656-abb9-7f19776253d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:59.385129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:59.434930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 169/339] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:59.435812 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67185fd-53be-456e-b533-71a2479a52fa None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:59.461445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 171/340] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:37:59.592874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67185fd-53be-456e-b533-71a2479a52fa None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:59.620513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:59.644200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdf603-658f-4782-89d5-6909de56bf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:59.644849 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdf603-658f-4782-89d5-6909de56bf60 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:59.645126 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdf603-658f-4782-89d5-6909de56bf60 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:59.645396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdf603-658f-4782-89d5-6909de56bf60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:59.663868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdf603-658f-4782-89d5-6909de56bf60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-d9cdf603-658f-4782-89d5-6909de56bf60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:37:59.669703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:37:59.670579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:37:59.671431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:37:59.671431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:37:59.671431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:37:59.671431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:37:59.671431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:37:59.671431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:37:59.671431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:37:59.671431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:37:59.671431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:37:59.671431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:37:59.671431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:37:59.671431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:37:59.674442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 170/341] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:37:59.679807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff3744-515f-4656-abb9-7f19776253d6 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:59.823726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff3744-515f-4656-abb9-7f19776253d6 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:59.866430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b572413-d8b7-4758-abd4-320e8dc5b43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:59.866994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b572413-d8b7-4758-abd4-320e8dc5b43b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:59.867274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b572413-d8b7-4758-abd4-320e8dc5b43b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:59.867550 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b572413-d8b7-4758-abd4-320e8dc5b43b None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:59.868218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b572413-d8b7-4758-abd4-320e8dc5b43b None admin] RBAC: Adding query filter params (name=member) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:59.868520 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b572413-d8b7-4758-abd4-320e8dc5b43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:59.869906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b572413-d8b7-4758-abd4-320e8dc5b43b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:59.879436 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 172/342] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:37:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:59.884572 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdf603-658f-4782-89d5-6909de56bf60 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:59.884780 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b572413-d8b7-4758-abd4-320e8dc5b43b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:59.907574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:00.025360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b572413-d8b7-4758-abd4-320e8dc5b43b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:00.040155 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdf603-658f-4782-89d5-6909de56bf60 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:00.063267 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f6fad-4cac-4668-b653-26678a6bdbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:00.063982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f6fad-4cac-4668-b653-26678a6bdbbe None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:00.064267 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f6fad-4cac-4668-b653-26678a6bdbbe None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:00.064533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f6fad-4cac-4668-b653-26678a6bdbbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:00.082640 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00cf57-09f8-457c-975f-1daf5fd84d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:00.083320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00cf57-09f8-457c-975f-1daf5fd84d4e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:00.083602 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00cf57-09f8-457c-975f-1daf5fd84d4e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:00.083875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00cf57-09f8-457c-975f-1daf5fd84d4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:00.096801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00cf57-09f8-457c-975f-1daf5fd84d4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-fc00cf57-09f8-457c-975f-1daf5fd84d4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:00.102048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:00.102993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:00.103782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 171/343] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:37:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:00.104430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00cf57-09f8-457c-975f-1daf5fd84d4e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:00.146941 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f6fad-4cac-4668-b653-26678a6bdbbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:00.148617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:00.149249 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f6fad-4cac-4668-b653-26678a6bdbbe None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:00.167685 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:00.222939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00cf57-09f8-457c-975f-1daf5fd84d4e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:00.264839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 173/344] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:37:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:38:00.266309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eac27-4165-40a6-83c7-538e7ecbe224 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:00.268960 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e96f9-6747-4cd1-ac3c-fc0dc7c3e339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:00.269599 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e96f9-6747-4cd1-ac3c-fc0dc7c3e339 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:00.269879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e96f9-6747-4cd1-ac3c-fc0dc7c3e339 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:00.270153 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e96f9-6747-4cd1-ac3c-fc0dc7c3e339 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:00.271261 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eac27-4165-40a6-83c7-538e7ecbe224 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:00.271585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eac27-4165-40a6-83c7-538e7ecbe224 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:00.273280 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 174/345] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:00.274085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eac27-4165-40a6-83c7-538e7ecbe224 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:00.282255 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e96f9-6747-4cd1-ac3c-fc0dc7c3e339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-4a4e96f9-6747-4cd1-ac3c-fc0dc7c3e339 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:00.287205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:00.289295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 172/346] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:38:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:00.291165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e96f9-6747-4cd1-ac3c-fc0dc7c3e339 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:00.404549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:00.407425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eac27-4165-40a6-83c7-538e7ecbe224 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:00.411398 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e96f9-6747-4cd1-ac3c-fc0dc7c3e339 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:00.429734 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:00.451437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3c26-bfbb-4434-8404-1339b85e546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:00.452103 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3c26-bfbb-4434-8404-1339b85e546e None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:00.452389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3c26-bfbb-4434-8404-1339b85e546e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:00.452689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3c26-bfbb-4434-8404-1339b85e546e None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:00.453173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb9684-3188-4afc-86cd-f9689e98131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:00.453359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc3c26-bfbb-4434-8404-1339b85e546e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:00.453667 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc3c26-bfbb-4434-8404-1339b85e546e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:00.454251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb9684-3188-4afc-86cd-f9689e98131a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:00.454679 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb9684-3188-4afc-86cd-f9689e98131a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:00.455075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc3c26-bfbb-4434-8404-1339b85e546e None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:00.458788 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb9684-3188-4afc-86cd-f9689e98131a None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:00.458788 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb9684-3188-4afc-86cd-f9689e98131a None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:00.458788 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb9684-3188-4afc-86cd-f9689e98131a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:00.459996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 173/347] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:00 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:00.461353 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954a9e9-141d-4e89-800d-069fe42d712d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:00.461641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954a9e9-141d-4e89-800d-069fe42d712d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:00.463023 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954a9e9-141d-4e89-800d-069fe42d712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:00.465431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 175/348] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:38:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:00.466340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3c26-bfbb-4434-8404-1339b85e546e None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:00.490354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5954a9e9-141d-4e89-800d-069fe42d712d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:00.491756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5954a9e9-141d-4e89-800d-069fe42d712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:00.585590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 174/349] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:00.586733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954a9e9-141d-4e89-800d-069fe42d712d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:00.619018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3c26-bfbb-4434-8404-1339b85e546e None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:00.684408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288175a-5b90-4172-9ebb-cd3b8751fa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:00.684949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288175a-5b90-4172-9ebb-cd3b8751fa5d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:00.685231 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288175a-5b90-4172-9ebb-cd3b8751fa5d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:00.685504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288175a-5b90-4172-9ebb-cd3b8751fa5d None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:00.686186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288175a-5b90-4172-9ebb-cd3b8751fa5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:00.686559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288175a-5b90-4172-9ebb-cd3b8751fa5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:00.688009 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288175a-5b90-4172-9ebb-cd3b8751fa5d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:00.699616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 176/350] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:00.702471 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288175a-5b90-4172-9ebb-cd3b8751fa5d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:00.769920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:00.781781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954a9e9-141d-4e89-800d-069fe42d712d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:00.785044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:00.826823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe80598-889e-46ee-a674-20bfcb1c7596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:00.828412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe80598-889e-46ee-a674-20bfcb1c7596 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:00.828915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe80598-889e-46ee-a674-20bfcb1c7596 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:00.829399 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe80598-889e-46ee-a674-20bfcb1c7596 None admin] PATH_INFO: `/v3/groups/167c7f13daa24f70864ae59406d88eb3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:00.840296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe80598-889e-46ee-a674-20bfcb1c7596 None admin] RBAC: Authorizing `identity:get_group(group_id=167c7f13daa24f70864ae59406d88eb3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:00.842461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe80598-889e-46ee-a674-20bfcb1c7596 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:00.845660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 175/351] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:00 2022] GET /identity/v3/groups/167c7f13daa24f70864ae59406d88eb3 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:00.847014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe80598-889e-46ee-a674-20bfcb1c7596 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:00.860136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288175a-5b90-4172-9ebb-cd3b8751fa5d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:00.897701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a2df9-7811-4734-b823-36662c696707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:00.898337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a2df9-7811-4734-b823-36662c696707 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:00.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a2df9-7811-4734-b823-36662c696707 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:00.899031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a2df9-7811-4734-b823-36662c696707 None admin] PATH_INFO: `/v3/users/cacce1e622b04b84b780cf979508e728` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:00.901765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a2df9-7811-4734-b823-36662c696707 None admin] RBAC: Authorizing `identity:get_user(user_id=cacce1e622b04b84b780cf979508e728)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:00.903239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a2df9-7811-4734-b823-36662c696707 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:00.905159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 177/352] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:38:00 2022] GET /identity/v3/users/cacce1e622b04b84b780cf979508e728 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:00.908147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d20672-d0f2-4baa-a6bb-96b61e61b20f None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:00.908691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d20672-d0f2-4baa-a6bb-96b61e61b20f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:00.908790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d20672-d0f2-4baa-a6bb-96b61e61b20f None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:00.910229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 178/353] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:00.910804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d20672-d0f2-4baa-a6bb-96b61e61b20f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:00.978200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe80598-889e-46ee-a674-20bfcb1c7596 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:01.019123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e18f90-6649-4f2d-b6fe-71c9f74d9a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:01.019739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e18f90-6649-4f2d-b6fe-71c9f74d9a17 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:01.020015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e18f90-6649-4f2d-b6fe-71c9f74d9a17 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:01.020437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e18f90-6649-4f2d-b6fe-71c9f74d9a17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:01.041333 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d20672-d0f2-4baa-a6bb-96b61e61b20f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:01.052795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:01.057804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:01.095901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6964b20-fcb4-401b-a6f0-d3f4b70d638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:01.096564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6964b20-fcb4-401b-a6f0-d3f4b70d638f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:01.096800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6964b20-fcb4-401b-a6f0-d3f4b70d638f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:01.097072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6964b20-fcb4-401b-a6f0-d3f4b70d638f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:01.097800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6964b20-fcb4-401b-a6f0-d3f4b70d638f None admin] RBAC: Adding query filter params (group.id=167c7f13daa24f70864ae59406d88eb3, role.id=aaefcf4fc05547caa577d6f4db32e1b5, scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:01.098160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6964b20-fcb4-401b-a6f0-d3f4b70d638f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:01.103129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6964b20-fcb4-401b-a6f0-d3f4b70d638f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:01.106459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e18f90-6649-4f2d-b6fe-71c9f74d9a17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:01.107008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 179/354] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Aug 29 23:38:00 2022] GET /identity/v3/role_assignments?group.id=167c7f13daa24f70864ae59406d88eb3&scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a&role.id=aaefcf4fc05547caa577d6f4db32e1b5 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:01.107969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e18f90-6649-4f2d-b6fe-71c9f74d9a17 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:01.109832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803367e-b497-47cf-9b16-f21a663aa61c None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:01.110165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803367e-b497-47cf-9b16-f21a663aa61c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:01.110384 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803367e-b497-47cf-9b16-f21a663aa61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:01.133976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d803367e-b497-47cf-9b16-f21a663aa61c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:01.135531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d803367e-b497-47cf-9b16-f21a663aa61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:01.241302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 180/355] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:01.241943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803367e-b497-47cf-9b16-f21a663aa61c None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:01.245994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 176/356] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:01.247218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e18f90-6649-4f2d-b6fe-71c9f74d9a17 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:01.359822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:01.379968 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e18f90-6649-4f2d-b6fe-71c9f74d9a17 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:01.383721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803367e-b497-47cf-9b16-f21a663aa61c None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:01.385288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:01.420220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35dc33-fbc8-4750-86cb-7b06238f538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:01.421978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35dc33-fbc8-4750-86cb-7b06238f538d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:01.422438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35dc33-fbc8-4750-86cb-7b06238f538d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:01.422973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35dc33-fbc8-4750-86cb-7b06238f538d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:01.427261 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad855a5-0f47-4ab6-80fd-2777b7969ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:01.427875 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad855a5-0f47-4ab6-80fd-2777b7969ae9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:01.428155 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad855a5-0f47-4ab6-80fd-2777b7969ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:01.428428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad855a5-0f47-4ab6-80fd-2777b7969ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:01.429420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad855a5-0f47-4ab6-80fd-2777b7969ae9 None admin] RBAC: Adding query filter params (role.id=3567c7c724ee489eae05cd3b2a321a7f, user.id=cacce1e622b04b84b780cf979508e728, scope.system=all) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:01.429753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad855a5-0f47-4ab6-80fd-2777b7969ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:01.433839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad855a5-0f47-4ab6-80fd-2777b7969ae9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:01.439154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35dc33-fbc8-4750-86cb-7b06238f538d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-3c35dc33-fbc8-4750-86cb-7b06238f538d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:01.444612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:01.445504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:01.446295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:01.446295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:01.446295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:01.446295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:01.446295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:01.446295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:01.446295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:01.446295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:01.446295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:01.446295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:01.446295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:38:01.446295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:01.446933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 181/357] 10.222.0.73 () {56 vars in 1308 bytes} [Mon Aug 29 23:38:01 2022] GET /identity/v3/role_assignments?user.id=cacce1e622b04b84b780cf979508e728&scope.system=all&role.id=3567c7c724ee489eae05cd3b2a321a7f => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:01.448228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597af1-4181-487b-9bd3-9ba94050f34b None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:01.448575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597af1-4181-487b-9bd3-9ba94050f34b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:01.448854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597af1-4181-487b-9bd3-9ba94050f34b None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:01.449326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 177/358] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:01.450316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35dc33-fbc8-4750-86cb-7b06238f538d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:01.450604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 182/359] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:01.457920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d622c-77b0-489d-8776-39b098ae0c25 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:01.458345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d622c-77b0-489d-8776-39b098ae0c25 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:01.458725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d622c-77b0-489d-8776-39b098ae0c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:01.496079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-c69d622c-77b0-489d-8776-39b098ae0c25 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:01.497715 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c69d622c-77b0-489d-8776-39b098ae0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:01.572165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35dc33-fbc8-4750-86cb-7b06238f538d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:01.608378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:01.621707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ac0fa-da53-42a2-9c6a-31b116ef0a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:01.622566 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ac0fa-da53-42a2-9c6a-31b116ef0a3e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:01.622966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ac0fa-da53-42a2-9c6a-31b116ef0a3e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:01.623365 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ac0fa-da53-42a2-9c6a-31b116ef0a3e None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:01.625604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ac0fa-da53-42a2-9c6a-31b116ef0a3e None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:01.627361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ac0fa-da53-42a2-9c6a-31b116ef0a3e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:01.629620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 183/361] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:01.629747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 178/361] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:01 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:01.630513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d622c-77b0-489d-8776-39b098ae0c25 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:01.630804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ac0fa-da53-42a2-9c6a-31b116ef0a3e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:01.768214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ac0fa-da53-42a2-9c6a-31b116ef0a3e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:01.790444 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:01.800891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d622c-77b0-489d-8776-39b098ae0c25 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:01.816195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7fdd6-eecd-4275-9812-4edff780ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:01.817291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7fdd6-eecd-4275-9812-4edff780ea1f None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:01.817765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7fdd6-eecd-4275-9812-4edff780ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:01.818420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7fdd6-eecd-4275-9812-4edff780ea1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:01.832375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7fdd6-eecd-4275-9812-4edff780ea1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-04b7fdd6-eecd-4275-9812-4edff780ea1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:01.840216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:01.841113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:01.841917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:01.841917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:01.841917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:01.841917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:01.841917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:01.841917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:01.841917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:01.841917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:01.841917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:01.841917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:01.841917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:01.841917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:01.845137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33236703-1ba5-4374-9d7f-c854e33f3bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:01.846066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33236703-1ba5-4374-9d7f-c854e33f3bfb None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:01.846543 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33236703-1ba5-4374-9d7f-c854e33f3bfb None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:01.847076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33236703-1ba5-4374-9d7f-c854e33f3bfb None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:01.847907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 179/362] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:38:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:01.848075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33236703-1ba5-4374-9d7f-c854e33f3bfb None admin] RBAC: Adding query filter params (name=member) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:01.848613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33236703-1ba5-4374-9d7f-c854e33f3bfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:01.849279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7fdd6-eecd-4275-9812-4edff780ea1f None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:01.851268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33236703-1ba5-4374-9d7f-c854e33f3bfb None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:01.863631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 184/363] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:38:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:01.867845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33236703-1ba5-4374-9d7f-c854e33f3bfb None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:01.914108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:01.978923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7fdd6-eecd-4275-9812-4edff780ea1f None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:01.995117 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33236703-1ba5-4374-9d7f-c854e33f3bfb None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:02.028280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3c41a-0757-4c95-afbb-869a5c2a4088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:02.029232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3c41a-0757-4c95-afbb-869a5c2a4088 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:02.030325 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3c41a-0757-4c95-afbb-869a5c2a4088 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:02.031360 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3c41a-0757-4c95-afbb-869a5c2a4088 None admin] PATH_INFO: `/v3/groups/167c7f13daa24f70864ae59406d88eb3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:02.033131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3c41a-0757-4c95-afbb-869a5c2a4088 None admin] RBAC: Authorizing `identity:get_group(group_id=167c7f13daa24f70864ae59406d88eb3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:02.034798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3c41a-0757-4c95-afbb-869a5c2a4088 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:02.037063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 180/364] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:01 2022] GET /identity/v3/groups/167c7f13daa24f70864ae59406d88eb3 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:02.037985 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3c41a-0757-4c95-afbb-869a5c2a4088 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:02.043664 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef436cff-ad81-4bbb-a7a6-61cb86eb2328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:02.044404 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef436cff-ad81-4bbb-a7a6-61cb86eb2328 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:02.044783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef436cff-ad81-4bbb-a7a6-61cb86eb2328 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:02.045156 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef436cff-ad81-4bbb-a7a6-61cb86eb2328 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:02.046981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef436cff-ad81-4bbb-a7a6-61cb86eb2328 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:02.047400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef436cff-ad81-4bbb-a7a6-61cb86eb2328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:02.048929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef436cff-ad81-4bbb-a7a6-61cb86eb2328 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:02.058162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 185/365] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:02.058998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef436cff-ad81-4bbb-a7a6-61cb86eb2328 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:02.079782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:02.177235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3c41a-0757-4c95-afbb-869a5c2a4088 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:02.201411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:02.208661 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef436cff-ad81-4bbb-a7a6-61cb86eb2328 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:02.224524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08de58-2f0b-4b02-9127-310a2271b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:02.225141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08de58-2f0b-4b02-9127-310a2271b291 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:02.225420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08de58-2f0b-4b02-9127-310a2271b291 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:02.225689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08de58-2f0b-4b02-9127-310a2271b291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:02.246773 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091e0bf-7806-42d8-93c4-920d1ee1a1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:02.248541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091e0bf-7806-42d8-93c4-920d1ee1a1be None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:02.248541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091e0bf-7806-42d8-93c4-920d1ee1a1be None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:02.248541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091e0bf-7806-42d8-93c4-920d1ee1a1be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:02.260348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091e0bf-7806-42d8-93c4-920d1ee1a1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-3091e0bf-7806-42d8-93c4-920d1ee1a1be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:02.268025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:02.268939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:02.269731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 186/366] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:02.270374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091e0bf-7806-42d8-93c4-920d1ee1a1be None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:02.317426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08de58-2f0b-4b02-9127-310a2271b291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:02.319209 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08de58-2f0b-4b02-9127-310a2271b291 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:02.373975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:02.407337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091e0bf-7806-42d8-93c4-920d1ee1a1be None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:02.454675 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 181/367] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:02.455864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08de58-2f0b-4b02-9127-310a2271b291 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:02.462268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3135d5-1b62-48bf-bd54-5ad0a5905936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:02.462906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3135d5-1b62-48bf-bd54-5ad0a5905936 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:02.463213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3135d5-1b62-48bf-bd54-5ad0a5905936 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:02.463488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3135d5-1b62-48bf-bd54-5ad0a5905936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:02.464228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3135d5-1b62-48bf-bd54-5ad0a5905936 None admin] RBAC: Adding query filter params (group.id=167c7f13daa24f70864ae59406d88eb3, role.id=06cbbfa32c9549ffa2d1fd68736820a1, scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:02.464541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3135d5-1b62-48bf-bd54-5ad0a5905936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:02.465989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3135d5-1b62-48bf-bd54-5ad0a5905936 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:02.472002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 187/368] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Aug 29 23:38:02 2022] GET /identity/v3/role_assignments?group.id=167c7f13daa24f70864ae59406d88eb3&scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a&role.id=06cbbfa32c9549ffa2d1fd68736820a1 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:02.472804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3135d5-1b62-48bf-bd54-5ad0a5905936 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:02.491303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:02.573519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08de58-2f0b-4b02-9127-310a2271b291 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:02.591382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3135d5-1b62-48bf-bd54-5ad0a5905936 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:02.616763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82edb-d0d7-44d8-9225-43c551add439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:02.617693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82edb-d0d7-44d8-9225-43c551add439 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:02.618251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82edb-d0d7-44d8-9225-43c551add439 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:02.618704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82edb-d0d7-44d8-9225-43c551add439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:02.632565 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af243bfb-0ef9-45f4-99b5-4134bab76b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:02.633189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af243bfb-0ef9-45f4-99b5-4134bab76b37 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:02.633471 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af243bfb-0ef9-45f4-99b5-4134bab76b37 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:02.633746 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af243bfb-0ef9-45f4-99b5-4134bab76b37 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:02.634499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af243bfb-0ef9-45f4-99b5-4134bab76b37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:02.634808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af243bfb-0ef9-45f4-99b5-4134bab76b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:02.637427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af243bfb-0ef9-45f4-99b5-4134bab76b37 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:02.644466 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:02.649150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 188/369] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:02.649992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af243bfb-0ef9-45f4-99b5-4134bab76b37 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:02.703392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df82edb-d0d7-44d8-9225-43c551add439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:02.705076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df82edb-d0d7-44d8-9225-43c551add439 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:02.721695 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:02.775782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af243bfb-0ef9-45f4-99b5-4134bab76b37 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:02.818653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf09225-d913-472a-aa61-47771b8035ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:02.819339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf09225-d913-472a-aa61-47771b8035ce None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:02.819619 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf09225-d913-472a-aa61-47771b8035ce None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:02.819897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf09225-d913-472a-aa61-47771b8035ce None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:02.821051 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf09225-d913-472a-aa61-47771b8035ce None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:02.824506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf09225-d913-472a-aa61-47771b8035ce None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:02.824506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 189/371] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:02 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:02.824884 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 182/371] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:02.826478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf09225-d913-472a-aa61-47771b8035ce None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:02.829149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82edb-d0d7-44d8-9225-43c551add439 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:02.906557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:02.935417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82edb-d0d7-44d8-9225-43c551add439 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:02.948352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf09225-d913-472a-aa61-47771b8035ce None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:02.951950 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:02.972659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d398466-ed53-4dcf-99d3-5436bedef538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:02.973529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d398466-ed53-4dcf-99d3-5436bedef538 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:02.973957 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d398466-ed53-4dcf-99d3-5436bedef538 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:02.974401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d398466-ed53-4dcf-99d3-5436bedef538 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:02.975728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d398466-ed53-4dcf-99d3-5436bedef538 None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:02.977351 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d398466-ed53-4dcf-99d3-5436bedef538 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:02.982986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 183/372] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:02 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:02.984514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d398466-ed53-4dcf-99d3-5436bedef538 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:02.987161 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60805b0-d7e0-43db-863b-420e524afde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:02.988029 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60805b0-d7e0-43db-863b-420e524afde1 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:02.988457 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60805b0-d7e0-43db-863b-420e524afde1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:02.988876 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60805b0-d7e0-43db-863b-420e524afde1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:03.069366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60805b0-d7e0-43db-863b-420e524afde1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:03.072993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60805b0-d7e0-43db-863b-420e524afde1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:03.089990 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d398466-ed53-4dcf-99d3-5436bedef538 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:03.129145 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06d1ac-9c25-4ab7-9afd-8dfe7eb86b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:03.130231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06d1ac-9c25-4ab7-9afd-8dfe7eb86b28 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:03.130766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06d1ac-9c25-4ab7-9afd-8dfe7eb86b28 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:03.131287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06d1ac-9c25-4ab7-9afd-8dfe7eb86b28 None admin] PATH_INFO: `/v3/groups/167c7f13daa24f70864ae59406d88eb3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:03.132637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06d1ac-9c25-4ab7-9afd-8dfe7eb86b28 None admin] RBAC: Authorizing `identity:get_group(group_id=167c7f13daa24f70864ae59406d88eb3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:03.134287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06d1ac-9c25-4ab7-9afd-8dfe7eb86b28 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:03.136607 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 184/373] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:02 2022] GET /identity/v3/groups/167c7f13daa24f70864ae59406d88eb3 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:03.137668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06d1ac-9c25-4ab7-9afd-8dfe7eb86b28 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:03.157748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:03.204007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 190/374] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:03.205185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60805b0-d7e0-43db-863b-420e524afde1 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:03.206175 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:03.281842 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06d1ac-9c25-4ab7-9afd-8dfe7eb86b28 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:03.344254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0b9ab-cda4-476b-a357-0bf99a00daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:03.345039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0b9ab-cda4-476b-a357-0bf99a00daeb None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:03.345334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0b9ab-cda4-476b-a357-0bf99a00daeb None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:03.345590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0b9ab-cda4-476b-a357-0bf99a00daeb None admin] PATH_INFO: `/v3/groups/167c7f13daa24f70864ae59406d88eb3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:03.346952 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0b9ab-cda4-476b-a357-0bf99a00daeb None admin] RBAC: Authorizing `identity:get_group(group_id=167c7f13daa24f70864ae59406d88eb3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:03.348542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0b9ab-cda4-476b-a357-0bf99a00daeb None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:03.353264 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 185/375] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:03 2022] GET /identity/v3/groups/167c7f13daa24f70864ae59406d88eb3 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:03.354262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0b9ab-cda4-476b-a357-0bf99a00daeb None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:03.357099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60805b0-d7e0-43db-863b-420e524afde1 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:03.404426 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895d780-69a8-44d1-9d36-20f589a689e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:03.405367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895d780-69a8-44d1-9d36-20f589a689e3 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:03.406352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895d780-69a8-44d1-9d36-20f589a689e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:03.406845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895d780-69a8-44d1-9d36-20f589a689e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:03.407777 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895d780-69a8-44d1-9d36-20f589a689e3 None admin] RBAC: Adding query filter params (group.id=167c7f13daa24f70864ae59406d88eb3, role.id=aaefcf4fc05547caa577d6f4db32e1b5, scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:03.408263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895d780-69a8-44d1-9d36-20f589a689e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:03.409913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895d780-69a8-44d1-9d36-20f589a689e3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:03.416286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 191/376] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Aug 29 23:38:03 2022] GET /identity/v3/role_assignments?group.id=167c7f13daa24f70864ae59406d88eb3&scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c&role.id=aaefcf4fc05547caa577d6f4db32e1b5 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:03.418033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d1ab0-5c91-4823-be4d-d063035da714 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:03.418506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d1ab0-5c91-4823-be4d-d063035da714 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:03.418992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d1ab0-5c91-4823-be4d-d063035da714 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:03.421004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 192/377] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:03.426735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d1ab0-5c91-4823-be4d-d063035da714 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:03.478698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:03.502219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0b9ab-cda4-476b-a357-0bf99a00daeb None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:03.528483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:03.553552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40b646-2c64-400f-b80a-6cf8a25730fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:03.554241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40b646-2c64-400f-b80a-6cf8a25730fa None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:03.554777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40b646-2c64-400f-b80a-6cf8a25730fa None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:03.555080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40b646-2c64-400f-b80a-6cf8a25730fa None admin] PATH_INFO: `/v3/projects/959954cde09c4c1cb490e7a7a1c17381` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:03.556310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40b646-2c64-400f-b80a-6cf8a25730fa None admin] RBAC: Authorizing `identity:get_project(project_id=959954cde09c4c1cb490e7a7a1c17381)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:03.558290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40b646-2c64-400f-b80a-6cf8a25730fa None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:03.562269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 186/378] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:03 2022] GET /identity/v3/projects/959954cde09c4c1cb490e7a7a1c17381 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:03.563728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b17bd0-7cde-41b7-b16b-63a8eb87837d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:03.564165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b17bd0-7cde-41b7-b16b-63a8eb87837d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:03.564460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b17bd0-7cde-41b7-b16b-63a8eb87837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:03.580164 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d1ab0-5c91-4823-be4d-d063035da714 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:03.589613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-72b17bd0-7cde-41b7-b16b-63a8eb87837d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:03.590825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-72b17bd0-7cde-41b7-b16b-63a8eb87837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:03.631880 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56038987-bde4-4c4e-acfb-1e03a45b9951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:03.632418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56038987-bde4-4c4e-acfb-1e03a45b9951 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:03.632702 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56038987-bde4-4c4e-acfb-1e03a45b9951 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:03.632981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56038987-bde4-4c4e-acfb-1e03a45b9951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:03.633713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56038987-bde4-4c4e-acfb-1e03a45b9951 None admin] RBAC: Adding query filter params (group.id=167c7f13daa24f70864ae59406d88eb3, role.id=06cbbfa32c9549ffa2d1fd68736820a1, scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:03.634025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56038987-bde4-4c4e-acfb-1e03a45b9951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:03.635515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56038987-bde4-4c4e-acfb-1e03a45b9951 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:03.643324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 193/379] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Aug 29 23:38:03 2022] GET /identity/v3/role_assignments?group.id=167c7f13daa24f70864ae59406d88eb3&scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c&role.id=06cbbfa32c9549ffa2d1fd68736820a1 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:03.644162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56038987-bde4-4c4e-acfb-1e03a45b9951 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:03.685063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 187/380] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:03.831244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:03.837885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56038987-bde4-4c4e-acfb-1e03a45b9951 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:03.885286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f50e1e-4b9d-4dee-97c8-5564bdd71a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:03.885849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f50e1e-4b9d-4dee-97c8-5564bdd71a96 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:03.886125 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f50e1e-4b9d-4dee-97c8-5564bdd71a96 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:03.886397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f50e1e-4b9d-4dee-97c8-5564bdd71a96 None admin] PATH_INFO: `/v3/groups/4f75fe5023ea47feb8e365003503f663` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:03.897418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f50e1e-4b9d-4dee-97c8-5564bdd71a96 None admin] RBAC: Authorizing `identity:get_group(group_id=4f75fe5023ea47feb8e365003503f663)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:03.898961 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f50e1e-4b9d-4dee-97c8-5564bdd71a96 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:03.900959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 194/381] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:03 2022] GET /identity/v3/groups/4f75fe5023ea47feb8e365003503f663 => generated 229 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:03.907238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b17bd0-7cde-41b7-b16b-63a8eb87837d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:04.002569 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f50e1e-4b9d-4dee-97c8-5564bdd71a96 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:04.049634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b17bd0-7cde-41b7-b16b-63a8eb87837d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:04.087835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:04.129262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779f6a0-c219-43cb-9544-e8a4865c4d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:04.130320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779f6a0-c219-43cb-9544-e8a4865c4d30 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:04.130974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779f6a0-c219-43cb-9544-e8a4865c4d30 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:04.131482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779f6a0-c219-43cb-9544-e8a4865c4d30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:04.133348 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779f6a0-c219-43cb-9544-e8a4865c4d30 None admin] RBAC: Adding query filter params (group.id=4f75fe5023ea47feb8e365003503f663, role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=959954cde09c4c1cb490e7a7a1c17381) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:04.134693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779f6a0-c219-43cb-9544-e8a4865c4d30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:04.136582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779f6a0-c219-43cb-9544-e8a4865c4d30 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:04.149115 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 188/382] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Aug 29 23:38:03 2022] GET /identity/v3/role_assignments?group.id=4f75fe5023ea47feb8e365003503f663&scope.project.id=959954cde09c4c1cb490e7a7a1c17381&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:04.162742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f50e1e-4b9d-4dee-97c8-5564bdd71a96 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:04.208618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcf462-747f-4e79-a7fa-0de128a554f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:04.210538 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf462-747f-4e79-a7fa-0de128a554f7 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:04.211274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf462-747f-4e79-a7fa-0de128a554f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:04.211754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf462-747f-4e79-a7fa-0de128a554f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:04.231889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcf462-747f-4e79-a7fa-0de128a554f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-f9dcf462-747f-4e79-a7fa-0de128a554f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:04.238376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:04.239375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:04.240174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 195/383] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:04.247475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779f6a0-c219-43cb-9544-e8a4865c4d30 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:04.399705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779f6a0-c219-43cb-9544-e8a4865c4d30 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:04.440692 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cba796-5974-4456-baa3-82f4f99c8362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:04.441706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cba796-5974-4456-baa3-82f4f99c8362 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:04.442209 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cba796-5974-4456-baa3-82f4f99c8362 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:04.442734 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cba796-5974-4456-baa3-82f4f99c8362 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:04.443667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cba796-5974-4456-baa3-82f4f99c8362 None admin] RBAC: Adding query filter params (name=member) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:04.444193 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cba796-5974-4456-baa3-82f4f99c8362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:04.445839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cba796-5974-4456-baa3-82f4f99c8362 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:04.456199 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 189/384] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:38:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:04.462150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcf462-747f-4e79-a7fa-0de128a554f7 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:04.489468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:04.582835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcf462-747f-4e79-a7fa-0de128a554f7 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:04.619731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666222ab-05d0-48ea-95e9-888b7ec600c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:04.620812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666222ab-05d0-48ea-95e9-888b7ec600c3 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:04.621295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666222ab-05d0-48ea-95e9-888b7ec600c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:04.621767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666222ab-05d0-48ea-95e9-888b7ec600c3 None admin] PATH_INFO: `/v3/groups/167c7f13daa24f70864ae59406d88eb3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:04.623114 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666222ab-05d0-48ea-95e9-888b7ec600c3 None admin] RBAC: Authorizing `identity:get_group(group_id=167c7f13daa24f70864ae59406d88eb3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:04.624804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666222ab-05d0-48ea-95e9-888b7ec600c3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:04.626889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 196/385] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:04 2022] GET /identity/v3/groups/167c7f13daa24f70864ae59406d88eb3 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:04.632628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cba796-5974-4456-baa3-82f4f99c8362 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:04.683810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:04.755898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cba796-5974-4456-baa3-82f4f99c8362 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:04.808778 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016f5ac-19e5-4a42-9e6f-14208560e82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:04.809416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016f5ac-19e5-4a42-9e6f-14208560e82b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:04.809699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016f5ac-19e5-4a42-9e6f-14208560e82b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:04.809974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016f5ac-19e5-4a42-9e6f-14208560e82b None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:04.815120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016f5ac-19e5-4a42-9e6f-14208560e82b None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:04.816596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016f5ac-19e5-4a42-9e6f-14208560e82b None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:04.818584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 190/386] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:04 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:04.824400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666222ab-05d0-48ea-95e9-888b7ec600c3 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:04.937869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:04.951147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666222ab-05d0-48ea-95e9-888b7ec600c3 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:04.993518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d14b3-e57b-43b5-80cf-d09f3d8bbbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:04.994187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d14b3-e57b-43b5-80cf-d09f3d8bbbdd None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:04.994476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d14b3-e57b-43b5-80cf-d09f3d8bbbdd None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:04.994755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d14b3-e57b-43b5-80cf-d09f3d8bbbdd None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a/groups/167c7f13daa24f70864ae59406d88eb3/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:04.996757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d14b3-e57b-43b5-80cf-d09f3d8bbbdd None admin] RBAC: Authorizing `identity:create_grant(project_id=1e69c872645b4f5db659d7dbfa42dd7a, group_id=167c7f13daa24f70864ae59406d88eb3, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:04.998196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d14b3-e57b-43b5-80cf-d09f3d8bbbdd None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:05.008463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c102b67-e8fd-4ac6-98ce-e7f959e2a0a9 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:05.008748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c102b67-e8fd-4ac6-98ce-e7f959e2a0a9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:05.009022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c102b67-e8fd-4ac6-98ce-e7f959e2a0a9 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:05.015848 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 191/387] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:38:05.015848 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045da070-162e-4a75-bf15-728abe804297 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:05.015848 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045da070-162e-4a75-bf15-728abe804297 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:05.016151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045da070-162e-4a75-bf15-728abe804297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:05.035585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-045da070-162e-4a75-bf15-728abe804297 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:05.036858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-045da070-162e-4a75-bf15-728abe804297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:05.086752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 197/388] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Aug 29 23:38:04 2022] PUT /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a/groups/167c7f13daa24f70864ae59406d88eb3/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:05.125787 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 192/389] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:38:05.555141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d14b3-e57b-43b5-80cf-d09f3d8bbbdd None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:05.687957 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d14b3-e57b-43b5-80cf-d09f3d8bbbdd None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:05.736260 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf2ce7-333a-4077-8036-8d68da3966cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:05.737296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf2ce7-333a-4077-8036-8d68da3966cc None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:05.737776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf2ce7-333a-4077-8036-8d68da3966cc None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:05.738259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf2ce7-333a-4077-8036-8d68da3966cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:05.756465 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf2ce7-333a-4077-8036-8d68da3966cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-15cf2ce7-333a-4077-8036-8d68da3966cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:05.761933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:05.762816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:05.764041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 198/390] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:38:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:05.768933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045da070-162e-4a75-bf15-728abe804297 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:05.821531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:05.892181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045da070-162e-4a75-bf15-728abe804297 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:05.940141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dea2ff-e17b-4e89-b0a0-8ffef49c1d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:05.940756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dea2ff-e17b-4e89-b0a0-8ffef49c1d89 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:05.941035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dea2ff-e17b-4e89-b0a0-8ffef49c1d89 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:05.941305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dea2ff-e17b-4e89-b0a0-8ffef49c1d89 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:05.943905 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dea2ff-e17b-4e89-b0a0-8ffef49c1d89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:05.944213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dea2ff-e17b-4e89-b0a0-8ffef49c1d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:05.946466 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dea2ff-e17b-4e89-b0a0-8ffef49c1d89 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:05.964412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 193/391] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:05.970174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf2ce7-333a-4077-8036-8d68da3966cc None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:05.984069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:06.109513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf2ce7-333a-4077-8036-8d68da3966cc None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:06.119746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62a13a-4478-4f69-8882-c1e0d4269e1b None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:06.120338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62a13a-4478-4f69-8882-c1e0d4269e1b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:06.120838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62a13a-4478-4f69-8882-c1e0d4269e1b None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:06.122639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 194/392] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:06.127949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0b97d-4c71-4c4f-8758-d588af2d840b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:06.128506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0b97d-4c71-4c4f-8758-d588af2d840b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:06.128978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0b97d-4c71-4c4f-8758-d588af2d840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:06.163316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d1074-118f-4ed8-9d6e-fd9e356a4e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:06.163858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-bed0b97d-4c71-4c4f-8758-d588af2d840b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:06.164511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d1074-118f-4ed8-9d6e-fd9e356a4e91 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:06.165028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d1074-118f-4ed8-9d6e-fd9e356a4e91 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:06.165131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-bed0b97d-4c71-4c4f-8758-d588af2d840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:06.165583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d1074-118f-4ed8-9d6e-fd9e356a4e91 None admin] PATH_INFO: `/v3/groups/167c7f13daa24f70864ae59406d88eb3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:06.166933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d1074-118f-4ed8-9d6e-fd9e356a4e91 None admin] RBAC: Authorizing `identity:get_group(group_id=167c7f13daa24f70864ae59406d88eb3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:06.168588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d1074-118f-4ed8-9d6e-fd9e356a4e91 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:06.170755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 199/393] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:05 2022] GET /identity/v3/groups/167c7f13daa24f70864ae59406d88eb3 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:06.175788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d1074-118f-4ed8-9d6e-fd9e356a4e91 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:06.283962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 195/394] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:38:06.298762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:06.323088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d1074-118f-4ed8-9d6e-fd9e356a4e91 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:06.363538 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedd16f-b8e6-4051-bc55-aa12849d8c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:06.365594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedd16f-b8e6-4051-bc55-aa12849d8c52 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:06.366023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedd16f-b8e6-4051-bc55-aa12849d8c52 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:06.366433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedd16f-b8e6-4051-bc55-aa12849d8c52 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:06.367732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedd16f-b8e6-4051-bc55-aa12849d8c52 None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:06.369316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedd16f-b8e6-4051-bc55-aa12849d8c52 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:06.372255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 200/395] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:06 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:06.383963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0b97d-4c71-4c4f-8758-d588af2d840b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:06.404499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d06597-96ae-4a15-86c6-b46ea323f497 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:06.405035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d06597-96ae-4a15-86c6-b46ea323f497 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:06.405493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d06597-96ae-4a15-86c6-b46ea323f497 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:06.407292 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 201/396] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:38:06.412396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650a238-10ad-4c2a-9b05-50443c75dd96 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:06.412826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650a238-10ad-4c2a-9b05-50443c75dd96 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:06.413238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650a238-10ad-4c2a-9b05-50443c75dd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:06.431258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:06.431851 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-4650a238-10ad-4c2a-9b05-50443c75dd96 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:06.433190 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4650a238-10ad-4c2a-9b05-50443c75dd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:06.529805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 202/397] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:06.529805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb2015-e835-43ef-89e1-da7599e93d3f None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:06.529805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb2015-e835-43ef-89e1-da7599e93d3f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:06.529805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb2015-e835-43ef-89e1-da7599e93d3f None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:06.529805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 203/398] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:06.535465 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdc498-8513-4e78-957f-d5b4217bf9da None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:06.535753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdc498-8513-4e78-957f-d5b4217bf9da None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:06.536076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdc498-8513-4e78-957f-d5b4217bf9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:06.549178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0b97d-4c71-4c4f-8758-d588af2d840b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:06.557944 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-61bdc498-8513-4e78-957f-d5b4217bf9da None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:06.559686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-61bdc498-8513-4e78-957f-d5b4217bf9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:06.611601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336d928-7bc2-4b30-88bb-cc21318f63d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:06.612766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336d928-7bc2-4b30-88bb-cc21318f63d3 None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:06.613264 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336d928-7bc2-4b30-88bb-cc21318f63d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:06.613823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336d928-7bc2-4b30-88bb-cc21318f63d3 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a/groups/167c7f13daa24f70864ae59406d88eb3/roles/06cbbfa32c9549ffa2d1fd68736820a1` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:06.616330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336d928-7bc2-4b30-88bb-cc21318f63d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e69c872645b4f5db659d7dbfa42dd7a, group_id=167c7f13daa24f70864ae59406d88eb3, role_id=06cbbfa32c9549ffa2d1fd68736820a1)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:06.618092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336d928-7bc2-4b30-88bb-cc21318f63d3 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:06.637220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 204/399] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:06.648900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdc498-8513-4e78-957f-d5b4217bf9da None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:06.648900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:06.723451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 196/400] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Aug 29 23:38:06 2022] PUT /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a/groups/167c7f13daa24f70864ae59406d88eb3/roles/06cbbfa32c9549ffa2d1fd68736820a1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:06.757096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdc498-8513-4e78-957f-d5b4217bf9da None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:06.796083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e171cd-da62-4784-abad-f428e59b5290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:06.796781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e171cd-da62-4784-abad-f428e59b5290 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:06.797059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e171cd-da62-4784-abad-f428e59b5290 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:06.797329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e171cd-da62-4784-abad-f428e59b5290 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:06.809155 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e171cd-da62-4784-abad-f428e59b5290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-86e171cd-da62-4784-abad-f428e59b5290 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:06.814350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:06.815232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:06.816089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 205/401] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:06.821926 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336d928-7bc2-4b30-88bb-cc21318f63d3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:06.863963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e171cd-da62-4784-abad-f428e59b5290 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:06.964529 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:06.975493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:06.984993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336d928-7bc2-4b30-88bb-cc21318f63d3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:07.017299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e171cd-da62-4784-abad-f428e59b5290 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:07.021265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b172d80-b461-4cee-bf7e-e9f256548b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:07.022093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b172d80-b461-4cee-bf7e-e9f256548b9a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.022544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b172d80-b461-4cee-bf7e-e9f256548b9a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.022977 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b172d80-b461-4cee-bf7e-e9f256548b9a None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.023802 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b172d80-b461-4cee-bf7e-e9f256548b9a None admin] RBAC: Adding query filter params (name=member) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:07.024239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b172d80-b461-4cee-bf7e-e9f256548b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:07.025721 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b172d80-b461-4cee-bf7e-e9f256548b9a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:07.042440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 197/402] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:38:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:07.043694 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b172d80-b461-4cee-bf7e-e9f256548b9a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:07.056737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5ee37-897a-4fd2-9d56-6a3df4338c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:07.057385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5ee37-897a-4fd2-9d56-6a3df4338c54 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.057672 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5ee37-897a-4fd2-9d56-6a3df4338c54 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.057957 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5ee37-897a-4fd2-9d56-6a3df4338c54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.072173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5ee37-897a-4fd2-9d56-6a3df4338c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-5be5ee37-897a-4fd2-9d56-6a3df4338c54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:07.079130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:07.080012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:07.081393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 206/403] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:38:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:07.082065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5ee37-897a-4fd2-9d56-6a3df4338c54 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:07.174841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b172d80-b461-4cee-bf7e-e9f256548b9a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:07.200891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5ee37-897a-4fd2-9d56-6a3df4338c54 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:07.217718 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df2a6-dc94-408d-9266-347552568f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:07.219133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df2a6-dc94-408d-9266-347552568f8e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.219417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df2a6-dc94-408d-9266-347552568f8e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.219829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df2a6-dc94-408d-9266-347552568f8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.231331 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:07.234183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100df2a6-dc94-408d-9266-347552568f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-100df2a6-dc94-408d-9266-347552568f8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:07.240554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:07.241512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:07.242310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:07.242310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:07.242310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:07.242310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:07.242310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:07.242310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:07.242310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:07.242310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:07.242310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:07.242310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:07.242310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:07.242310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:07.243490 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 198/404] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:07.244205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df2a6-dc94-408d-9266-347552568f8e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:07.244740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a1d05-4382-4628-a7ef-f5679d8d76f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:07.245643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a1d05-4382-4628-a7ef-f5679d8d76f4 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.246151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a1d05-4382-4628-a7ef-f5679d8d76f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.246619 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a1d05-4382-4628-a7ef-f5679d8d76f4 None admin] PATH_INFO: `/v3/groups/167c7f13daa24f70864ae59406d88eb3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.248026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a1d05-4382-4628-a7ef-f5679d8d76f4 None admin] RBAC: Authorizing `identity:get_group(group_id=167c7f13daa24f70864ae59406d88eb3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:07.249910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a1d05-4382-4628-a7ef-f5679d8d76f4 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:07.253992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 207/405] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:07 2022] GET /identity/v3/groups/167c7f13daa24f70864ae59406d88eb3 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:07.258738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a1d05-4382-4628-a7ef-f5679d8d76f4 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:07.267562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:07.369110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df2a6-dc94-408d-9266-347552568f8e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:07.388596 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a1d05-4382-4628-a7ef-f5679d8d76f4 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:07.411169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585dc63-86cc-4a8f-b8dc-88b623e4be13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:07.411785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585dc63-86cc-4a8f-b8dc-88b623e4be13 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.412716 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585dc63-86cc-4a8f-b8dc-88b623e4be13 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.413007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585dc63-86cc-4a8f-b8dc-88b623e4be13 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.413737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585dc63-86cc-4a8f-b8dc-88b623e4be13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:07.414043 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585dc63-86cc-4a8f-b8dc-88b623e4be13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:07.416122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585dc63-86cc-4a8f-b8dc-88b623e4be13 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:07.428214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 199/406] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:07.428991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585dc63-86cc-4a8f-b8dc-88b623e4be13 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:07.429498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8041b-4646-440b-ac2f-ab896aecbb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:07.430347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8041b-4646-440b-ac2f-ab896aecbb17 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.430831 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8041b-4646-440b-ac2f-ab896aecbb17 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.431344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8041b-4646-440b-ac2f-ab896aecbb17 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.432583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8041b-4646-440b-ac2f-ab896aecbb17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:07.433106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8041b-4646-440b-ac2f-ab896aecbb17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:07.434725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8041b-4646-440b-ac2f-ab896aecbb17 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:07.444011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 208/407] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:07.445154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8041b-4646-440b-ac2f-ab896aecbb17 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:07.504222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:07.539857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:07.557828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8041b-4646-440b-ac2f-ab896aecbb17 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:07.571861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585dc63-86cc-4a8f-b8dc-88b623e4be13 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:07.595790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118ae1a-24d4-4e4c-935b-e31f438b2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:07.596417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118ae1a-24d4-4e4c-935b-e31f438b2d92 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.596698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118ae1a-24d4-4e4c-935b-e31f438b2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.596968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118ae1a-24d4-4e4c-935b-e31f438b2d92 None admin] PATH_INFO: `/v3/groups/167c7f13daa24f70864ae59406d88eb3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.598068 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118ae1a-24d4-4e4c-935b-e31f438b2d92 None admin] RBAC: Authorizing `identity:get_group(group_id=167c7f13daa24f70864ae59406d88eb3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:07.599769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118ae1a-24d4-4e4c-935b-e31f438b2d92 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:07.601785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 209/408] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:07 2022] GET /identity/v3/groups/167c7f13daa24f70864ae59406d88eb3 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:07.602760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118ae1a-24d4-4e4c-935b-e31f438b2d92 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:07.617237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0f80d-6ea4-4321-810b-44342e5534b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:07.618595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0f80d-6ea4-4321-810b-44342e5534b9 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.619271 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0f80d-6ea4-4321-810b-44342e5534b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.619798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0f80d-6ea4-4321-810b-44342e5534b9 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.621354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0f80d-6ea4-4321-810b-44342e5534b9 None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:07.623721 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0f80d-6ea4-4321-810b-44342e5534b9 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:07.626723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 200/409] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:07 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:07.627688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0f80d-6ea4-4321-810b-44342e5534b9 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:07.721221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118ae1a-24d4-4e4c-935b-e31f438b2d92 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:07.758539 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:07.769624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0f80d-6ea4-4321-810b-44342e5534b9 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:07.774910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5c7e9-c39e-4e30-ab83-1799b65ece01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:07.775541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5c7e9-c39e-4e30-ab83-1799b65ece01 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.775822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5c7e9-c39e-4e30-ab83-1799b65ece01 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.776096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5c7e9-c39e-4e30-ab83-1799b65ece01 None admin] PATH_INFO: `/v3/groups/4f75fe5023ea47feb8e365003503f663` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.777221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5c7e9-c39e-4e30-ab83-1799b65ece01 None admin] RBAC: Authorizing `identity:get_group(group_id=4f75fe5023ea47feb8e365003503f663)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:07.778662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5c7e9-c39e-4e30-ab83-1799b65ece01 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:07.780941 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 210/410] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:07 2022] GET /identity/v3/groups/4f75fe5023ea47feb8e365003503f663 => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:07.783059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5c7e9-c39e-4e30-ab83-1799b65ece01 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:07.807109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d39e5-69b9-4c8e-8cc2-f056e7c92be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:07.807741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d39e5-69b9-4c8e-8cc2-f056e7c92be4 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.808026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d39e5-69b9-4c8e-8cc2-f056e7c92be4 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.808299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d39e5-69b9-4c8e-8cc2-f056e7c92be4 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.809423 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d39e5-69b9-4c8e-8cc2-f056e7c92be4 None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:07.810871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d39e5-69b9-4c8e-8cc2-f056e7c92be4 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:07.812613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 201/411] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:07 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:07.813676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5109017-2f1f-47a5-b524-53f2b13df54d None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.813958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5109017-2f1f-47a5-b524-53f2b13df54d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.814229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5109017-2f1f-47a5-b524-53f2b13df54d None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.819018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 202/412] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:07.819018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5109017-2f1f-47a5-b524-53f2b13df54d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:07.835329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:07.898554 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5c7e9-c39e-4e30-ab83-1799b65ece01 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:07.934368 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0696-4e9e-4c6a-bfb8-3e45357c582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:07.935077 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0696-4e9e-4c6a-bfb8-3e45357c582a None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.935361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0696-4e9e-4c6a-bfb8-3e45357c582a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.935478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5109017-2f1f-47a5-b524-53f2b13df54d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:07.935632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0696-4e9e-4c6a-bfb8-3e45357c582a None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c/groups/167c7f13daa24f70864ae59406d88eb3/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.937571 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0696-4e9e-4c6a-bfb8-3e45357c582a None admin] RBAC: Authorizing `identity:create_grant(project_id=977fa7acdb0b47bfb8fc7727e2878e1c, group_id=167c7f13daa24f70864ae59406d88eb3, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:07.939048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0696-4e9e-4c6a-bfb8-3e45357c582a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:07.969774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0e877-d1d4-4900-9c6a-fc1d5951f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:07.970404 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0e877-d1d4-4900-9c6a-fc1d5951f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:07.970685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0e877-d1d4-4900-9c6a-fc1d5951f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:07.970995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0e877-d1d4-4900-9c6a-fc1d5951f4a2 None admin] PATH_INFO: `/v3/projects/959954cde09c4c1cb490e7a7a1c17381` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:07.972154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0e877-d1d4-4900-9c6a-fc1d5951f4a2 None admin] RBAC: Authorizing `identity:get_project(project_id=959954cde09c4c1cb490e7a7a1c17381)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:07.973677 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0e877-d1d4-4900-9c6a-fc1d5951f4a2 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:07.975335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 203/413] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:07 2022] GET /identity/v3/projects/959954cde09c4c1cb490e7a7a1c17381 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:07.976072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0e877-d1d4-4900-9c6a-fc1d5951f4a2 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:08.040901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 211/414] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Aug 29 23:38:07 2022] PUT /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c/groups/167c7f13daa24f70864ae59406d88eb3/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:08.042016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ac6c4-8379-4dc1-968d-8a488629bb4c None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:08.042309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ac6c4-8379-4dc1-968d-8a488629bb4c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:08.042587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ac6c4-8379-4dc1-968d-8a488629bb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:08.064634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:08.070094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-9d4ac6c4-8379-4dc1-968d-8a488629bb4c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:08.071642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9d4ac6c4-8379-4dc1-968d-8a488629bb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:08.089487 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0e877-d1d4-4900-9c6a-fc1d5951f4a2 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:08.128784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:08.132272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140ae7d-dfa8-4db0-bd4c-c7ec2d5939d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:08.133107 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140ae7d-dfa8-4db0-bd4c-c7ec2d5939d8 None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:08.133487 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140ae7d-dfa8-4db0-bd4c-c7ec2d5939d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:08.133862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140ae7d-dfa8-4db0-bd4c-c7ec2d5939d8 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c/groups/167c7f13daa24f70864ae59406d88eb3/roles/06cbbfa32c9549ffa2d1fd68736820a1` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:08.136365 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140ae7d-dfa8-4db0-bd4c-c7ec2d5939d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=977fa7acdb0b47bfb8fc7727e2878e1c, group_id=167c7f13daa24f70864ae59406d88eb3, role_id=06cbbfa32c9549ffa2d1fd68736820a1)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:08.138007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140ae7d-dfa8-4db0-bd4c-c7ec2d5939d8 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:08.154719 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 212/415] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:08.156513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ac6c4-8379-4dc1-968d-8a488629bb4c None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:08.251853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 204/416] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Aug 29 23:38:07 2022] PUT /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c/groups/167c7f13daa24f70864ae59406d88eb3/roles/06cbbfa32c9549ffa2d1fd68736820a1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:08.273821 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ac6c4-8379-4dc1-968d-8a488629bb4c None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:08.324357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a72a22-1449-42f2-b1ac-ad01a6f9ca0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:08.325340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72a22-1449-42f2-b1ac-ad01a6f9ca0a None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:08.325792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72a22-1449-42f2-b1ac-ad01a6f9ca0a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:08.326221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72a22-1449-42f2-b1ac-ad01a6f9ca0a None admin] PATH_INFO: `/v3/projects/959954cde09c4c1cb490e7a7a1c17381/groups/4f75fe5023ea47feb8e365003503f663/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:08.332507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a72a22-1449-42f2-b1ac-ad01a6f9ca0a None admin] RBAC: Authorizing `identity:create_grant(project_id=959954cde09c4c1cb490e7a7a1c17381, group_id=4f75fe5023ea47feb8e365003503f663, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:08.334283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a72a22-1449-42f2-b1ac-ad01a6f9ca0a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:08.408811 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 213/417] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Aug 29 23:38:08 2022] PUT /identity/v3/projects/959954cde09c4c1cb490e7a7a1c17381/groups/4f75fe5023ea47feb8e365003503f663/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:08.504147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140ae7d-dfa8-4db0-bd4c-c7ec2d5939d8 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:08.617149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140ae7d-dfa8-4db0-bd4c-c7ec2d5939d8 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:08.652489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b707a1-e516-491a-abd3-a12a52d779e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:08.653131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b707a1-e516-491a-abd3-a12a52d779e4 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:08.653415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b707a1-e516-491a-abd3-a12a52d779e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:08.653692 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b707a1-e516-491a-abd3-a12a52d779e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:08.662157 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:08.668409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b707a1-e516-491a-abd3-a12a52d779e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-19b707a1-e516-491a-abd3-a12a52d779e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:08.673874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:08.674751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:08.675604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 205/418] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:08.681700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a72a22-1449-42f2-b1ac-ad01a6f9ca0a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:08.750292 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:08.759219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f3ba5-cea8-4935-9148-219bdcc29a92 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:08.759219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f3ba5-cea8-4935-9148-219bdcc29a92 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:08.759219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f3ba5-cea8-4935-9148-219bdcc29a92 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:08.759219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 206/419] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:08.763128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c935249-24ca-471d-9f1d-08e242fc861c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:08.763412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c935249-24ca-471d-9f1d-08e242fc861c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:08.763688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c935249-24ca-471d-9f1d-08e242fc861c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:08.784254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-7c935249-24ca-471d-9f1d-08e242fc861c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:08.785470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7c935249-24ca-471d-9f1d-08e242fc861c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:08.860744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a72a22-1449-42f2-b1ac-ad01a6f9ca0a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:08.877497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 207/420] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:38:08.896734 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72844ac3-55e4-4425-a035-9fae9a501954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:08.897352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72844ac3-55e4-4425-a035-9fae9a501954 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:08.897632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72844ac3-55e4-4425-a035-9fae9a501954 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:08.897900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72844ac3-55e4-4425-a035-9fae9a501954 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:08.898565 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72844ac3-55e4-4425-a035-9fae9a501954 None admin] RBAC: Adding query filter params (name=member) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:08.898865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72844ac3-55e4-4425-a035-9fae9a501954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:08.900254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72844ac3-55e4-4425-a035-9fae9a501954 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:08.909313 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 214/421] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:38:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:08.914932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c935249-24ca-471d-9f1d-08e242fc861c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:09.057806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c935249-24ca-471d-9f1d-08e242fc861c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:09.095223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:09.102288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ba7c0-1fa5-46d5-bcd0-b840fc98899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:09.105577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba7c0-1fa5-46d5-bcd0-b840fc98899a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:09.105577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba7c0-1fa5-46d5-bcd0-b840fc98899a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:09.105577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba7c0-1fa5-46d5-bcd0-b840fc98899a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:09.173105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ba7c0-1fa5-46d5-bcd0-b840fc98899a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:09.174556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ba7c0-1fa5-46d5-bcd0-b840fc98899a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:09.257439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72844ac3-55e4-4425-a035-9fae9a501954 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:09.278144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 208/422] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:09.285109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ba7c0-1fa5-46d5-bcd0-b840fc98899a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:09.342336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:09.369912 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72844ac3-55e4-4425-a035-9fae9a501954 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:09.373231 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:09.407581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64f6e8-e3fb-44e7-b310-79d94e419484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:09.408256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64f6e8-e3fb-44e7-b310-79d94e419484 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:09.408505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64f6e8-e3fb-44e7-b310-79d94e419484 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:09.408787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64f6e8-e3fb-44e7-b310-79d94e419484 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:09.420216 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64f6e8-e3fb-44e7-b310-79d94e419484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-ee64f6e8-e3fb-44e7-b310-79d94e419484 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:09.426635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:09.427510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:09.428315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:09.428315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:09.428315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:09.428315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:09.428315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:09.428315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:09.428315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:09.428315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:09.428315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:09.428315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:09.428315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:09.428315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:09.429558 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 215/423] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:38:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:09.434498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64f6e8-e3fb-44e7-b310-79d94e419484 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:09.541724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64f6e8-e3fb-44e7-b310-79d94e419484 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:09.556771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ba7c0-1fa5-46d5-bcd0-b840fc98899a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:09.579327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22899ce5-9c2c-45e1-81af-6c69367554b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:09.579960 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899ce5-9c2c-45e1-81af-6c69367554b5 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:09.580552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899ce5-9c2c-45e1-81af-6c69367554b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:09.580836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899ce5-9c2c-45e1-81af-6c69367554b5 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:09.581506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22899ce5-9c2c-45e1-81af-6c69367554b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:09.581812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22899ce5-9c2c-45e1-81af-6c69367554b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:09.583197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22899ce5-9c2c-45e1-81af-6c69367554b5 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:09.591912 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 216/424] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:09.598479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22899ce5-9c2c-45e1-81af-6c69367554b5 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:09.626088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:09.699616 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bcf5a-6594-4faf-8ecc-92af3bcb877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:09.700277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bcf5a-6594-4faf-8ecc-92af3bcb877c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:09.700559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bcf5a-6594-4faf-8ecc-92af3bcb877c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:09.700834 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bcf5a-6594-4faf-8ecc-92af3bcb877c None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:09.707561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22899ce5-9c2c-45e1-81af-6c69367554b5 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:09.708014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bcf5a-6594-4faf-8ecc-92af3bcb877c None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:09.709026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bcf5a-6594-4faf-8ecc-92af3bcb877c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:09.711040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 209/425] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:09 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:09.719772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bcf5a-6594-4faf-8ecc-92af3bcb877c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:09.753326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c38e7d-b673-4daf-bf8b-95ff263c6969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:09.753956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c38e7d-b673-4daf-bf8b-95ff263c6969 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:09.754239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c38e7d-b673-4daf-bf8b-95ff263c6969 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:09.754516 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c38e7d-b673-4daf-bf8b-95ff263c6969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:09.873765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c38e7d-b673-4daf-bf8b-95ff263c6969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:09.875756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c38e7d-b673-4daf-bf8b-95ff263c6969 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:09.907318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:09.936696 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:09.942172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bcf5a-6594-4faf-8ecc-92af3bcb877c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:09.980071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5c4e-bd71-43dd-ad66-e4a3ea1e272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:09.980987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5c4e-bd71-43dd-ad66-e4a3ea1e272f None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:09.981415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5c4e-bd71-43dd-ad66-e4a3ea1e272f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:09.981835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5c4e-bd71-43dd-ad66-e4a3ea1e272f None admin] PATH_INFO: `/v3/groups/167c7f13daa24f70864ae59406d88eb3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:09.983138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc5c4e-bd71-43dd-ad66-e4a3ea1e272f None admin] RBAC: Authorizing `identity:get_group(group_id=167c7f13daa24f70864ae59406d88eb3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:09.985286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc5c4e-bd71-43dd-ad66-e4a3ea1e272f None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:09.987400 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 210/426] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:09 2022] GET /identity/v3/groups/167c7f13daa24f70864ae59406d88eb3 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:09.993356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5c4e-bd71-43dd-ad66-e4a3ea1e272f None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:10.061533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 217/427] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:10.079255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c38e7d-b673-4daf-bf8b-95ff263c6969 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:10.111486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5c4e-bd71-43dd-ad66-e4a3ea1e272f None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:10.148439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fa4cf-c9f5-497c-a46f-e7076bf776ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:10.149377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fa4cf-c9f5-497c-a46f-e7076bf776ef None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:10.149880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fa4cf-c9f5-497c-a46f-e7076bf776ef None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:10.150349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fa4cf-c9f5-497c-a46f-e7076bf776ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:10.151298 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fa4cf-c9f5-497c-a46f-e7076bf776ef None admin] RBAC: Adding query filter params (group.id=167c7f13daa24f70864ae59406d88eb3, role.id=aaefcf4fc05547caa577d6f4db32e1b5, scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:10.151826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fa4cf-c9f5-497c-a46f-e7076bf776ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:10.153477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fa4cf-c9f5-497c-a46f-e7076bf776ef None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:10.160806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 211/428] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Aug 29 23:38:09 2022] GET /identity/v3/role_assignments?group.id=167c7f13daa24f70864ae59406d88eb3&scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a&role.id=aaefcf4fc05547caa577d6f4db32e1b5 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:10.234576 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c38e7d-b673-4daf-bf8b-95ff263c6969 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:10.254086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5cf3e-6764-4958-b42d-a0a58d77c042 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:10.254086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5cf3e-6764-4958-b42d-a0a58d77c042 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:10.254086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5cf3e-6764-4958-b42d-a0a58d77c042 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:10.254086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 212/429] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:10.254086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d838f1-eaf7-4c3b-9547-7946f1a9afbf None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:10.254086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d838f1-eaf7-4c3b-9547-7946f1a9afbf None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:10.254581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d838f1-eaf7-4c3b-9547-7946f1a9afbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:10.278825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:10.278825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eec847-2972-41fa-85c3-23afbf013176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:10.278825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eec847-2972-41fa-85c3-23afbf013176 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:10.278825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eec847-2972-41fa-85c3-23afbf013176 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:10.285186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eec847-2972-41fa-85c3-23afbf013176 None admin] PATH_INFO: `/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:10.285186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eec847-2972-41fa-85c3-23afbf013176 None admin] RBAC: Authorizing `identity:get_project(project_id=1e69c872645b4f5db659d7dbfa42dd7a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:10.285186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eec847-2972-41fa-85c3-23afbf013176 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:10.285186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 218/430] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:10 2022] GET /identity/v3/projects/1e69c872645b4f5db659d7dbfa42dd7a => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:10.287525 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eec847-2972-41fa-85c3-23afbf013176 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:10.296775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-01d838f1-eaf7-4c3b-9547-7946f1a9afbf None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:10.298331 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-01d838f1-eaf7-4c3b-9547-7946f1a9afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:10.346230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:10.399405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eec847-2972-41fa-85c3-23afbf013176 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:10.426292 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 213/431] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:10.435598 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f5cba-2fcc-4a71-acfe-e119a23e423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:10.436236 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f5cba-2fcc-4a71-acfe-e119a23e423e None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:10.436603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f5cba-2fcc-4a71-acfe-e119a23e423e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:10.436878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f5cba-2fcc-4a71-acfe-e119a23e423e None admin] PATH_INFO: `/v3/groups/167c7f13daa24f70864ae59406d88eb3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:10.437983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f5cba-2fcc-4a71-acfe-e119a23e423e None admin] RBAC: Authorizing `identity:get_group(group_id=167c7f13daa24f70864ae59406d88eb3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:10.439448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f5cba-2fcc-4a71-acfe-e119a23e423e None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:10.441026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 219/432] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:10 2022] GET /identity/v3/groups/167c7f13daa24f70864ae59406d88eb3 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:10.446898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d838f1-eaf7-4c3b-9547-7946f1a9afbf None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:10.556348 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d838f1-eaf7-4c3b-9547-7946f1a9afbf None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:10.596782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3910f-c9fd-4252-8f6e-a4a2e21afd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:10.597404 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3910f-c9fd-4252-8f6e-a4a2e21afd00 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:10.597686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3910f-c9fd-4252-8f6e-a4a2e21afd00 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:10.598021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3910f-c9fd-4252-8f6e-a4a2e21afd00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:10.598763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3910f-c9fd-4252-8f6e-a4a2e21afd00 None admin] RBAC: Adding query filter params (group.id=167c7f13daa24f70864ae59406d88eb3, role.id=06cbbfa32c9549ffa2d1fd68736820a1, scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:10.599119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3910f-c9fd-4252-8f6e-a4a2e21afd00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:10.600552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3910f-c9fd-4252-8f6e-a4a2e21afd00 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:10.607514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 214/433] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Aug 29 23:38:10 2022] GET /identity/v3/role_assignments?group.id=167c7f13daa24f70864ae59406d88eb3&scope.project.id=1e69c872645b4f5db659d7dbfa42dd7a&role.id=06cbbfa32c9549ffa2d1fd68736820a1 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:10.735924 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f5cba-2fcc-4a71-acfe-e119a23e423e None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:10.776978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab110f1a-873b-45ab-887a-92ebc450dce6 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:10.777318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab110f1a-873b-45ab-887a-92ebc450dce6 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:10.777535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab110f1a-873b-45ab-887a-92ebc450dce6 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:10.779050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 215/434] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:10.784926 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6513c-48fa-437a-87a3-ca5bf76fc73b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:10.785204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6513c-48fa-437a-87a3-ca5bf76fc73b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:10.785479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6513c-48fa-437a-87a3-ca5bf76fc73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:10.802468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:10.812361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-66b6513c-48fa-437a-87a3-ca5bf76fc73b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:10.816894 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-66b6513c-48fa-437a-87a3-ca5bf76fc73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:10.837442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:10.856130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f5cba-2fcc-4a71-acfe-e119a23e423e None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:10.895592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df75a1-46c1-467c-ab22-6ee22a88eff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:10.896225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df75a1-46c1-467c-ab22-6ee22a88eff0 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:10.896501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df75a1-46c1-467c-ab22-6ee22a88eff0 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:10.896846 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df75a1-46c1-467c-ab22-6ee22a88eff0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:10.909455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df75a1-46c1-467c-ab22-6ee22a88eff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:10.909918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 216/435] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-a3df75a1-46c1-467c-ab22-6ee22a88eff0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:10.915393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:10.916499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:10.917607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 220/436] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:10.922215 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6513c-48fa-437a-87a3-ca5bf76fc73b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:10.943640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b6c3-841c-493a-a1c2-2a9939cb03b3 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:10.943920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b6c3-841c-493a-a1c2-2a9939cb03b3 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:10.944189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b6c3-841c-493a-a1c2-2a9939cb03b3 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:10.945518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 221/437] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:38:10.950710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf9185-eb56-4dc5-af5a-2403e2e9618f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:10.951013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf9185-eb56-4dc5-af5a-2403e2e9618f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:10.951640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf9185-eb56-4dc5-af5a-2403e2e9618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:10.972286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-4bbf9185-eb56-4dc5-af5a-2403e2e9618f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:10.973631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4bbf9185-eb56-4dc5-af5a-2403e2e9618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:11.050392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6513c-48fa-437a-87a3-ca5bf76fc73b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:11.057314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 222/438] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:11.087481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5b759-6dcb-4bf7-bec0-fd549194024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:11.088095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5b759-6dcb-4bf7-bec0-fd549194024a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:11.088371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5b759-6dcb-4bf7-bec0-fd549194024a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:11.088640 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5b759-6dcb-4bf7-bec0-fd549194024a None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:11.089301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5b759-6dcb-4bf7-bec0-fd549194024a None admin] RBAC: Adding query filter params (name=member) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:11.089603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5b759-6dcb-4bf7-bec0-fd549194024a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:11.090998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5b759-6dcb-4bf7-bec0-fd549194024a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:11.100518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 217/439] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:38:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:11.106514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf9185-eb56-4dc5-af5a-2403e2e9618f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:11.161387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:11.189819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5b759-6dcb-4bf7-bec0-fd549194024a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:11.217561 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:11.217951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf9185-eb56-4dc5-af5a-2403e2e9618f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:11.268226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484f6ec-884a-46ac-b089-ae85cf9475d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:11.268911 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484f6ec-884a-46ac-b089-ae85cf9475d2 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:11.270351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484f6ec-884a-46ac-b089-ae85cf9475d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:11.270351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484f6ec-884a-46ac-b089-ae85cf9475d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:11.325536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5b759-6dcb-4bf7-bec0-fd549194024a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:11.352243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484f6ec-884a-46ac-b089-ae85cf9475d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:11.353686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484f6ec-884a-46ac-b089-ae85cf9475d2 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:11.360647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5fdf9-1465-476e-b069-77b7048deff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:11.361295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5fdf9-1465-476e-b069-77b7048deff3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:11.361573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5fdf9-1465-476e-b069-77b7048deff3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:11.361841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5fdf9-1465-476e-b069-77b7048deff3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:11.371800 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5fdf9-1465-476e-b069-77b7048deff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-98d5fdf9-1465-476e-b069-77b7048deff3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:11.377169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:11.378266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 218/440] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:11.379146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5fdf9-1465-476e-b069-77b7048deff3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:11.406128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:11.455942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 223/441] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:11.456417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:11.456849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484f6ec-884a-46ac-b089-ae85cf9475d2 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:11.479321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5fdf9-1465-476e-b069-77b7048deff3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:11.512973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f830769-3aa6-44c1-97a7-d1b0608d0b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:11.513594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f830769-3aa6-44c1-97a7-d1b0608d0b11 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:11.513875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f830769-3aa6-44c1-97a7-d1b0608d0b11 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:11.514146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f830769-3aa6-44c1-97a7-d1b0608d0b11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:11.524074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f830769-3aa6-44c1-97a7-d1b0608d0b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-6f830769-3aa6-44c1-97a7-d1b0608d0b11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:11.528837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:11.529726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:11.531033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:11.531033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:11.531033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:11.531033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:11.531033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:11.531033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:11.531033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:11.531033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:11.531033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:11.531033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:11.531033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:11.531033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:11.535135 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 219/442] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:38:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:11.535908 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f830769-3aa6-44c1-97a7-d1b0608d0b11 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:11.555097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484f6ec-884a-46ac-b089-ae85cf9475d2 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:11.588047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df15b11-8f0d-4a1f-98c9-073fb691c048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:11.588579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df15b11-8f0d-4a1f-98c9-073fb691c048 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:11.588860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df15b11-8f0d-4a1f-98c9-073fb691c048 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:11.589131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df15b11-8f0d-4a1f-98c9-073fb691c048 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:11.589792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df15b11-8f0d-4a1f-98c9-073fb691c048 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:11.590094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df15b11-8f0d-4a1f-98c9-073fb691c048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:11.591489 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df15b11-8f0d-4a1f-98c9-073fb691c048 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:11.599932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 224/443] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:11.600697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df15b11-8f0d-4a1f-98c9-073fb691c048 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:11.615707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:11.639152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f830769-3aa6-44c1-97a7-d1b0608d0b11 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:11.674248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72ee12-c915-4ed3-91b3-7b77e3b1ced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:11.674869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72ee12-c915-4ed3-91b3-7b77e3b1ced0 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:11.675175 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72ee12-c915-4ed3-91b3-7b77e3b1ced0 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:11.675446 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72ee12-c915-4ed3-91b3-7b77e3b1ced0 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:11.676577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72ee12-c915-4ed3-91b3-7b77e3b1ced0 None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:11.678004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72ee12-c915-4ed3-91b3-7b77e3b1ced0 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:11.679828 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 220/444] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:11 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:11.680411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72ee12-c915-4ed3-91b3-7b77e3b1ced0 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:11.684155 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:11.702420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df15b11-8f0d-4a1f-98c9-073fb691c048 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:11.742168 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec429d0-743c-4697-b547-d838e3a86c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:11.742789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec429d0-743c-4697-b547-d838e3a86c78 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:11.743094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec429d0-743c-4697-b547-d838e3a86c78 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:11.743367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec429d0-743c-4697-b547-d838e3a86c78 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:11.744036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec429d0-743c-4697-b547-d838e3a86c78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:11.744337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec429d0-743c-4697-b547-d838e3a86c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:11.745700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec429d0-743c-4697-b547-d838e3a86c78 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:11.753726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 225/445] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:11.754567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec429d0-743c-4697-b547-d838e3a86c78 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:11.781676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72ee12-c915-4ed3-91b3-7b77e3b1ced0 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:11.815760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af7f44-0085-44dc-9d3c-61fc0084d854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:11.816363 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af7f44-0085-44dc-9d3c-61fc0084d854 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:11.816639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af7f44-0085-44dc-9d3c-61fc0084d854 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:11.816979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af7f44-0085-44dc-9d3c-61fc0084d854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:11.828439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:11.853835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec429d0-743c-4697-b547-d838e3a86c78 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:11.885542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af7f44-0085-44dc-9d3c-61fc0084d854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:11.887026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af7f44-0085-44dc-9d3c-61fc0084d854 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:11.887629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed22733-1473-4b7d-bbcd-7cb1942d0c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:11.888252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed22733-1473-4b7d-bbcd-7cb1942d0c4a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:11.888539 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed22733-1473-4b7d-bbcd-7cb1942d0c4a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:11.888817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed22733-1473-4b7d-bbcd-7cb1942d0c4a None admin] PATH_INFO: `/v3/groups/167c7f13daa24f70864ae59406d88eb3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:11.890208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:11.890435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed22733-1473-4b7d-bbcd-7cb1942d0c4a None admin] RBAC: Authorizing `identity:get_group(group_id=167c7f13daa24f70864ae59406d88eb3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:11.891887 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed22733-1473-4b7d-bbcd-7cb1942d0c4a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:11.893459 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 226/446] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:11 2022] GET /identity/v3/groups/167c7f13daa24f70864ae59406d88eb3 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:11.894221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed22733-1473-4b7d-bbcd-7cb1942d0c4a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:11.986029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 221/447] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:11.986870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af7f44-0085-44dc-9d3c-61fc0084d854 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:11.993909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed22733-1473-4b7d-bbcd-7cb1942d0c4a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:12.028344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13132789-caa9-4093-b2af-460e42b00300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:12.028945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13132789-caa9-4093-b2af-460e42b00300 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:12.029224 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13132789-caa9-4093-b2af-460e42b00300 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:12.029494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13132789-caa9-4093-b2af-460e42b00300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:12.042211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:12.083605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af7f44-0085-44dc-9d3c-61fc0084d854 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:12.085874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:12.096808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13132789-caa9-4093-b2af-460e42b00300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:12.098268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13132789-caa9-4093-b2af-460e42b00300 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:12.118103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84d057-d7d6-448e-b173-b17cba9798be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:12.118103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84d057-d7d6-448e-b173-b17cba9798be None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:12.118103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84d057-d7d6-448e-b173-b17cba9798be None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:12.118103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84d057-d7d6-448e-b173-b17cba9798be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:12.118708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84d057-d7d6-448e-b173-b17cba9798be None admin] RBAC: Adding query filter params (group.id=167c7f13daa24f70864ae59406d88eb3, role.id=aaefcf4fc05547caa577d6f4db32e1b5, scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:12.119054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84d057-d7d6-448e-b173-b17cba9798be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:12.120515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84d057-d7d6-448e-b173-b17cba9798be None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:12.134947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 222/448] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Aug 29 23:38:11 2022] GET /identity/v3/role_assignments?group.id=167c7f13daa24f70864ae59406d88eb3&scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c&role.id=aaefcf4fc05547caa577d6f4db32e1b5 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:12.134947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84d057-d7d6-448e-b173-b17cba9798be None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:12.226697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 227/449] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:12.233043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13132789-caa9-4093-b2af-460e42b00300 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:12.240750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84d057-d7d6-448e-b173-b17cba9798be None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:12.278965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0c348-b121-4f5a-867f-88a4f1b66089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:12.279603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0c348-b121-4f5a-867f-88a4f1b66089 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:12.279882 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0c348-b121-4f5a-867f-88a4f1b66089 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:12.280177 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0c348-b121-4f5a-867f-88a4f1b66089 None admin] PATH_INFO: `/v3/projects/959954cde09c4c1cb490e7a7a1c17381` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:12.281313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0c348-b121-4f5a-867f-88a4f1b66089 None admin] RBAC: Authorizing `identity:get_project(project_id=959954cde09c4c1cb490e7a7a1c17381)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:12.282738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0c348-b121-4f5a-867f-88a4f1b66089 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:12.285765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 223/450] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:12 2022] GET /identity/v3/projects/959954cde09c4c1cb490e7a7a1c17381 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:12.286862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:12.289902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0c348-b121-4f5a-867f-88a4f1b66089 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:12.333739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:12.352118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13132789-caa9-4093-b2af-460e42b00300 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:12.392151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042f990-bc0c-4537-80f2-36a911aa6154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:12.392707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042f990-bc0c-4537-80f2-36a911aa6154 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:12.392985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042f990-bc0c-4537-80f2-36a911aa6154 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:12.393258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042f990-bc0c-4537-80f2-36a911aa6154 None admin] PATH_INFO: `/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:12.394448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042f990-bc0c-4537-80f2-36a911aa6154 None admin] RBAC: Authorizing `identity:get_project(project_id=977fa7acdb0b47bfb8fc7727e2878e1c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:12.396901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042f990-bc0c-4537-80f2-36a911aa6154 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:12.397928 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 228/451] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:38:12 2022] GET /identity/v3/projects/977fa7acdb0b47bfb8fc7727e2878e1c => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:12.403801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042f990-bc0c-4537-80f2-36a911aa6154 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:12.422563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0c348-b121-4f5a-867f-88a4f1b66089 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:12.463978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d995d75-af99-4474-9d42-a5b604ede9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:12.464618 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d995d75-af99-4474-9d42-a5b604ede9e5 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:12.464899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d995d75-af99-4474-9d42-a5b604ede9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:12.465174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d995d75-af99-4474-9d42-a5b604ede9e5 None admin] PATH_INFO: `/v3/groups/4f75fe5023ea47feb8e365003503f663` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:12.466295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d995d75-af99-4474-9d42-a5b604ede9e5 None admin] RBAC: Authorizing `identity:get_group(group_id=4f75fe5023ea47feb8e365003503f663)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:12.467819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d995d75-af99-4474-9d42-a5b604ede9e5 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:12.469569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 224/452] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:12 2022] GET /identity/v3/groups/4f75fe5023ea47feb8e365003503f663 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:12.475309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d995d75-af99-4474-9d42-a5b604ede9e5 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:12.523295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042f990-bc0c-4537-80f2-36a911aa6154 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:12.533873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:12.557402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd44a76-8f0c-4938-a562-00b140e5c793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:12.558029 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd44a76-8f0c-4938-a562-00b140e5c793 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:12.558313 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd44a76-8f0c-4938-a562-00b140e5c793 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:12.558589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd44a76-8f0c-4938-a562-00b140e5c793 None admin] PATH_INFO: `/v3/groups/167c7f13daa24f70864ae59406d88eb3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:12.559726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd44a76-8f0c-4938-a562-00b140e5c793 None admin] RBAC: Authorizing `identity:get_group(group_id=167c7f13daa24f70864ae59406d88eb3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:12.561201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd44a76-8f0c-4938-a562-00b140e5c793 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:12.563345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 229/453] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Aug 29 23:38:12 2022] GET /identity/v3/groups/167c7f13daa24f70864ae59406d88eb3 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:12.569182 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd44a76-8f0c-4938-a562-00b140e5c793 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:12.573574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d995d75-af99-4474-9d42-a5b604ede9e5 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:12.575910 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:12.606539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac98a6-43ff-4271-9f9c-8963183fb605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:12.607229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac98a6-43ff-4271-9f9c-8963183fb605 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:12.607511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac98a6-43ff-4271-9f9c-8963183fb605 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:12.607782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac98a6-43ff-4271-9f9c-8963183fb605 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:12.609029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac98a6-43ff-4271-9f9c-8963183fb605 None admin] RBAC: Adding query filter params (group.id=4f75fe5023ea47feb8e365003503f663, role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=959954cde09c4c1cb490e7a7a1c17381) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:12.609336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac98a6-43ff-4271-9f9c-8963183fb605 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:12.610791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac98a6-43ff-4271-9f9c-8963183fb605 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:12.617481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 225/454] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Aug 29 23:38:12 2022] GET /identity/v3/role_assignments?group.id=4f75fe5023ea47feb8e365003503f663&scope.project.id=959954cde09c4c1cb490e7a7a1c17381&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:12.673218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd44a76-8f0c-4938-a562-00b140e5c793 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:12.709347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b32f60-e051-4464-a0b6-b69dca0f6599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:12.709968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b32f60-e051-4464-a0b6-b69dca0f6599 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:12.710247 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b32f60-e051-4464-a0b6-b69dca0f6599 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:12.710519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b32f60-e051-4464-a0b6-b69dca0f6599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:12.711280 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b32f60-e051-4464-a0b6-b69dca0f6599 None admin] RBAC: Adding query filter params (group.id=167c7f13daa24f70864ae59406d88eb3, role.id=06cbbfa32c9549ffa2d1fd68736820a1, scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:12.711589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b32f60-e051-4464-a0b6-b69dca0f6599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:12.713042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b32f60-e051-4464-a0b6-b69dca0f6599 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:12.719634 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 230/455] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Aug 29 23:38:12 2022] GET /identity/v3/role_assignments?group.id=167c7f13daa24f70864ae59406d88eb3&scope.project.id=977fa7acdb0b47bfb8fc7727e2878e1c&role.id=06cbbfa32c9549ffa2d1fd68736820a1 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:15.153145 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989b955-a941-432b-a90a-feefe7d67aa4 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:15.153693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989b955-a941-432b-a90a-feefe7d67aa4 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:15.153693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989b955-a941-432b-a90a-feefe7d67aa4 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:15.155152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 226/456] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:15.165433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952e579-ae60-413e-b212-b14b99a5d133 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:15.165956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952e579-ae60-413e-b212-b14b99a5d133 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:15.165956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952e579-ae60-413e-b212-b14b99a5d133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:15.192058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-3952e579-ae60-413e-b212-b14b99a5d133 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:15.193277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-3952e579-ae60-413e-b212-b14b99a5d133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:15.242130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:15.282670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 231/457] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:15.402629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3e974-08be-4a03-b99b-ea964f4ebd06 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:15.402971 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3e974-08be-4a03-b99b-ea964f4ebd06 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:15.403266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3e974-08be-4a03-b99b-ea964f4ebd06 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:15.404627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 227/458] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:15.409992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e685fe8-2725-4b63-99c7-c45280978251 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:15.410530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e685fe8-2725-4b63-99c7-c45280978251 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:15.411033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e685fe8-2725-4b63-99c7-c45280978251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:15.432569 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-9e685fe8-2725-4b63-99c7-c45280978251 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:15.434043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9e685fe8-2725-4b63-99c7-c45280978251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:15.523553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 232/459] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:38:15.611223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3e974-08be-4a03-b99b-ea964f4ebd06 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:15.749674 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3e974-08be-4a03-b99b-ea964f4ebd06 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:15.770253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8f660-6998-4a3d-aa64-0e6931e6caf2 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:15.770871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8f660-6998-4a3d-aa64-0e6931e6caf2 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:15.771366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8f660-6998-4a3d-aa64-0e6931e6caf2 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:15.773202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 233/460] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:15.780285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45d5fc-d912-4dab-9ab3-741c4fcbee52 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:15.780843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45d5fc-d912-4dab-9ab3-741c4fcbee52 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:15.781420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45d5fc-d912-4dab-9ab3-741c4fcbee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:15.794983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65885a5-6ba8-47db-ac19-4da4a1e1dcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:15.795541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65885a5-6ba8-47db-ac19-4da4a1e1dcb5 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:15.796336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65885a5-6ba8-47db-ac19-4da4a1e1dcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:15.796605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65885a5-6ba8-47db-ac19-4da4a1e1dcb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:15.801956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-4f45d5fc-d912-4dab-9ab3-741c4fcbee52 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:15.803513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4f45d5fc-d912-4dab-9ab3-741c4fcbee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:15.812351 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65885a5-6ba8-47db-ac19-4da4a1e1dcb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:15.813810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65885a5-6ba8-47db-ac19-4da4a1e1dcb5 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-e65885a5-6ba8-47db-ac19-4da4a1e1dcb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:15.837829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:15.838941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:15.840017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:15.840017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:15.840017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:15.841932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 228/461] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:15.843089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65885a5-6ba8-47db-ac19-4da4a1e1dcb5 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:15.867700 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:15.899736 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 234/462] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:15.901036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45d5fc-d912-4dab-9ab3-741c4fcbee52 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:15.949313 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:15.952075 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65885a5-6ba8-47db-ac19-4da4a1e1dcb5 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:15.989737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc50ae4-d0f0-4a98-9057-ff15391204b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:15.990681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc50ae4-d0f0-4a98-9057-ff15391204b1 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:15.991179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc50ae4-d0f0-4a98-9057-ff15391204b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:15.991774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc50ae4-d0f0-4a98-9057-ff15391204b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:16.003570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc50ae4-d0f0-4a98-9057-ff15391204b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:16.005248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc50ae4-d0f0-4a98-9057-ff15391204b1 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-6dc50ae4-d0f0-4a98-9057-ff15391204b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:16.022205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:16.023223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:16.024056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:16.024056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:16.024056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:16.030779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 229/463] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:16.032516 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc43340-840c-4b24-af5d-928419d2b70c None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:16.033000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc43340-840c-4b24-af5d-928419d2b70c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:16.033535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc43340-840c-4b24-af5d-928419d2b70c None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:16.034934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45d5fc-d912-4dab-9ab3-741c4fcbee52 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:16.035219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 230/464] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:16.036078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc43340-840c-4b24-af5d-928419d2b70c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:16.078731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2872fb9-4c66-45f7-a185-00966ef0c918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:16.079849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2872fb9-4c66-45f7-a185-00966ef0c918 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:16.080218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2872fb9-4c66-45f7-a185-00966ef0c918 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:16.080581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2872fb9-4c66-45f7-a185-00966ef0c918 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:16.082147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2872fb9-4c66-45f7-a185-00966ef0c918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:16.082522 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2872fb9-4c66-45f7-a185-00966ef0c918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:16.083992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2872fb9-4c66-45f7-a185-00966ef0c918 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:16.102655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 235/465] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:16.102655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d4f1-347d-40b4-8af7-d576c0181d21 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:16.102655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d4f1-347d-40b4-8af7-d576c0181d21 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:16.102655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d4f1-347d-40b4-8af7-d576c0181d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:16.121988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-91c3d4f1-347d-40b4-8af7-d576c0181d21 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:16.123482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-91c3d4f1-347d-40b4-8af7-d576c0181d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:16.127159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:16.159829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc43340-840c-4b24-af5d-928419d2b70c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:16.196313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5f61e-34c6-4843-92d9-5958c4172871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:16.197018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5f61e-34c6-4843-92d9-5958c4172871 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:16.197370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5f61e-34c6-4843-92d9-5958c4172871 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:16.197714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5f61e-34c6-4843-92d9-5958c4172871 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:16.198433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5f61e-34c6-4843-92d9-5958c4172871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:16.198808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5f61e-34c6-4843-92d9-5958c4172871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:16.204037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5f61e-34c6-4843-92d9-5958c4172871 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:16.204544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 236/466] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:16.205890 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3d4f1-347d-40b4-8af7-d576c0181d21 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:16.215250 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 231/467] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:16.218027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5f61e-34c6-4843-92d9-5958c4172871 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:16.241833 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:16.321881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5f61e-34c6-4843-92d9-5958c4172871 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:16.327202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3d4f1-347d-40b4-8af7-d576c0181d21 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:16.351995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:16.357255 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10165b7-a096-45c7-83db-599e709cb63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:16.357889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10165b7-a096-45c7-83db-599e709cb63a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:16.358741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10165b7-a096-45c7-83db-599e709cb63a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:16.359013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10165b7-a096-45c7-83db-599e709cb63a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:16.371176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d221eb-0936-4485-8c32-b8501f495c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:16.371794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d221eb-0936-4485-8c32-b8501f495c65 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:16.372456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d221eb-0936-4485-8c32-b8501f495c65 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:16.372750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d221eb-0936-4485-8c32-b8501f495c65 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:16.373401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d221eb-0936-4485-8c32-b8501f495c65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:16.375244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10165b7-a096-45c7-83db-599e709cb63a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:16.375723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d221eb-0936-4485-8c32-b8501f495c65 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:16.377051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10165b7-a096-45c7-83db-599e709cb63a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-b10165b7-a096-45c7-83db-599e709cb63a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:16.394658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:16.395817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:16.396738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:16.396738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:16.396738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:16.401416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 232/468] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:16.402388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10165b7-a096-45c7-83db-599e709cb63a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:16.482489 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 237/469] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:38:16 2022] POST /identity/v3/users => generated 246 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:38:16.483700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d221eb-0936-4485-8c32-b8501f495c65 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:16.531748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10165b7-a096-45c7-83db-599e709cb63a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:16.575510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:16.585586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231068c9-6b1a-4e22-9824-43452e0ec672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:16.589106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231068c9-6b1a-4e22-9824-43452e0ec672 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:16.589106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231068c9-6b1a-4e22-9824-43452e0ec672 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:16.589106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231068c9-6b1a-4e22-9824-43452e0ec672 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:16.589106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231068c9-6b1a-4e22-9824-43452e0ec672 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:16.591653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231068c9-6b1a-4e22-9824-43452e0ec672 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:16.604979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d221eb-0936-4485-8c32-b8501f495c65 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:16.644652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c4be7-a985-44c4-a8f2-501c31a4fc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:16.645286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c4be7-a985-44c4-a8f2-501c31a4fc3c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:16.645566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c4be7-a985-44c4-a8f2-501c31a4fc3c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:16.645839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c4be7-a985-44c4-a8f2-501c31a4fc3c None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:16.646492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c4be7-a985-44c4-a8f2-501c31a4fc3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:16.646801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c4be7-a985-44c4-a8f2-501c31a4fc3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:16.648218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c4be7-a985-44c4-a8f2-501c31a4fc3c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:16.661646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 238/470] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:16.662311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c4be7-a985-44c4-a8f2-501c31a4fc3c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:16.678165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 233/471] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:38:16 2022] POST /identity/v3/users => generated 248 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:38:16.679297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231068c9-6b1a-4e22-9824-43452e0ec672 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:16.739993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:16.812303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c4be7-a985-44c4-a8f2-501c31a4fc3c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:16.828189 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231068c9-6b1a-4e22-9824-43452e0ec672 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:16.857131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495b4bc-bf48-4632-9f65-349bd3868cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:16.858024 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495b4bc-bf48-4632-9f65-349bd3868cd1 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:16.858335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495b4bc-bf48-4632-9f65-349bd3868cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:16.858604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495b4bc-bf48-4632-9f65-349bd3868cd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:16.865758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:16.870606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495b4bc-bf48-4632-9f65-349bd3868cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:16.872094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495b4bc-bf48-4632-9f65-349bd3868cd1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:16.876763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34340b4a-4814-4c17-b616-18bceed646a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:16.877433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340b4a-4814-4c17-b616-18bceed646a4 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:16.877755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340b4a-4814-4c17-b616-18bceed646a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:16.877984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340b4a-4814-4c17-b616-18bceed646a4 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:16.878616 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34340b4a-4814-4c17-b616-18bceed646a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:16.880327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34340b4a-4814-4c17-b616-18bceed646a4 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-f495b4bc-bf48-4632-9f65-349bd3868cd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:16.889585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:16.890654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:16.891863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:16.891863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:16.891863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:16.891863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 239/472] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:16.892870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a37ffc-7521-4098-933f-a36a9c7ee663 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:16.893502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a37ffc-7521-4098-933f-a36a9c7ee663 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:16.894054 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a37ffc-7521-4098-933f-a36a9c7ee663 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:16.895853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 240/473] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:16.896607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a37ffc-7521-4098-933f-a36a9c7ee663 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:16.969060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 234/474] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:38:16 2022] POST /identity/v3/users => generated 248 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:38:16.974936 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634797cb-fd8c-46be-9dae-56603b51e2b7 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:16.974936 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634797cb-fd8c-46be-9dae-56603b51e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:16.974936 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634797cb-fd8c-46be-9dae-56603b51e2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:17.009977 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-634797cb-fd8c-46be-9dae-56603b51e2b7 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:17.011273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-634797cb-fd8c-46be-9dae-56603b51e2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:17.035942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a37ffc-7521-4098-933f-a36a9c7ee663 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:17.116094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33f7c9-5755-41bb-b6e5-6f2a7cb4e488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:17.116981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33f7c9-5755-41bb-b6e5-6f2a7cb4e488 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:17.117970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33f7c9-5755-41bb-b6e5-6f2a7cb4e488 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:17.118382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33f7c9-5755-41bb-b6e5-6f2a7cb4e488 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:17.119406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33f7c9-5755-41bb-b6e5-6f2a7cb4e488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:17.119830 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33f7c9-5755-41bb-b6e5-6f2a7cb4e488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:17.122580 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33f7c9-5755-41bb-b6e5-6f2a7cb4e488 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:17.137432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 241/475] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:17.143366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33f7c9-5755-41bb-b6e5-6f2a7cb4e488 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:17.156666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 235/476] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:17.201601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:17.255471 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33f7c9-5755-41bb-b6e5-6f2a7cb4e488 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:17.291606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41855e-8d9e-4bb2-b1c7-94d0624d45ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:17.292222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41855e-8d9e-4bb2-b1c7-94d0624d45ba None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:17.292504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41855e-8d9e-4bb2-b1c7-94d0624d45ba None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:17.292779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41855e-8d9e-4bb2-b1c7-94d0624d45ba None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:17.293585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41855e-8d9e-4bb2-b1c7-94d0624d45ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:17.295161 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41855e-8d9e-4bb2-b1c7-94d0624d45ba None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:17.419534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 242/477] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:38:17 2022] POST /identity/v3/users => generated 249 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:38:17.443582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634797cb-fd8c-46be-9dae-56603b51e2b7 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:17.482028 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:17.587751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634797cb-fd8c-46be-9dae-56603b51e2b7 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:17.632581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730451b5-1692-4874-a7ef-543b76b70696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:17.633203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730451b5-1692-4874-a7ef-543b76b70696 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:17.633486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730451b5-1692-4874-a7ef-543b76b70696 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:17.633745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730451b5-1692-4874-a7ef-543b76b70696 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:17.634420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730451b5-1692-4874-a7ef-543b76b70696 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:17.635809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730451b5-1692-4874-a7ef-543b76b70696 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:17.688129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.sql.core [None req-730451b5-1692-4874-a7ef-543b76b70696 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 23:38:17.688129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 23:38:17.688129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [parameters: {'id': '4f53e706141b4c9785a0e120c0f68fce', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 23:38:17.688129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93263) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-730451b5-1692-4874-a7ef-543b76b70696 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application result.read() Aug 29 23:38:17.708394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:38:17.709294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application yield resource Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise self.value Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application session.commit() Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 23:38:17.710826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self.session.flush() Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application compat.raise_( Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 23:38:17.711731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:38:17.712589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application result.read() Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:38:17.713405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [parameters: {'id': '4f53e706141b4c9785a0e120c0f68fce', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:17.715161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 23:38:17.717031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:17.719009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 236/478] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Aug 29 23:38:17 2022] POST /identity/v3/roles => generated 144 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:17.719155 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41855e-8d9e-4bb2-b1c7-94d0624d45ba None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:17.833160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41855e-8d9e-4bb2-b1c7-94d0624d45ba None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:17.840472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:17.874969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c294dd-2205-4be2-847d-6ff582969383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:17.875619 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c294dd-2205-4be2-847d-6ff582969383 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:17.875908 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c294dd-2205-4be2-847d-6ff582969383 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:17.876186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c294dd-2205-4be2-847d-6ff582969383 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:17.891303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c294dd-2205-4be2-847d-6ff582969383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-39c294dd-2205-4be2-847d-6ff582969383 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:17.898668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:17.900745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:17.902724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 243/479] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:38:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:17.904305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730451b5-1692-4874-a7ef-543b76b70696 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:18.082317 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:18.095334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730451b5-1692-4874-a7ef-543b76b70696 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:18.141396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf37a9-53b5-4a81-be58-24e9c0808d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:18.142020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf37a9-53b5-4a81-be58-24e9c0808d37 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:18.142309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf37a9-53b5-4a81-be58-24e9c0808d37 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:18.142591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf37a9-53b5-4a81-be58-24e9c0808d37 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:18.144864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf37a9-53b5-4a81-be58-24e9c0808d37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:18.145178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf37a9-53b5-4a81-be58-24e9c0808d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:18.146548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf37a9-53b5-4a81-be58-24e9c0808d37 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:18.156066 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 237/480] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:18.682010 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cdfd5-f207-4d2a-a7bb-eb6f347bca26 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:18.682684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cdfd5-f207-4d2a-a7bb-eb6f347bca26 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:18.682684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cdfd5-f207-4d2a-a7bb-eb6f347bca26 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:18.684273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 244/481] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:18.692323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010398ac-c515-4c97-88ff-3d79474566ba None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:18.692875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010398ac-c515-4c97-88ff-3d79474566ba None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:18.692875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010398ac-c515-4c97-88ff-3d79474566ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:18.711722 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-010398ac-c515-4c97-88ff-3d79474566ba None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:18.712919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-010398ac-c515-4c97-88ff-3d79474566ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:18.821900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 238/482] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:19.024909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0614b-b9eb-4359-b02d-e021894c9dc6 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:19.024909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0614b-b9eb-4359-b02d-e021894c9dc6 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:19.024909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0614b-b9eb-4359-b02d-e021894c9dc6 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:19.025873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 245/483] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:19.030820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba35441-3702-4a99-9aa5-3ae2f9c8f6b9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:19.031132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba35441-3702-4a99-9aa5-3ae2f9c8f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:19.031409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba35441-3702-4a99-9aa5-3ae2f9c8f6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:19.052075 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-aba35441-3702-4a99-9aa5-3ae2f9c8f6b9 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:19.053438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-aba35441-3702-4a99-9aa5-3ae2f9c8f6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:19.136164 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 239/484] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:19.171598 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0614b-b9eb-4359-b02d-e021894c9dc6 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:19.357418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0614b-b9eb-4359-b02d-e021894c9dc6 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:19.400290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967534e-1984-4bc3-b67e-fcda3ad5f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:19.400933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967534e-1984-4bc3-b67e-fcda3ad5f14b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:19.401519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967534e-1984-4bc3-b67e-fcda3ad5f14b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:19.401798 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967534e-1984-4bc3-b67e-fcda3ad5f14b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:19.412984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967534e-1984-4bc3-b67e-fcda3ad5f14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-7967534e-1984-4bc3-b67e-fcda3ad5f14b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:19.418228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:19.419127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:19.421751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 246/485] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:19.425270 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba35441-3702-4a99-9aa5-3ae2f9c8f6b9 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:19.440185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967534e-1984-4bc3-b67e-fcda3ad5f14b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:19.456861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:19.487255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:19.558518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967534e-1984-4bc3-b67e-fcda3ad5f14b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:19.595122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc979a-f64a-4061-a3bd-9400b9c47f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:19.595754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc979a-f64a-4061-a3bd-9400b9c47f77 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:19.596031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc979a-f64a-4061-a3bd-9400b9c47f77 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:19.596300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc979a-f64a-4061-a3bd-9400b9c47f77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:19.608501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc979a-f64a-4061-a3bd-9400b9c47f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-fecc979a-f64a-4061-a3bd-9400b9c47f77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:19.614593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:19.615504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:19.616771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 247/486] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:19.624294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc979a-f64a-4061-a3bd-9400b9c47f77 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:19.680038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba35441-3702-4a99-9aa5-3ae2f9c8f6b9 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:19.715320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f55b8-e2b1-447d-9aa8-bd20ed4fc7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:19.716025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f55b8-e2b1-447d-9aa8-bd20ed4fc7e6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:19.716414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f55b8-e2b1-447d-9aa8-bd20ed4fc7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:19.716758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f55b8-e2b1-447d-9aa8-bd20ed4fc7e6 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:19.718154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f55b8-e2b1-447d-9aa8-bd20ed4fc7e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:19.718580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f55b8-e2b1-447d-9aa8-bd20ed4fc7e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:19.720075 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f55b8-e2b1-447d-9aa8-bd20ed4fc7e6 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:19.729737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 240/487] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:19.731067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193aced0-9d10-4014-9c65-65b62181b930 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:19.731422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193aced0-9d10-4014-9c65-65b62181b930 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:19.745276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193aced0-9d10-4014-9c65-65b62181b930 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:19.745276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 241/488] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:19.745276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193aced0-9d10-4014-9c65-65b62181b930 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:19.765844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:19.784058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc979a-f64a-4061-a3bd-9400b9c47f77 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:19.820750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4bb0b-9a25-4ee4-bab9-037e0f1867eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:19.821365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4bb0b-9a25-4ee4-bab9-037e0f1867eb None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:19.821694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4bb0b-9a25-4ee4-bab9-037e0f1867eb None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:19.822044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4bb0b-9a25-4ee4-bab9-037e0f1867eb None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:19.822731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4bb0b-9a25-4ee4-bab9-037e0f1867eb None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:19.823474 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4bb0b-9a25-4ee4-bab9-037e0f1867eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:19.825323 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4bb0b-9a25-4ee4-bab9-037e0f1867eb None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:19.826074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:19.835878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 248/489] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:19.837308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aff8d-9f9c-4b05-b7f0-cc2d43c981bc None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:19.837596 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aff8d-9f9c-4b05-b7f0-cc2d43c981bc None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:19.837873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aff8d-9f9c-4b05-b7f0-cc2d43c981bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:19.856716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a53aff8d-9f9c-4b05-b7f0-cc2d43c981bc None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:19.857924 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a53aff8d-9f9c-4b05-b7f0-cc2d43c981bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:19.859212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193aced0-9d10-4014-9c65-65b62181b930 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:19.899067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e864ee-1ffe-49e3-a809-ccbb6dbf253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:19.899697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e864ee-1ffe-49e3-a809-ccbb6dbf253b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:19.900001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e864ee-1ffe-49e3-a809-ccbb6dbf253b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:19.900243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e864ee-1ffe-49e3-a809-ccbb6dbf253b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:19.912173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e864ee-1ffe-49e3-a809-ccbb6dbf253b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:19.913622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e864ee-1ffe-49e3-a809-ccbb6dbf253b None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-95e864ee-1ffe-49e3-a809-ccbb6dbf253b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:19.928180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:19.929100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:19.935518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:19.935518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:19.935518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:19.935518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 242/490] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:19.935518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfa6ad-740c-4373-bebe-f941bb23ff3e None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:19.935518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfa6ad-740c-4373-bebe-f941bb23ff3e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:19.935518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfa6ad-740c-4373-bebe-f941bb23ff3e None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:19.935518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 243/491] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:19.935518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfa6ad-740c-4373-bebe-f941bb23ff3e None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:19.942554 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 249/492] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:19.943460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aff8d-9f9c-4b05-b7f0-cc2d43c981bc None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:20.028389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:20.049997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfa6ad-740c-4373-bebe-f941bb23ff3e None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:20.057950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aff8d-9f9c-4b05-b7f0-cc2d43c981bc None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:20.079367 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:20.089350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1f456-a628-402f-8c10-9ad957e5635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:20.090226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1f456-a628-402f-8c10-9ad957e5635f None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:20.090738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1f456-a628-402f-8c10-9ad957e5635f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:20.091374 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1f456-a628-402f-8c10-9ad957e5635f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:20.097311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bbe63-fb3f-4183-aa7a-a95b88db5a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:20.097921 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bbe63-fb3f-4183-aa7a-a95b88db5a14 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:20.098198 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bbe63-fb3f-4183-aa7a-a95b88db5a14 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:20.098465 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bbe63-fb3f-4183-aa7a-a95b88db5a14 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:20.099175 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bbe63-fb3f-4183-aa7a-a95b88db5a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:20.099575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bbe63-fb3f-4183-aa7a-a95b88db5a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:20.101020 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bbe63-fb3f-4183-aa7a-a95b88db5a14 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:20.105228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1f456-a628-402f-8c10-9ad957e5635f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:20.106941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1f456-a628-402f-8c10-9ad957e5635f None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:20.116113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 250/493] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:20.117499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700f26-ee07-4e7c-b261-9ce2d94dea68 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:20.117867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700f26-ee07-4e7c-b261-9ce2d94dea68 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:20.118150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700f26-ee07-4e7c-b261-9ce2d94dea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-74d1f456-a628-402f-8c10-9ad957e5635f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:20.124370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:20.125258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:20.126184 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:20.126184 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:20.126184 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:20.129411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 244/494] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:20.133938 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1f456-a628-402f-8c10-9ad957e5635f None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:20.138941 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-94700f26-ee07-4e7c-b261-9ce2d94dea68 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:20.140297 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-94700f26-ee07-4e7c-b261-9ce2d94dea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:20.214704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 251/495] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:20.215684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700f26-ee07-4e7c-b261-9ce2d94dea68 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:20.247074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1f456-a628-402f-8c10-9ad957e5635f None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:20.284992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985125fc-01f8-4f71-b29a-75b704c791a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:20.285960 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985125fc-01f8-4f71-b29a-75b704c791a1 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:20.286440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985125fc-01f8-4f71-b29a-75b704c791a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:20.287037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985125fc-01f8-4f71-b29a-75b704c791a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:20.288124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:20.296017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985125fc-01f8-4f71-b29a-75b704c791a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:20.297706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985125fc-01f8-4f71-b29a-75b704c791a1 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-985125fc-01f8-4f71-b29a-75b704c791a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:20.311265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:20.312223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:20.313132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:20.313132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:20.313132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:20.313132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:20.313132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:20.313132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:20.313132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:20.313132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:20.313132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:38:20.313132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:20.315666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 245/496] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Aug 29 23:38:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:20.316699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985125fc-01f8-4f71-b29a-75b704c791a1 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:20.323539 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700f26-ee07-4e7c-b261-9ce2d94dea68 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:20.361531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:20.363226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d047ef-7d94-4b21-9a53-be5e998450a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:20.364080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d047ef-7d94-4b21-9a53-be5e998450a0 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:20.364533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d047ef-7d94-4b21-9a53-be5e998450a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:20.365230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d047ef-7d94-4b21-9a53-be5e998450a0 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:20.366809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d047ef-7d94-4b21-9a53-be5e998450a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:20.367370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d047ef-7d94-4b21-9a53-be5e998450a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:20.368985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d047ef-7d94-4b21-9a53-be5e998450a0 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:20.381463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 252/497] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:20.382493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d047ef-7d94-4b21-9a53-be5e998450a0 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:20.432745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985125fc-01f8-4f71-b29a-75b704c791a1 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:20.470485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3643-f71c-4df0-bcdf-85e2efc6a9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:20.471270 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3643-f71c-4df0-bcdf-85e2efc6a9fd None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:20.471623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3643-f71c-4df0-bcdf-85e2efc6a9fd None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:20.472055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3643-f71c-4df0-bcdf-85e2efc6a9fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:20.484342 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f3643-f71c-4df0-bcdf-85e2efc6a9fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-8c0f3643-f71c-4df0-bcdf-85e2efc6a9fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:20.490996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:20.491883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:20.492673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 246/498] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:20.493700 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3643-f71c-4df0-bcdf-85e2efc6a9fd None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:20.495962 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d047ef-7d94-4b21-9a53-be5e998450a0 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:20.525056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:20.534044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4ee7c-fea6-426b-ab30-61c2a27a6e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:20.534658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4ee7c-fea6-426b-ab30-61c2a27a6e56 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:20.535118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4ee7c-fea6-426b-ab30-61c2a27a6e56 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:20.535282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4ee7c-fea6-426b-ab30-61c2a27a6e56 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:20.536003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4ee7c-fea6-426b-ab30-61c2a27a6e56 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:20.537022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4ee7c-fea6-426b-ab30-61c2a27a6e56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:20.538456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4ee7c-fea6-426b-ab30-61c2a27a6e56 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:20.577551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 253/499] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Aug 29 23:38:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:20.578803 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4ee7c-fea6-426b-ab30-61c2a27a6e56 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:20.602344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:20.606774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3643-f71c-4df0-bcdf-85e2efc6a9fd None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:20.642554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f9ced-88d7-4158-ad86-98ed2acebade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:20.642554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f9ced-88d7-4158-ad86-98ed2acebade None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:20.642554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f9ced-88d7-4158-ad86-98ed2acebade None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:20.642554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f9ced-88d7-4158-ad86-98ed2acebade None admin] PATH_INFO: `/v3/users/glance` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:20.648472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f9ced-88d7-4158-ad86-98ed2acebade None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:20.649911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f9ced-88d7-4158-ad86-98ed2acebade None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-201f9ced-88d7-4158-ad86-98ed2acebade None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:20.663332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:20.664288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:20.665176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:20.665176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:20.665176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:20.665176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:20.665176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:20.665176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:20.665176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:20.665176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:20.665176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:38:20.665176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:20.673289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 247/500] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:20.673289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f9ced-88d7-4158-ad86-98ed2acebade None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:20.693000 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4ee7c-fea6-426b-ab30-61c2a27a6e56 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:20.727224 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6bbf3-528d-424c-a878-2d6efdd5d68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:20.727854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6bbf3-528d-424c-a878-2d6efdd5d68e None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:20.728122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6bbf3-528d-424c-a878-2d6efdd5d68e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:20.728392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6bbf3-528d-424c-a878-2d6efdd5d68e None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:20.729050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6bbf3-528d-424c-a878-2d6efdd5d68e None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:20.729630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6bbf3-528d-424c-a878-2d6efdd5d68e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:20.731028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6bbf3-528d-424c-a878-2d6efdd5d68e None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:20.739965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 254/501] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:20.745004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6bbf3-528d-424c-a878-2d6efdd5d68e None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:20.782747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f9ced-88d7-4158-ad86-98ed2acebade None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:20.798182 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:20.820533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19988717-d4ca-45c3-9a73-84b9b138158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:20.821181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19988717-d4ca-45c3-9a73-84b9b138158c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:20.821465 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19988717-d4ca-45c3-9a73-84b9b138158c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:20.821738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19988717-d4ca-45c3-9a73-84b9b138158c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:20.832816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19988717-d4ca-45c3-9a73-84b9b138158c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-19988717-d4ca-45c3-9a73-84b9b138158c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:20.838060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:20.839149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:20.840078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 248/502] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:20.840727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19988717-d4ca-45c3-9a73-84b9b138158c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:20.858749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6bbf3-528d-424c-a878-2d6efdd5d68e None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:20.861694 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:20.894819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53da3c9-500e-4c75-b76d-73d6923de3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:20.895386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53da3c9-500e-4c75-b76d-73d6923de3a4 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:20.895667 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53da3c9-500e-4c75-b76d-73d6923de3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:20.895947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53da3c9-500e-4c75-b76d-73d6923de3a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:20.945208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19988717-d4ca-45c3-9a73-84b9b138158c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:20.964965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53da3c9-500e-4c75-b76d-73d6923de3a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:20.966430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53da3c9-500e-4c75-b76d-73d6923de3a4 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:20.979638 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dedc58-a516-47b3-9871-bf582e14dcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:20.980246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dedc58-a516-47b3-9871-bf582e14dcd6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:20.980525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dedc58-a516-47b3-9871-bf582e14dcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:20.980797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dedc58-a516-47b3-9871-bf582e14dcd6 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:20.981519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dedc58-a516-47b3-9871-bf582e14dcd6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:20.981827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dedc58-a516-47b3-9871-bf582e14dcd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:20.983320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dedc58-a516-47b3-9871-bf582e14dcd6 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:21.013778 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:21.018872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 249/503] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Aug 29 23:38:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:21.019705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dedc58-a516-47b3-9871-bf582e14dcd6 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:21.065949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 255/504] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:21.066793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53da3c9-500e-4c75-b76d-73d6923de3a4 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:21.097223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:21.119777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dedc58-a516-47b3-9871-bf582e14dcd6 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:21.153919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d059b-7f25-4d4a-a6fb-80b5a66a92f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:21.154503 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d059b-7f25-4d4a-a6fb-80b5a66a92f9 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:21.154844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d059b-7f25-4d4a-a6fb-80b5a66a92f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:21.155641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d059b-7f25-4d4a-a6fb-80b5a66a92f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:21.165770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d059b-7f25-4d4a-a6fb-80b5a66a92f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:21.167210 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53da3c9-500e-4c75-b76d-73d6923de3a4 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:21.167314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d059b-7f25-4d4a-a6fb-80b5a66a92f9 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-a16d059b-7f25-4d4a-a6fb-80b5a66a92f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:21.181710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:21.182613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:21.183476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:21.183476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:21.183476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:21.183476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 250/505] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:21.183970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04093c-0624-4c44-bd4a-df01f5443d54 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:21.184226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04093c-0624-4c44-bd4a-df01f5443d54 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:21.184492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04093c-0624-4c44-bd4a-df01f5443d54 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:21.185820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 251/506] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:21.187046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04093c-0624-4c44-bd4a-df01f5443d54 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:21.205694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fe674-a3a5-4eaf-b9d2-7a4cc1b4537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:21.206298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fe674-a3a5-4eaf-b9d2-7a4cc1b4537a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:21.206572 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fe674-a3a5-4eaf-b9d2-7a4cc1b4537a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:21.206845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fe674-a3a5-4eaf-b9d2-7a4cc1b4537a None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:21.207649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fe674-a3a5-4eaf-b9d2-7a4cc1b4537a None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:21.207947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fe674-a3a5-4eaf-b9d2-7a4cc1b4537a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:21.209335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fe674-a3a5-4eaf-b9d2-7a4cc1b4537a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:21.217109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 256/507] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:21.218433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fe674-a3a5-4eaf-b9d2-7a4cc1b4537a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:21.232247 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:21.289957 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04093c-0624-4c44-bd4a-df01f5443d54 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:21.315293 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:21.319251 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fe674-a3a5-4eaf-b9d2-7a4cc1b4537a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:21.322555 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb3405-999d-4db4-81f5-3e9e2b7a1612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:21.323182 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb3405-999d-4db4-81f5-3e9e2b7a1612 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:21.323461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb3405-999d-4db4-81f5-3e9e2b7a1612 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:21.323749 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb3405-999d-4db4-81f5-3e9e2b7a1612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:21.357596 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed712463-3bd7-412f-b702-400e4e71d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:21.358768 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed712463-3bd7-412f-b702-400e4e71d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:21.359071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed712463-3bd7-412f-b702-400e4e71d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:21.359340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed712463-3bd7-412f-b702-400e4e71d6c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:21.370214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed712463-3bd7-412f-b702-400e4e71d6c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:21.372033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed712463-3bd7-412f-b702-400e4e71d6c9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-ed712463-3bd7-412f-b702-400e4e71d6c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:21.386891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:21.387848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:21.388710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:21.388710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:21.388710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:21.388710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 257/508] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:21.388918 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed712463-3bd7-412f-b702-400e4e71d6c9 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:21.400065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb3405-999d-4db4-81f5-3e9e2b7a1612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:21.401518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb3405-999d-4db4-81f5-3e9e2b7a1612 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:21.449034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:21.497166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed712463-3bd7-412f-b702-400e4e71d6c9 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:21.500845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 252/509] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:21.502094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b5c52-e46b-44f4-82c7-8b9b3ccdd657 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:21.502375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b5c52-e46b-44f4-82c7-8b9b3ccdd657 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:21.502650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b5c52-e46b-44f4-82c7-8b9b3ccdd657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:21.519865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a88b5c52-e46b-44f4-82c7-8b9b3ccdd657 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:21.521066 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a88b5c52-e46b-44f4-82c7-8b9b3ccdd657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:21.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40b4d4-ea28-4ffb-ba5c-50a8c36e2cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:21.532852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b4d4-ea28-4ffb-ba5c-50a8c36e2cff None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:21.533136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b4d4-ea28-4ffb-ba5c-50a8c36e2cff None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:21.533413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b4d4-ea28-4ffb-ba5c-50a8c36e2cff None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:21.534052 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40b4d4-ea28-4ffb-ba5c-50a8c36e2cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:21.534360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40b4d4-ea28-4ffb-ba5c-50a8c36e2cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:21.535764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40b4d4-ea28-4ffb-ba5c-50a8c36e2cff None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:21.543501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:21.548331 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 258/510] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:21.549112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40b4d4-ea28-4ffb-ba5c-50a8c36e2cff None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:21.587128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 253/511] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:21.587966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b5c52-e46b-44f4-82c7-8b9b3ccdd657 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:21.661778 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40b4d4-ea28-4ffb-ba5c-50a8c36e2cff None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:21.685735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:21.699688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b5c52-e46b-44f4-82c7-8b9b3ccdd657 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:21.700986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3d545-1ae4-426d-9482-99132faeafe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:21.702488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3d545-1ae4-426d-9482-99132faeafe1 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:21.703648 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3d545-1ae4-426d-9482-99132faeafe1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:21.704086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3d545-1ae4-426d-9482-99132faeafe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:21.716341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3d545-1ae4-426d-9482-99132faeafe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:21.719516 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3d545-1ae4-426d-9482-99132faeafe1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-81e3d545-1ae4-426d-9482-99132faeafe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:21.734922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:21.735927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:21.736751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:21.736751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:21.736751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:21.736751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 259/512] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:21.736751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3d545-1ae4-426d-9482-99132faeafe1 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:21.753131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bba5f-2495-4917-a050-c1ef821161ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:21.753964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bba5f-2495-4917-a050-c1ef821161ae None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:21.754246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bba5f-2495-4917-a050-c1ef821161ae None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:21.754518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bba5f-2495-4917-a050-c1ef821161ae None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:21.755193 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bba5f-2495-4917-a050-c1ef821161ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:21.755497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bba5f-2495-4917-a050-c1ef821161ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:21.756866 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bba5f-2495-4917-a050-c1ef821161ae None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:21.769216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 254/513] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:21.769944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bba5f-2495-4917-a050-c1ef821161ae None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:21.789913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:21.850564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3d545-1ae4-426d-9482-99132faeafe1 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:21.875740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bba5f-2495-4917-a050-c1ef821161ae None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:21.885806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb32f0-b82a-415e-b688-e2403de3c71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:21.886430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb32f0-b82a-415e-b688-e2403de3c71b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:21.886710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb32f0-b82a-415e-b688-e2403de3c71b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:21.887010 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb32f0-b82a-415e-b688-e2403de3c71b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:21.898097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb32f0-b82a-415e-b688-e2403de3c71b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:21.899597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb32f0-b82a-415e-b688-e2403de3c71b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:21.910000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123f489-051a-4893-becd-f0928582b295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:21.910623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123f489-051a-4893-becd-f0928582b295 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:21.910930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123f489-051a-4893-becd-f0928582b295 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:21.911207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123f489-051a-4893-becd-f0928582b295 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-f0cb32f0-b82a-415e-b688-e2403de3c71b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:21.914259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:21.915170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:21.916056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:21.916056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:21.916056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:21.916056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 260/514] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:21.916276 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb32f0-b82a-415e-b688-e2403de3c71b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:21.918091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123f489-051a-4893-becd-f0928582b295 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:21.919550 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123f489-051a-4893-becd-f0928582b295 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-3123f489-051a-4893-becd-f0928582b295 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:21.932034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:21.938059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:21.939495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:21.939495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:21.939495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:21.939495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:21.939495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:21.939495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:21.939495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:21.939495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:21.939495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:38:21.939495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:21.939495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 255/515] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:21.939495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123f489-051a-4893-becd-f0928582b295 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:21.956133 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:22.011741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:22.028047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb32f0-b82a-415e-b688-e2403de3c71b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:22.033579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123f489-051a-4893-becd-f0928582b295 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:22.060470 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2edc21-1131-4a70-b01c-fba1a7d50e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:22.061593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2edc21-1131-4a70-b01c-fba1a7d50e9b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:22.061872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2edc21-1131-4a70-b01c-fba1a7d50e9b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:22.062143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2edc21-1131-4a70-b01c-fba1a7d50e9b None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:22.062789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2edc21-1131-4a70-b01c-fba1a7d50e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:22.063104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2edc21-1131-4a70-b01c-fba1a7d50e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:22.064460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2edc21-1131-4a70-b01c-fba1a7d50e9b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:22.065996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b85f-fb09-4796-a227-57b9beb874bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:22.066610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b85f-fb09-4796-a227-57b9beb874bb None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:22.066890 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b85f-fb09-4796-a227-57b9beb874bb None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:22.067237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b85f-fb09-4796-a227-57b9beb874bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:22.074119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0b85f-fb09-4796-a227-57b9beb874bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:22.075700 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0b85f-fb09-4796-a227-57b9beb874bb None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:22.076288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 261/516] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:22.077105 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2edc21-1131-4a70-b01c-fba1a7d50e9b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-43d0b85f-fb09-4796-a227-57b9beb874bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:22.091316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:22.092659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:22.093505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:22.093505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:22.093505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:22.093505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:22.093505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:22.093505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:22.093505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:22.093505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:22.093505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 256/517] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:22.094003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b85f-fb09-4796-a227-57b9beb874bb None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:22.163202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:22.177987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2edc21-1131-4a70-b01c-fba1a7d50e9b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:22.195314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b85f-fb09-4796-a227-57b9beb874bb None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:22.213418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c8ff8-b5f7-4620-a53a-81a8459f9eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:22.213970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c8ff8-b5f7-4620-a53a-81a8459f9eb9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:22.214246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c8ff8-b5f7-4620-a53a-81a8459f9eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:22.214517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c8ff8-b5f7-4620-a53a-81a8459f9eb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:22.224456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c8ff8-b5f7-4620-a53a-81a8459f9eb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:22.225889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c8ff8-b5f7-4620-a53a-81a8459f9eb9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:22.228951 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89c07c-c8a2-4665-b746-8a1f763b24c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:22.229805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89c07c-c8a2-4665-b746-8a1f763b24c0 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:22.230083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89c07c-c8a2-4665-b746-8a1f763b24c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:22.230354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89c07c-c8a2-4665-b746-8a1f763b24c0 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:22.231034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89c07c-c8a2-4665-b746-8a1f763b24c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:22.231340 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89c07c-c8a2-4665-b746-8a1f763b24c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:22.232683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89c07c-c8a2-4665-b746-8a1f763b24c0 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:22.239620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-fa9c8ff8-b5f7-4620-a53a-81a8459f9eb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:22.240618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:22.241601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:22.242466 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:22.242466 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:22.242466 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:22.242466 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 262/518] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:22.242688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c8ff8-b5f7-4620-a53a-81a8459f9eb9 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:22.246641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 257/519] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:22.247333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89c07c-c8a2-4665-b746-8a1f763b24c0 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:22.345517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89c07c-c8a2-4665-b746-8a1f763b24c0 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:22.345702 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c8ff8-b5f7-4620-a53a-81a8459f9eb9 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:22.379111 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95463a54-4ac0-4f1e-9bc8-80fab6b9b44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:22.379275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb436509-cbfc-4c4a-83cd-e5a384f5b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:22.379730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95463a54-4ac0-4f1e-9bc8-80fab6b9b44c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:22.379867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb436509-cbfc-4c4a-83cd-e5a384f5b6bf None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:22.380010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95463a54-4ac0-4f1e-9bc8-80fab6b9b44c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:22.380148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb436509-cbfc-4c4a-83cd-e5a384f5b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:22.380282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95463a54-4ac0-4f1e-9bc8-80fab6b9b44c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:22.380425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb436509-cbfc-4c4a-83cd-e5a384f5b6bf None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:22.381150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb436509-cbfc-4c4a-83cd-e5a384f5b6bf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:22.381458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb436509-cbfc-4c4a-83cd-e5a384f5b6bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:22.382927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb436509-cbfc-4c4a-83cd-e5a384f5b6bf None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:22.387242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95463a54-4ac0-4f1e-9bc8-80fab6b9b44c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:22.388658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95463a54-4ac0-4f1e-9bc8-80fab6b9b44c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:22.391557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:22.400515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 263/520] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Aug 29 23:38:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-95463a54-4ac0-4f1e-9bc8-80fab6b9b44c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:22.401040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:22.408093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:22.408976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:22.408976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:22.408976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:22.408976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:22.408976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:22.408976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:22.408976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:22.408976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:22.408976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:38:22.408976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:22.409478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb436509-cbfc-4c4a-83cd-e5a384f5b6bf None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:22.409548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 258/521] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:22.409548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95463a54-4ac0-4f1e-9bc8-80fab6b9b44c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:22.464903 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:22.500861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb436509-cbfc-4c4a-83cd-e5a384f5b6bf None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:22.506931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95463a54-4ac0-4f1e-9bc8-80fab6b9b44c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:22.534471 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53f91a-5698-4586-8653-8ab9f37cd3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:22.535107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53f91a-5698-4586-8653-8ab9f37cd3d0 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:22.535390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53f91a-5698-4586-8653-8ab9f37cd3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:22.535659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53f91a-5698-4586-8653-8ab9f37cd3d0 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:22.536343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53f91a-5698-4586-8653-8ab9f37cd3d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:22.536651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53f91a-5698-4586-8653-8ab9f37cd3d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:22.538085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53f91a-5698-4586-8653-8ab9f37cd3d0 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:22.540689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71ca70-9a85-4563-9aa7-1668dc4e4861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:22.541286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ca70-9a85-4563-9aa7-1668dc4e4861 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:22.541564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ca70-9a85-4563-9aa7-1668dc4e4861 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:22.541840 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ca70-9a85-4563-9aa7-1668dc4e4861 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:22.542468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71ca70-9a85-4563-9aa7-1668dc4e4861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:22.542769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71ca70-9a85-4563-9aa7-1668dc4e4861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:22.544165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71ca70-9a85-4563-9aa7-1668dc4e4861 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:22.556272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 264/522] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:22.562265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 259/523] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:22.562401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53f91a-5698-4586-8653-8ab9f37cd3d0 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:22.562489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71ca70-9a85-4563-9aa7-1668dc4e4861 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:22.619070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:22.657090 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71ca70-9a85-4563-9aa7-1668dc4e4861 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:22.663678 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53f91a-5698-4586-8653-8ab9f37cd3d0 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:22.674372 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:22.690561 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad423ba-d94d-457a-8a60-381fa48dfecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:22.691203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad423ba-d94d-457a-8a60-381fa48dfecf None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:22.691482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad423ba-d94d-457a-8a60-381fa48dfecf None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:22.691755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad423ba-d94d-457a-8a60-381fa48dfecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:22.698852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0deb6-49d6-41b6-ae68-17d2b2ba31c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:22.699503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0deb6-49d6-41b6-ae68-17d2b2ba31c0 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:22.699793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0deb6-49d6-41b6-ae68-17d2b2ba31c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:22.700076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0deb6-49d6-41b6-ae68-17d2b2ba31c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:22.706715 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0deb6-49d6-41b6-ae68-17d2b2ba31c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:22.708189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0deb6-49d6-41b6-ae68-17d2b2ba31c0 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-21b0deb6-49d6-41b6-ae68-17d2b2ba31c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:22.720432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:22.721420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:22.722252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:22.722252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:22.722252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:22.722252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:22.722252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:22.722252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:22.722252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:22.722252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:22.722252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 265/524] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:22.722252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0deb6-49d6-41b6-ae68-17d2b2ba31c0 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:22.767969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad423ba-d94d-457a-8a60-381fa48dfecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:22.769415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad423ba-d94d-457a-8a60-381fa48dfecf None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:22.825672 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0deb6-49d6-41b6-ae68-17d2b2ba31c0 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:22.844037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:22.861901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07e24d-10d6-41c4-8c19-7c5894b0021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:22.862503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07e24d-10d6-41c4-8c19-7c5894b0021c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:22.862783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07e24d-10d6-41c4-8c19-7c5894b0021c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:22.863087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07e24d-10d6-41c4-8c19-7c5894b0021c None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:22.863818 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07e24d-10d6-41c4-8c19-7c5894b0021c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:22.864120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07e24d-10d6-41c4-8c19-7c5894b0021c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:22.865541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07e24d-10d6-41c4-8c19-7c5894b0021c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:22.867071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 260/525] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:22.867899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad423ba-d94d-457a-8a60-381fa48dfecf None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:22.882582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 266/526] 10.222.0.73 () {56 vars in 1139 bytes} [Mon Aug 29 23:38:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:22.883419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07e24d-10d6-41c4-8c19-7c5894b0021c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:22.891631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:22.971168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad423ba-d94d-457a-8a60-381fa48dfecf None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:22.983020 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07e24d-10d6-41c4-8c19-7c5894b0021c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:23.005177 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77cfb5-fcb3-483f-b5aa-860d3fa6f9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:23.005771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77cfb5-fcb3-483f-b5aa-860d3fa6f9fb None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:23.006046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77cfb5-fcb3-483f-b5aa-860d3fa6f9fb None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:23.006312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77cfb5-fcb3-483f-b5aa-860d3fa6f9fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:23.007063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77cfb5-fcb3-483f-b5aa-860d3fa6f9fb None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=59a1b0b274294a288dbf07cd99f95407) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:23.007371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77cfb5-fcb3-483f-b5aa-860d3fa6f9fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:23.008774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77cfb5-fcb3-483f-b5aa-860d3fa6f9fb None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:23.013994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 261/527] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:22 2022] GET /identity/v3/role_assignments?user.id=59a1b0b274294a288dbf07cd99f95407&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:23.014793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77cfb5-fcb3-483f-b5aa-860d3fa6f9fb None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:23.025320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b70425-d8a7-462f-8cec-395100c87668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:23.026067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70425-d8a7-462f-8cec-395100c87668 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:23.026341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70425-d8a7-462f-8cec-395100c87668 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:23.026611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70425-d8a7-462f-8cec-395100c87668 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:23.027308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b70425-d8a7-462f-8cec-395100c87668 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:23.028925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b70425-d8a7-462f-8cec-395100c87668 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:23.102692 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:23.120980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 267/528] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:38:22 2022] POST /identity/v3/users => generated 247 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:38:23.122017 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b70425-d8a7-462f-8cec-395100c87668 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:23.123033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77cfb5-fcb3-483f-b5aa-860d3fa6f9fb None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:23.166020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0b506-5eb1-496d-99bb-38704ddfee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:23.166801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0b506-5eb1-496d-99bb-38704ddfee5b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:23.167160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0b506-5eb1-496d-99bb-38704ddfee5b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:23.167798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0b506-5eb1-496d-99bb-38704ddfee5b None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:23.168501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0b506-5eb1-496d-99bb-38704ddfee5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:23.168811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0b506-5eb1-496d-99bb-38704ddfee5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:23.170316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0b506-5eb1-496d-99bb-38704ddfee5b None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:23.178358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:23.193256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 262/529] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:23.198914 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0b506-5eb1-496d-99bb-38704ddfee5b None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:23.299203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b70425-d8a7-462f-8cec-395100c87668 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:23.333222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0b506-5eb1-496d-99bb-38704ddfee5b None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:23.345695 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087f22-f350-48c2-b4ce-78ca49824b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:23.346338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087f22-f350-48c2-b4ce-78ca49824b01 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:23.346617 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087f22-f350-48c2-b4ce-78ca49824b01 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:23.346903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087f22-f350-48c2-b4ce-78ca49824b01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:23.358844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49087f22-f350-48c2-b4ce-78ca49824b01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:23.359872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49087f22-f350-48c2-b4ce-78ca49824b01 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-49087f22-f350-48c2-b4ce-78ca49824b01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:23.379405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:23.380380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:23.381885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:23.381885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:23.381885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:23.381885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 268/530] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:23.381885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087f22-f350-48c2-b4ce-78ca49824b01 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:23.383696 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941eaa4-ed67-4852-bf91-d5f8276a4599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:23.385207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941eaa4-ed67-4852-bf91-d5f8276a4599 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:23.386763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941eaa4-ed67-4852-bf91-d5f8276a4599 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:23.387275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941eaa4-ed67-4852-bf91-d5f8276a4599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:23.404315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:23.477827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941eaa4-ed67-4852-bf91-d5f8276a4599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:23.479573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941eaa4-ed67-4852-bf91-d5f8276a4599 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:23.485723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:23.505112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087f22-f350-48c2-b4ce-78ca49824b01 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:23.545797 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092feda-3828-4536-8958-98938888253f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:23.546984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092feda-3828-4536-8958-98938888253f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:23.547419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092feda-3828-4536-8958-98938888253f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:23.548004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092feda-3828-4536-8958-98938888253f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:23.548843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092feda-3828-4536-8958-98938888253f None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=7a10328a436c4159b6519e5493ba57f8) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:23.549320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092feda-3828-4536-8958-98938888253f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:23.551101 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092feda-3828-4536-8958-98938888253f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:23.562973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 269/531] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:23 2022] GET /identity/v3/role_assignments?user.id=7a10328a436c4159b6519e5493ba57f8&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:23.564075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092feda-3828-4536-8958-98938888253f None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:23.613755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 263/532] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:23.627459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941eaa4-ed67-4852-bf91-d5f8276a4599 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:23.692179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:23.737916 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092feda-3828-4536-8958-98938888253f None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:23.772960 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941eaa4-ed67-4852-bf91-d5f8276a4599 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:23.778673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f26ab-d2f3-4e3d-a8c2-2b36d5171e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:23.779558 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f26ab-d2f3-4e3d-a8c2-2b36d5171e7b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:23.780087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f26ab-d2f3-4e3d-a8c2-2b36d5171e7b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:23.780564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f26ab-d2f3-4e3d-a8c2-2b36d5171e7b None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:23.781420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f26ab-d2f3-4e3d-a8c2-2b36d5171e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:23.781947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f26ab-d2f3-4e3d-a8c2-2b36d5171e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:23.783571 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f26ab-d2f3-4e3d-a8c2-2b36d5171e7b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:23.796987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 270/533] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:23.808444 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f26ab-d2f3-4e3d-a8c2-2b36d5171e7b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:23.810729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a15285-868d-49c5-b004-4cfabc5636c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:23.812107 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a15285-868d-49c5-b004-4cfabc5636c7 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:23.812483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a15285-868d-49c5-b004-4cfabc5636c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:23.812850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a15285-868d-49c5-b004-4cfabc5636c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:23.825818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a15285-868d-49c5-b004-4cfabc5636c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:23.825818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a15285-868d-49c5-b004-4cfabc5636c7 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:23.827300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-f3a15285-868d-49c5-b004-4cfabc5636c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:23.842251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:23.851513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:23.853187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:23.853187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:23.853187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:23.853187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 264/534] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:23.853187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a15285-868d-49c5-b004-4cfabc5636c7 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:23.987731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:23.995218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a15285-868d-49c5-b004-4cfabc5636c7 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:24.031114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef90fa-cf02-494a-876b-3bf34534e687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:24.031786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef90fa-cf02-494a-876b-3bf34534e687 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:24.032091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef90fa-cf02-494a-876b-3bf34534e687 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:24.032341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef90fa-cf02-494a-876b-3bf34534e687 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:24.032982 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef90fa-cf02-494a-876b-3bf34534e687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:24.033282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef90fa-cf02-494a-876b-3bf34534e687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:24.035056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef90fa-cf02-494a-876b-3bf34534e687 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:24.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 265/535] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:24.053262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef90fa-cf02-494a-876b-3bf34534e687 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:24.062720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f26ab-d2f3-4e3d-a8c2-2b36d5171e7b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:24.146684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c2d6-6577-453c-a766-d3d2eb68dbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:24.147448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c2d6-6577-453c-a766-d3d2eb68dbdf None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:24.147723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c2d6-6577-453c-a766-d3d2eb68dbdf None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:24.147993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c2d6-6577-453c-a766-d3d2eb68dbdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:24.162468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef90fa-cf02-494a-876b-3bf34534e687 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:24.167964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25c2d6-6577-453c-a766-d3d2eb68dbdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:24.169445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25c2d6-6577-453c-a766-d3d2eb68dbdf None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-3d25c2d6-6577-453c-a766-d3d2eb68dbdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:24.192782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:24.193767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:24.195215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:24.195215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:24.195215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:24.195215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:24.195215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:24.195215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:24.195215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:24.195215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:24.195215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 271/536] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:24.203818 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c2d6-6577-453c-a766-d3d2eb68dbdf None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:24.209796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1adb4-c13c-4989-ab2b-3e2488bd9032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:24.210430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1adb4-c13c-4989-ab2b-3e2488bd9032 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:24.210708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1adb4-c13c-4989-ab2b-3e2488bd9032 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:24.211005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1adb4-c13c-4989-ab2b-3e2488bd9032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:24.227185 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1adb4-c13c-4989-ab2b-3e2488bd9032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:24.228740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1adb4-c13c-4989-ab2b-3e2488bd9032 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-56e1adb4-c13c-4989-ab2b-3e2488bd9032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:24.251689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:24.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:24.253878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:24.253878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:24.253878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:24.253878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:24.253878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:24.253878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:24.253878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:24.253878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:24.253878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 266/537] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:24.261363 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1adb4-c13c-4989-ab2b-3e2488bd9032 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:24.299284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:24.340994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:24.420860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c2d6-6577-453c-a766-d3d2eb68dbdf None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:24.429871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1adb4-c13c-4989-ab2b-3e2488bd9032 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:24.474794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5ac01-daa1-45f5-9476-1e264410ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:24.475474 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5ac01-daa1-45f5-9476-1e264410ef50 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:24.475767 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5ac01-daa1-45f5-9476-1e264410ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:24.476043 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5ac01-daa1-45f5-9476-1e264410ef50 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:24.476744 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5ac01-daa1-45f5-9476-1e264410ef50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:24.477057 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5ac01-daa1-45f5-9476-1e264410ef50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:24.481652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5ac01-daa1-45f5-9476-1e264410ef50 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:24.494369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 267/538] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:24.502923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5ac01-daa1-45f5-9476-1e264410ef50 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:24.515584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0e16e-ba41-4e66-9e97-2d68782a3f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:24.516208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0e16e-ba41-4e66-9e97-2d68782a3f4e None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:24.516497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0e16e-ba41-4e66-9e97-2d68782a3f4e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:24.516766 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0e16e-ba41-4e66-9e97-2d68782a3f4e None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:24.517466 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0e16e-ba41-4e66-9e97-2d68782a3f4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:24.517774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0e16e-ba41-4e66-9e97-2d68782a3f4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:24.519254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0e16e-ba41-4e66-9e97-2d68782a3f4e None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:24.549359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 272/539] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:24.555256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0e16e-ba41-4e66-9e97-2d68782a3f4e None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:24.595783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:24.614589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5ac01-daa1-45f5-9476-1e264410ef50 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:24.650570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f620345-6f45-45c8-a445-88b7fa8e7bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:24.651410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620345-6f45-45c8-a445-88b7fa8e7bc3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:24.651697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620345-6f45-45c8-a445-88b7fa8e7bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:24.652024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620345-6f45-45c8-a445-88b7fa8e7bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:24.652822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f620345-6f45-45c8-a445-88b7fa8e7bc3 None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=707518bbe380425aa793f005548bc9d5) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:24.653405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f620345-6f45-45c8-a445-88b7fa8e7bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:24.654888 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f620345-6f45-45c8-a445-88b7fa8e7bc3 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:24.661710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 268/540] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:24 2022] GET /identity/v3/role_assignments?user.id=707518bbe380425aa793f005548bc9d5&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:24.784449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0e16e-ba41-4e66-9e97-2d68782a3f4e None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:24.828917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:24.838235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1efe4-9b8b-4c75-aa2c-48a816585220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:24.838855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1efe4-9b8b-4c75-aa2c-48a816585220 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:24.845317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1efe4-9b8b-4c75-aa2c-48a816585220 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:24.845317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1efe4-9b8b-4c75-aa2c-48a816585220 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:24.845317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1efe4-9b8b-4c75-aa2c-48a816585220 None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=ea872bd7ac2f4640a97648ccf96c02da) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:24.845317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1efe4-9b8b-4c75-aa2c-48a816585220 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:24.845317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1efe4-9b8b-4c75-aa2c-48a816585220 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:24.852008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 273/541] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:24 2022] GET /identity/v3/role_assignments?user.id=ea872bd7ac2f4640a97648ccf96c02da&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:25.136892 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7c2a-e4dd-44d1-89b9-bb81b734d0f5 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:25.136892 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7c2a-e4dd-44d1-89b9-bb81b734d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:25.136892 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7c2a-e4dd-44d1-89b9-bb81b734d0f5 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:25.138598 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 269/542] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:25.143629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78a78-3119-4dfc-9c3e-07e91617a427 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:25.144047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78a78-3119-4dfc-9c3e-07e91617a427 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:25.144221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78a78-3119-4dfc-9c3e-07e91617a427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:25.168389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e5c78a78-3119-4dfc-9c3e-07e91617a427 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:25.169578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e5c78a78-3119-4dfc-9c3e-07e91617a427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:25.263510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 274/543] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:38:25.371058 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebbe1a-cc6b-4917-9b0d-994a5f104b94 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:25.371378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebbe1a-cc6b-4917-9b0d-994a5f104b94 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:25.371616 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebbe1a-cc6b-4917-9b0d-994a5f104b94 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:25.372968 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 270/544] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:25.388047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8845f-ba50-4226-b46b-9b89052a16c4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:25.388292 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8845f-ba50-4226-b46b-9b89052a16c4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:25.388526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8845f-ba50-4226-b46b-9b89052a16c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:25.413719 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-7da8845f-ba50-4226-b46b-9b89052a16c4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:25.414951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7da8845f-ba50-4226-b46b-9b89052a16c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:25.497070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 275/545] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:25.602397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebbe1a-cc6b-4917-9b0d-994a5f104b94 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:25.745313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebbe1a-cc6b-4917-9b0d-994a5f104b94 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:25.799038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e594ca4-3811-40dc-9017-6580dbf0f74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:25.800056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e594ca4-3811-40dc-9017-6580dbf0f74f None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:25.800542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e594ca4-3811-40dc-9017-6580dbf0f74f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:25.801007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e594ca4-3811-40dc-9017-6580dbf0f74f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:25.812487 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:25.816621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e594ca4-3811-40dc-9017-6580dbf0f74f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-3e594ca4-3811-40dc-9017-6580dbf0f74f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:25.821736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:25.829341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:25.830141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 271/546] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:25.830779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8845f-ba50-4226-b46b-9b89052a16c4 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:25.854617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7010574-b2a8-4322-b7d2-c8ebc73f9c7b None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:25.855300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7010574-b2a8-4322-b7d2-c8ebc73f9c7b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:25.855800 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7010574-b2a8-4322-b7d2-c8ebc73f9c7b None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:25.859807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 272/547] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:38:25.864094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e447a-0137-47f7-9c54-7310ece4e631 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:25.864625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e447a-0137-47f7-9c54-7310ece4e631 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:25.865096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e447a-0137-47f7-9c54-7310ece4e631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:25.890655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-438e447a-0137-47f7-9c54-7310ece4e631 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:25.891918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-438e447a-0137-47f7-9c54-7310ece4e631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:25.909685 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:25.962037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8845f-ba50-4226-b46b-9b89052a16c4 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:25.965447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 273/548] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:38:25.965714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e447a-0137-47f7-9c54-7310ece4e631 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:26.001416 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588373e-0ca8-4e53-a8c0-c3db2a6c61b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:26.002409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588373e-0ca8-4e53-a8c0-c3db2a6c61b2 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:26.003084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588373e-0ca8-4e53-a8c0-c3db2a6c61b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:26.003563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588373e-0ca8-4e53-a8c0-c3db2a6c61b2 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:26.005232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588373e-0ca8-4e53-a8c0-c3db2a6c61b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:26.005754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588373e-0ca8-4e53-a8c0-c3db2a6c61b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:26.007406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588373e-0ca8-4e53-a8c0-c3db2a6c61b2 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:26.018742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 276/549] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:26.023773 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588373e-0ca8-4e53-a8c0-c3db2a6c61b2 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:26.073314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e447a-0137-47f7-9c54-7310ece4e631 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:26.104025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:26.112653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fef46-f3ba-40c8-9e96-13d07af2c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:26.113399 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fef46-f3ba-40c8-9e96-13d07af2c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:26.113759 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fef46-f3ba-40c8-9e96-13d07af2c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:26.114014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fef46-f3ba-40c8-9e96-13d07af2c1d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:26.124419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fef46-f3ba-40c8-9e96-13d07af2c1d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-4f1fef46-f3ba-40c8-9e96-13d07af2c1d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:26.133563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:26.134480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:26.135833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:26.135833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:26.135833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:26.135833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:26.135833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:26.135833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:26.135833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:26.135833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:26.135833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:26.135833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:26.135833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:26.135833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:26.139799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 274/550] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:26.143805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fef46-f3ba-40c8-9e96-13d07af2c1d8 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:26.163343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588373e-0ca8-4e53-a8c0-c3db2a6c61b2 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:26.178512 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:26.202791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b42cfa-da35-417c-a037-fdc15c9cf2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:26.203750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b42cfa-da35-417c-a037-fdc15c9cf2da None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:26.204249 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b42cfa-da35-417c-a037-fdc15c9cf2da None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:26.204712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b42cfa-da35-417c-a037-fdc15c9cf2da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:26.218232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b42cfa-da35-417c-a037-fdc15c9cf2da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:26.220206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b42cfa-da35-417c-a037-fdc15c9cf2da None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-e0b42cfa-da35-417c-a037-fdc15c9cf2da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:26.237737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:26.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:26.239599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:26.239599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:26.239599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:26.240423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 277/551] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:26.245772 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b42cfa-da35-417c-a037-fdc15c9cf2da None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:26.334801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fef46-f3ba-40c8-9e96-13d07af2c1d8 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:26.355912 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b42cfa-da35-417c-a037-fdc15c9cf2da None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:26.370168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b61548-d7b3-46a0-911c-325767de669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:26.370775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b61548-d7b3-46a0-911c-325767de669d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:26.371100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b61548-d7b3-46a0-911c-325767de669d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:26.371371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b61548-d7b3-46a0-911c-325767de669d None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:26.372030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b61548-d7b3-46a0-911c-325767de669d None admin] RBAC: Adding query filter params (name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:26.372330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b61548-d7b3-46a0-911c-325767de669d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:26.373735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b61548-d7b3-46a0-911c-325767de669d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:26.382231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 275/552] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:26.387389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b61548-d7b3-46a0-911c-325767de669d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:26.395505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c9672-60e2-43e8-889a-39b5cee9222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:26.396390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c9672-60e2-43e8-889a-39b5cee9222a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:26.396959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c9672-60e2-43e8-889a-39b5cee9222a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:26.397423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c9672-60e2-43e8-889a-39b5cee9222a None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:26.398255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c9672-60e2-43e8-889a-39b5cee9222a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:26.398766 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c9672-60e2-43e8-889a-39b5cee9222a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:26.400581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c9672-60e2-43e8-889a-39b5cee9222a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:26.415179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 278/553] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:26.416511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c9672-60e2-43e8-889a-39b5cee9222a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:26.440098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:26.447383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:26.494356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b61548-d7b3-46a0-911c-325767de669d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:26.529997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c9672-60e2-43e8-889a-39b5cee9222a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:26.530203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b05379-6540-491f-b1ee-6f0a31f73e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:26.530771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b05379-6540-491f-b1ee-6f0a31f73e9d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:26.531103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b05379-6540-491f-b1ee-6f0a31f73e9d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:26.531374 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b05379-6540-491f-b1ee-6f0a31f73e9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:26.544436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b05379-6540-491f-b1ee-6f0a31f73e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-38b05379-6540-491f-b1ee-6f0a31f73e9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:26.549915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:26.550819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:26.551645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 276/554] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:26.552388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b05379-6540-491f-b1ee-6f0a31f73e9d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:26.574930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0b616-c6ec-4064-bf2d-58b369134ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:26.575988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0b616-c6ec-4064-bf2d-58b369134ec9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:26.577129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0b616-c6ec-4064-bf2d-58b369134ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:26.577594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0b616-c6ec-4064-bf2d-58b369134ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:26.589291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0b616-c6ec-4064-bf2d-58b369134ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:26.591038 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0b616-c6ec-4064-bf2d-58b369134ec9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-0eb0b616-c6ec-4064-bf2d-58b369134ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:26.608160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:26.609110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:26.609958 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:26.609958 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:26.609958 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:26.611931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 279/555] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:26.613015 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0b616-c6ec-4064-bf2d-58b369134ec9 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:26.660176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b05379-6540-491f-b1ee-6f0a31f73e9d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:26.672049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:26.697232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5502a4-c4c7-4e80-87ba-b5247d26c25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:26.697858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5502a4-c4c7-4e80-87ba-b5247d26c25a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:26.698136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5502a4-c4c7-4e80-87ba-b5247d26c25a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:26.698472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5502a4-c4c7-4e80-87ba-b5247d26c25a None admin] PATH_INFO: `/v3/users/nova` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:26.700067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:26.707857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5502a4-c4c7-4e80-87ba-b5247d26c25a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:26.709178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5502a4-c4c7-4e80-87ba-b5247d26c25a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-fb5502a4-c4c7-4e80-87ba-b5247d26c25a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:26.721013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:26.721923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:26.723304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:26.723304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:26.723304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:26.723304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:26.723304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:26.723304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:26.723304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:26.723304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:26.723304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:38:26.723304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:26.723304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 277/556] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Aug 29 23:38:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:26.723304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5502a4-c4c7-4e80-87ba-b5247d26c25a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:26.731867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0b616-c6ec-4064-bf2d-58b369134ec9 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:26.770587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d616ae-dcb7-455c-a7ae-f4c9f6c4ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:26.771495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d616ae-dcb7-455c-a7ae-f4c9f6c4ed7c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:26.771949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d616ae-dcb7-455c-a7ae-f4c9f6c4ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:26.772418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d616ae-dcb7-455c-a7ae-f4c9f6c4ed7c None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:26.773264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d616ae-dcb7-455c-a7ae-f4c9f6c4ed7c None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:26.773737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d616ae-dcb7-455c-a7ae-f4c9f6c4ed7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:26.775430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d616ae-dcb7-455c-a7ae-f4c9f6c4ed7c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:26.784974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 280/557] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:26.786180 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d616ae-dcb7-455c-a7ae-f4c9f6c4ed7c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:26.840601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5502a4-c4c7-4e80-87ba-b5247d26c25a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:26.877712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a885a-2ca8-4aa3-b407-afc9ff8de807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:26.878319 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a885a-2ca8-4aa3-b407-afc9ff8de807 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:26.878597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a885a-2ca8-4aa3-b407-afc9ff8de807 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:26.878864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a885a-2ca8-4aa3-b407-afc9ff8de807 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:26.879597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a885a-2ca8-4aa3-b407-afc9ff8de807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:26.879827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a885a-2ca8-4aa3-b407-afc9ff8de807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:26.881192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a885a-2ca8-4aa3-b407-afc9ff8de807 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:26.898015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 278/558] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:26.898978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a885a-2ca8-4aa3-b407-afc9ff8de807 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:26.899760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d616ae-dcb7-455c-a7ae-f4c9f6c4ed7c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:26.930451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:26.938478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87105-9fad-43ad-a5e9-24a95e51a7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:26.939118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87105-9fad-43ad-a5e9-24a95e51a7c1 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:26.939407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87105-9fad-43ad-a5e9-24a95e51a7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:26.939723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87105-9fad-43ad-a5e9-24a95e51a7c1 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:26.940449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d87105-9fad-43ad-a5e9-24a95e51a7c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:26.940752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d87105-9fad-43ad-a5e9-24a95e51a7c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:26.942187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d87105-9fad-43ad-a5e9-24a95e51a7c1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:26.951966 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:26.963033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 281/559] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Aug 29 23:38:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:26.963190 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87105-9fad-43ad-a5e9-24a95e51a7c1 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:27.008848 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a885a-2ca8-4aa3-b407-afc9ff8de807 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:27.043805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cbcc1-0e74-4f34-b2f3-2a9c98687292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:27.044464 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cbcc1-0e74-4f34-b2f3-2a9c98687292 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.044747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cbcc1-0e74-4f34-b2f3-2a9c98687292 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.045552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cbcc1-0e74-4f34-b2f3-2a9c98687292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.056414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cbcc1-0e74-4f34-b2f3-2a9c98687292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:27.057863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cbcc1-0e74-4f34-b2f3-2a9c98687292 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-070cbcc1-0e74-4f34-b2f3-2a9c98687292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:27.074051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:27.075281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:27.076377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:27.076377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:27.076377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:27.079723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 279/560] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:27.080113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87105-9fad-43ad-a5e9-24a95e51a7c1 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:27.080964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e772d-8d31-462b-8efe-ab19f94b431c None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.081251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e772d-8d31-462b-8efe-ab19f94b431c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.081523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e772d-8d31-462b-8efe-ab19f94b431c None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.082793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 280/561] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:27.087485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e772d-8d31-462b-8efe-ab19f94b431c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:27.118762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913d524-f0a7-4899-b530-35c74de88345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:27.119376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913d524-f0a7-4899-b530-35c74de88345 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.119664 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913d524-f0a7-4899-b530-35c74de88345 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.119934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913d524-f0a7-4899-b530-35c74de88345 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.127861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913d524-f0a7-4899-b530-35c74de88345 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:27.135697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913d524-f0a7-4899-b530-35c74de88345 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-e913d524-f0a7-4899-b530-35c74de88345 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:27.142377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:27.143545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:27.144501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:27.144501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:27.144501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:27.144501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:27.144501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:27.144501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:27.144501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:27.144501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:27.144501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:38:27.144501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:27.144501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 282/562] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:27.144501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913d524-f0a7-4899-b530-35c74de88345 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:27.183732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:27.205515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e772d-8d31-462b-8efe-ab19f94b431c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:27.208112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:27.245173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a6850-99b0-463c-a529-0402d9dfad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:27.245935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a6850-99b0-463c-a529-0402d9dfad32 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.246355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a6850-99b0-463c-a529-0402d9dfad32 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.246756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a6850-99b0-463c-a529-0402d9dfad32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.257937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a6850-99b0-463c-a529-0402d9dfad32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:27.259057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913d524-f0a7-4899-b530-35c74de88345 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:27.259654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a6850-99b0-463c-a529-0402d9dfad32 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-de4a6850-99b0-463c-a529-0402d9dfad32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:27.276642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:27.277766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:27.278657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:27.278657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:27.278657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:27.278657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 281/563] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:27.279259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195518e-1680-4040-bc36-4502657bbfe7 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.280067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195518e-1680-4040-bc36-4502657bbfe7 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.280341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195518e-1680-4040-bc36-4502657bbfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.299393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d195518e-1680-4040-bc36-4502657bbfe7 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:27.300631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d195518e-1680-4040-bc36-4502657bbfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:27.301023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c682a10-9581-474e-bd47-fd0a386a189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:27.301662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c682a10-9581-474e-bd47-fd0a386a189e None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.301940 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c682a10-9581-474e-bd47-fd0a386a189e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.302210 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c682a10-9581-474e-bd47-fd0a386a189e None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.302855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c682a10-9581-474e-bd47-fd0a386a189e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:27.303206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c682a10-9581-474e-bd47-fd0a386a189e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:27.304568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c682a10-9581-474e-bd47-fd0a386a189e None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:27.321935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 283/564] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:27.321935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c682a10-9581-474e-bd47-fd0a386a189e None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:27.376778 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 282/565] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:27.377781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195518e-1680-4040-bc36-4502657bbfe7 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:27.428081 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c682a10-9581-474e-bd47-fd0a386a189e None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:27.446243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:27.457007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:27.464270 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9308f-25a8-4ca2-aba4-07422c8db736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:27.465020 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9308f-25a8-4ca2-aba4-07422c8db736 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.466052 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9308f-25a8-4ca2-aba4-07422c8db736 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.466331 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9308f-25a8-4ca2-aba4-07422c8db736 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.467597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9308f-25a8-4ca2-aba4-07422c8db736 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:27.467908 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9308f-25a8-4ca2-aba4-07422c8db736 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:27.469378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9308f-25a8-4ca2-aba4-07422c8db736 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:27.489542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 284/566] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Aug 29 23:38:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:27.490348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9308f-25a8-4ca2-aba4-07422c8db736 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:27.502118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195518e-1680-4040-bc36-4502657bbfe7 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:27.540477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee2dcf-7abd-46c5-99c9-28e3909c4fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:27.541077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee2dcf-7abd-46c5-99c9-28e3909c4fdc None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.541355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee2dcf-7abd-46c5-99c9-28e3909c4fdc None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.541624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee2dcf-7abd-46c5-99c9-28e3909c4fdc None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.542255 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee2dcf-7abd-46c5-99c9-28e3909c4fdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:27.542553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee2dcf-7abd-46c5-99c9-28e3909c4fdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:27.543941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee2dcf-7abd-46c5-99c9-28e3909c4fdc None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:27.556338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 283/567] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:27.557608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77398a3-dcf0-4598-be53-b03d4c55870b None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.557899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77398a3-dcf0-4598-be53-b03d4c55870b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.558171 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77398a3-dcf0-4598-be53-b03d4c55870b None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.559582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 284/568] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:27.564474 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77398a3-dcf0-4598-be53-b03d4c55870b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:27.603009 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9308f-25a8-4ca2-aba4-07422c8db736 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:27.638710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c9468-fb04-49f3-a42b-44762828962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:27.639889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c9468-fb04-49f3-a42b-44762828962f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.640071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c9468-fb04-49f3-a42b-44762828962f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.640343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c9468-fb04-49f3-a42b-44762828962f None admin] PATH_INFO: `/v3/users/glance` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.647409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c9468-fb04-49f3-a42b-44762828962f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:27.648935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c9468-fb04-49f3-a42b-44762828962f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-655c9468-fb04-49f3-a42b-44762828962f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:27.662449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:27.663640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:27.664612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:27.664612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:27.664612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:27.664612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:27.664612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:27.664612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:27.664612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:27.664612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:27.664612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:38:27.664612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:27.664612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 285/569] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:27.665202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c9468-fb04-49f3-a42b-44762828962f None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:27.677381 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77398a3-dcf0-4598-be53-b03d4c55870b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:27.698563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:27.701187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:27.711874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3974d60-1732-4490-a15f-dde53b50b70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:27.712472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3974d60-1732-4490-a15f-dde53b50b70b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.713462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3974d60-1732-4490-a15f-dde53b50b70b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.713462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3974d60-1732-4490-a15f-dde53b50b70b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.764727 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c9468-fb04-49f3-a42b-44762828962f None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:27.781852 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3974d60-1732-4490-a15f-dde53b50b70b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:27.783346 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3974d60-1732-4490-a15f-dde53b50b70b None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:27.798004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6208a-21bc-44f8-8fe7-ee480b02cbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:27.798634 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6208a-21bc-44f8-8fe7-ee480b02cbb4 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.798957 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6208a-21bc-44f8-8fe7-ee480b02cbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.799232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6208a-21bc-44f8-8fe7-ee480b02cbb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.805789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6208a-21bc-44f8-8fe7-ee480b02cbb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:27.807239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6208a-21bc-44f8-8fe7-ee480b02cbb4 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-35d6208a-21bc-44f8-8fe7-ee480b02cbb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:27.818526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:27.819583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:27.820711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:27.820711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:27.820711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:27.820711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:27.820711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:27.820711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:27.820711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:27.820711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:27.820711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 286/570] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:27.821299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8065f-78eb-4a34-8018-3ca7d4cfe22f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:27.821387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8065f-78eb-4a34-8018-3ca7d4cfe22f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:27.821610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8065f-78eb-4a34-8018-3ca7d4cfe22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:27.839478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-fbb8065f-78eb-4a34-8018-3ca7d4cfe22f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:27.840676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-fbb8065f-78eb-4a34-8018-3ca7d4cfe22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:27.881484 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 285/571] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:27.882315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3974d60-1732-4490-a15f-dde53b50b70b None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:27.908636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:27.916854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 287/572] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:27.917693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8065f-78eb-4a34-8018-3ca7d4cfe22f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:27.943475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:27.986093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3974d60-1732-4490-a15f-dde53b50b70b None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:28.023479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8251f-14b6-4f7e-8500-5452abde7fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:28.023851 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8065f-78eb-4a34-8018-3ca7d4cfe22f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:28.024102 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8251f-14b6-4f7e-8500-5452abde7fbb None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:28.024379 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8251f-14b6-4f7e-8500-5452abde7fbb None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:28.024647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8251f-14b6-4f7e-8500-5452abde7fbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:28.036746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8251f-14b6-4f7e-8500-5452abde7fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-a9a8251f-14b6-4f7e-8500-5452abde7fbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:28.041481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:28.042419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 286/573] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:28.047865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8251f-14b6-4f7e-8500-5452abde7fbb None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:28.064212 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5a584-c55d-41a2-8971-83cc55d9c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:28.064902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5a584-c55d-41a2-8971-83cc55d9c127 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:28.065255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5a584-c55d-41a2-8971-83cc55d9c127 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:28.065524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5a584-c55d-41a2-8971-83cc55d9c127 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:28.066249 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5a584-c55d-41a2-8971-83cc55d9c127 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:28.066557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5a584-c55d-41a2-8971-83cc55d9c127 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:28.068007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5a584-c55d-41a2-8971-83cc55d9c127 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:28.086374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 288/574] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Aug 29 23:38:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:28.087471 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5a584-c55d-41a2-8971-83cc55d9c127 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:28.139605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:28.156967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8251f-14b6-4f7e-8500-5452abde7fbb None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:28.172579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:28.193063 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5a584-c55d-41a2-8971-83cc55d9c127 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:28.196186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2df4db-13c7-4ddd-a1fa-411c150e66e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:28.196788 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2df4db-13c7-4ddd-a1fa-411c150e66e4 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:28.197064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2df4db-13c7-4ddd-a1fa-411c150e66e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:28.197334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2df4db-13c7-4ddd-a1fa-411c150e66e4 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:28.198014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2df4db-13c7-4ddd-a1fa-411c150e66e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:28.198314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2df4db-13c7-4ddd-a1fa-411c150e66e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:28.199766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2df4db-13c7-4ddd-a1fa-411c150e66e4 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:28.211813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 287/575] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:28.212620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2df4db-13c7-4ddd-a1fa-411c150e66e4 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:28.227094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50527bae-14a5-4849-965f-691441dce414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:28.227725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50527bae-14a5-4849-965f-691441dce414 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:28.228006 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50527bae-14a5-4849-965f-691441dce414 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:28.228275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50527bae-14a5-4849-965f-691441dce414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:28.239856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50527bae-14a5-4849-965f-691441dce414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:28.241289 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50527bae-14a5-4849-965f-691441dce414 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-50527bae-14a5-4849-965f-691441dce414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:28.256701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:28.257659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:28.258557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:28.258557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:28.258557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:28.258557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 289/576] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:28.258557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50527bae-14a5-4849-965f-691441dce414 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:28.320079 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2df4db-13c7-4ddd-a1fa-411c150e66e4 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:28.352582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bd85a-95f9-4fd9-8981-e35593d53655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:28.353397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bd85a-95f9-4fd9-8981-e35593d53655 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:28.353679 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bd85a-95f9-4fd9-8981-e35593d53655 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:28.353949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bd85a-95f9-4fd9-8981-e35593d53655 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:28.354871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bd85a-95f9-4fd9-8981-e35593d53655 None admin] RBAC: Adding query filter params (name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:28.355198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bd85a-95f9-4fd9-8981-e35593d53655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:28.356354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50527bae-14a5-4849-965f-691441dce414 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:28.356574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bd85a-95f9-4fd9-8981-e35593d53655 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:28.364814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 288/577] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:28.365590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bd85a-95f9-4fd9-8981-e35593d53655 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:28.374576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:28.395301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd868239-7ba2-41e8-ae0a-4dd6df84e0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:28.395932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd868239-7ba2-41e8-ae0a-4dd6df84e0ef None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:28.396213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd868239-7ba2-41e8-ae0a-4dd6df84e0ef None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:28.396486 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd868239-7ba2-41e8-ae0a-4dd6df84e0ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:28.398340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:28.407516 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd868239-7ba2-41e8-ae0a-4dd6df84e0ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:28.408952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd868239-7ba2-41e8-ae0a-4dd6df84e0ef None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-dd868239-7ba2-41e8-ae0a-4dd6df84e0ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:28.424143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:28.425223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:28.426478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:28.426478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:28.426478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:28.426478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 290/578] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:28.426478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd868239-7ba2-41e8-ae0a-4dd6df84e0ef None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:28.466306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bd85a-95f9-4fd9-8981-e35593d53655 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:28.500153 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b15d-b5dc-4c28-95d1-67b7cbf6ae6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:28.500774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b15d-b5dc-4c28-95d1-67b7cbf6ae6f None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:28.501049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b15d-b5dc-4c28-95d1-67b7cbf6ae6f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:28.501315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b15d-b5dc-4c28-95d1-67b7cbf6ae6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:28.511097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5b15d-b5dc-4c28-95d1-67b7cbf6ae6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-a5a5b15d-b5dc-4c28-95d1-67b7cbf6ae6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:28.516224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:28.517291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:28.518139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 289/579] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:28.518924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b15d-b5dc-4c28-95d1-67b7cbf6ae6f None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:28.529013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd868239-7ba2-41e8-ae0a-4dd6df84e0ef None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:28.562852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad8986-95dc-4562-9c14-1c2bf009e9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:28.563540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8986-95dc-4562-9c14-1c2bf009e9f3 None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:28.563820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8986-95dc-4562-9c14-1c2bf009e9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:28.564099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8986-95dc-4562-9c14-1c2bf009e9f3 None admin] PATH_INFO: `/v3/projects/da13e1cbae664d5a92198052526ee459/users/59a1b0b274294a288dbf07cd99f95407/roles/ec4f9fa2b3e6483f97993b78c43ea7a4` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:28.578317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad8986-95dc-4562-9c14-1c2bf009e9f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=da13e1cbae664d5a92198052526ee459, user_id=59a1b0b274294a288dbf07cd99f95407, role_id=ec4f9fa2b3e6483f97993b78c43ea7a4)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:28.579793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad8986-95dc-4562-9c14-1c2bf009e9f3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:28.584497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:28.618530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b15d-b5dc-4c28-95d1-67b7cbf6ae6f None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:28.650823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e062f3d-a326-4320-8491-1f305404e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:28.651451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e062f3d-a326-4320-8491-1f305404e103 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:28.651739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e062f3d-a326-4320-8491-1f305404e103 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:28.652037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e062f3d-a326-4320-8491-1f305404e103 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:28.652678 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e062f3d-a326-4320-8491-1f305404e103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:28.652991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e062f3d-a326-4320-8491-1f305404e103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:28.654372 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e062f3d-a326-4320-8491-1f305404e103 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:28.663660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 291/580] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:38:28 2022] PUT /identity/v3/projects/da13e1cbae664d5a92198052526ee459/users/59a1b0b274294a288dbf07cd99f95407/roles/ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:28.664683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad8986-95dc-4562-9c14-1c2bf009e9f3 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:28.671105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 290/581] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:28.671105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e062f3d-a326-4320-8491-1f305404e103 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:28.724508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:28.791517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e062f3d-a326-4320-8491-1f305404e103 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:28.817213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad8986-95dc-4562-9c14-1c2bf009e9f3 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:28.823123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:28.832522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d9038-f1bb-42b7-ab97-8f2f8aaf9a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:28.833408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d9038-f1bb-42b7-ab97-8f2f8aaf9a68 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:28.833689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d9038-f1bb-42b7-ab97-8f2f8aaf9a68 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:28.833961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d9038-f1bb-42b7-ab97-8f2f8aaf9a68 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:28.834817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d9038-f1bb-42b7-ab97-8f2f8aaf9a68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:28.835516 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d9038-f1bb-42b7-ab97-8f2f8aaf9a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:28.836905 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d9038-f1bb-42b7-ab97-8f2f8aaf9a68 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:28.852776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39729c-ddba-4083-ba63-c1e421c69cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:28.852958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 291/582] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:28.855030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39729c-ddba-4083-ba63-c1e421c69cc7 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:28.855030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39729c-ddba-4083-ba63-c1e421c69cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:28.855255 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d9038-f1bb-42b7-ab97-8f2f8aaf9a68 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:28.855369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39729c-ddba-4083-ba63-c1e421c69cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:28.868734 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39729c-ddba-4083-ba63-c1e421c69cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:28.870187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39729c-ddba-4083-ba63-c1e421c69cc7 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-dc39729c-ddba-4083-ba63-c1e421c69cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:28.885425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:28.886407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:28.887339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:28.887339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:28.887339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:28.887339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 292/583] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:28.887339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39729c-ddba-4083-ba63-c1e421c69cc7 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:28.963389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d9038-f1bb-42b7-ab97-8f2f8aaf9a68 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:28.986450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:28.999241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d680d2-0fc5-44af-94d9-d9dd66521405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:29.001030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39729c-ddba-4083-ba63-c1e421c69cc7 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:29.001147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d680d2-0fc5-44af-94d9-d9dd66521405 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:29.001147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d680d2-0fc5-44af-94d9-d9dd66521405 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:29.001147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d680d2-0fc5-44af-94d9-d9dd66521405 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:29.001147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d680d2-0fc5-44af-94d9-d9dd66521405 None admin] RBAC: Adding query filter params (name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:29.001453 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d680d2-0fc5-44af-94d9-d9dd66521405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:29.002640 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d680d2-0fc5-44af-94d9-d9dd66521405 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:29.011252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 292/584] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:29.012065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d680d2-0fc5-44af-94d9-d9dd66521405 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:29.040383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492792f5-22e5-40c0-951f-06cf930b68f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:29.041016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492792f5-22e5-40c0-951f-06cf930b68f3 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:29.041294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492792f5-22e5-40c0-951f-06cf930b68f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:29.041569 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492792f5-22e5-40c0-951f-06cf930b68f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:29.048950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492792f5-22e5-40c0-951f-06cf930b68f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:29.050523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492792f5-22e5-40c0-951f-06cf930b68f3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-492792f5-22e5-40c0-951f-06cf930b68f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:29.061983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:29.063049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:29.063955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:29.063955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:29.063955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:29.063955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:29.063955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:29.063955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:29.063955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:29.063955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:29.065847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:29.067904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 293/585] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:29.068533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492792f5-22e5-40c0-951f-06cf930b68f3 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:29.122515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d680d2-0fc5-44af-94d9-d9dd66521405 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:29.160373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824327-cd1a-437c-9f06-2b0fa3d28865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:29.160991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824327-cd1a-437c-9f06-2b0fa3d28865 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:29.161266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824327-cd1a-437c-9f06-2b0fa3d28865 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:29.161535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824327-cd1a-437c-9f06-2b0fa3d28865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:29.168255 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51824327-cd1a-437c-9f06-2b0fa3d28865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:29.169840 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51824327-cd1a-437c-9f06-2b0fa3d28865 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:29.179267 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492792f5-22e5-40c0-951f-06cf930b68f3 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-51824327-cd1a-437c-9f06-2b0fa3d28865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:29.180893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:29.181781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:29.182651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:29.182651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:29.182651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:29.182651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:29.182651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:29.182651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:29.182651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:29.182651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:29.182651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 293/586] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:29.183705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824327-cd1a-437c-9f06-2b0fa3d28865 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:29.220528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee1c07-6f16-41bd-8a26-de36e4cdd519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:29.221129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee1c07-6f16-41bd-8a26-de36e4cdd519 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:29.222052 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee1c07-6f16-41bd-8a26-de36e4cdd519 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:29.222052 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee1c07-6f16-41bd-8a26-de36e4cdd519 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:29.222294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee1c07-6f16-41bd-8a26-de36e4cdd519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:29.222574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee1c07-6f16-41bd-8a26-de36e4cdd519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:29.223962 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee1c07-6f16-41bd-8a26-de36e4cdd519 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:29.241022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 294/587] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:29.241022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee1c07-6f16-41bd-8a26-de36e4cdd519 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:29.252964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:29.293960 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824327-cd1a-437c-9f06-2b0fa3d28865 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:29.303496 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:29.329787 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e8754-5556-4bb5-8434-c927e23c2d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:29.330535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e8754-5556-4bb5-8434-c927e23c2d90 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:29.330897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e8754-5556-4bb5-8434-c927e23c2d90 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:29.331250 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e8754-5556-4bb5-8434-c927e23c2d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:29.343856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e8754-5556-4bb5-8434-c927e23c2d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:29.345600 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e8754-5556-4bb5-8434-c927e23c2d90 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:29.347897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee1c07-6f16-41bd-8a26-de36e4cdd519 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-aa7e8754-5556-4bb5-8434-c927e23c2d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:29.361096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:29.362282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:29.363416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:29.363416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:29.363416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:29.363861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 294/588] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:29.364633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e8754-5556-4bb5-8434-c927e23c2d90 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:29.389217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844137a-26f4-43d5-8c6b-44a7cc14c897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:29.389906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844137a-26f4-43d5-8c6b-44a7cc14c897 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:29.390254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844137a-26f4-43d5-8c6b-44a7cc14c897 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:29.390601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844137a-26f4-43d5-8c6b-44a7cc14c897 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:29.391382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844137a-26f4-43d5-8c6b-44a7cc14c897 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:29.391763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844137a-26f4-43d5-8c6b-44a7cc14c897 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:29.393190 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844137a-26f4-43d5-8c6b-44a7cc14c897 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:29.409377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 295/589] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:29.409377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844137a-26f4-43d5-8c6b-44a7cc14c897 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:29.474843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:29.475765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e8754-5556-4bb5-8434-c927e23c2d90 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:29.509871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844137a-26f4-43d5-8c6b-44a7cc14c897 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:29.511323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30d3c5-0488-49e9-8a8c-c6381216008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:29.512003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30d3c5-0488-49e9-8a8c-c6381216008f None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:29.512352 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30d3c5-0488-49e9-8a8c-c6381216008f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:29.512691 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30d3c5-0488-49e9-8a8c-c6381216008f None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:29.513465 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30d3c5-0488-49e9-8a8c-c6381216008f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:29.514381 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30d3c5-0488-49e9-8a8c-c6381216008f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:29.515882 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30d3c5-0488-49e9-8a8c-c6381216008f None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:29.532844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 295/590] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:29.532844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30d3c5-0488-49e9-8a8c-c6381216008f None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:29.552776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:29.553526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dad19-60bf-48e4-a949-9a5e4f9c23af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:29.554159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dad19-60bf-48e4-a949-9a5e4f9c23af None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:29.554438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dad19-60bf-48e4-a949-9a5e4f9c23af None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:29.554927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dad19-60bf-48e4-a949-9a5e4f9c23af None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:29.563700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5dad19-60bf-48e4-a949-9a5e4f9c23af None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:29.565128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5dad19-60bf-48e4-a949-9a5e4f9c23af None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-ab5dad19-60bf-48e4-a949-9a5e4f9c23af None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:29.577765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:29.579870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:29.580972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:29.580972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:29.580972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:29.580972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:29.580972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:29.580972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:29.580972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:29.580972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:29.580972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:38:29.580972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:29.580972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 296/591] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:29.580972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dad19-60bf-48e4-a949-9a5e4f9c23af None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:29.643437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30d3c5-0488-49e9-8a8c-c6381216008f None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:29.680106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a2f5-0ac6-45ba-ae0a-1ff9c0b0715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:29.681007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a2f5-0ac6-45ba-ae0a-1ff9c0b0715d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:29.681449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a2f5-0ac6-45ba-ae0a-1ff9c0b0715d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:29.681723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a2f5-0ac6-45ba-ae0a-1ff9c0b0715d None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:29.682364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a2f5-0ac6-45ba-ae0a-1ff9c0b0715d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:29.682667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a2f5-0ac6-45ba-ae0a-1ff9c0b0715d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:29.684069 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a2f5-0ac6-45ba-ae0a-1ff9c0b0715d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:29.686513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dad19-60bf-48e4-a949-9a5e4f9c23af None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:29.700297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 296/592] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:29.700297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a2f5-0ac6-45ba-ae0a-1ff9c0b0715d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:29.718932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:29.727947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9a259-dd85-411d-b15d-e379d8d92808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:29.728627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9a259-dd85-411d-b15d-e379d8d92808 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:29.728923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9a259-dd85-411d-b15d-e379d8d92808 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:29.729188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9a259-dd85-411d-b15d-e379d8d92808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:29.745327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9a259-dd85-411d-b15d-e379d8d92808 None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=a75fb249079b4831be08cc4c9f94d6df) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:29.745327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9a259-dd85-411d-b15d-e379d8d92808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:29.745327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9a259-dd85-411d-b15d-e379d8d92808 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:29.745327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 297/593] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:29 2022] GET /identity/v3/role_assignments?user.id=a75fb249079b4831be08cc4c9f94d6df&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:29.745327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9a259-dd85-411d-b15d-e379d8d92808 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:29.823184 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:29.845414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a2f5-0ac6-45ba-ae0a-1ff9c0b0715d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:29.878443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9a259-dd85-411d-b15d-e379d8d92808 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:29.885364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e3578-2aab-4030-b06b-bde0c63976eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:29.886108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e3578-2aab-4030-b06b-bde0c63976eb None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:29.886443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e3578-2aab-4030-b06b-bde0c63976eb None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:29.886772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e3578-2aab-4030-b06b-bde0c63976eb None admin] PATH_INFO: `/v3/projects/da13e1cbae664d5a92198052526ee459/users/7a10328a436c4159b6519e5493ba57f8/roles/ec4f9fa2b3e6483f97993b78c43ea7a4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:29.902937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e3578-2aab-4030-b06b-bde0c63976eb None admin] RBAC: Authorizing `identity:create_grant(project_id=da13e1cbae664d5a92198052526ee459, user_id=7a10328a436c4159b6519e5493ba57f8, role_id=ec4f9fa2b3e6483f97993b78c43ea7a4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:29.905120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e3578-2aab-4030-b06b-bde0c63976eb None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:29.923662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642a0a2-32c5-4462-97c1-51d9c08539c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:29.924568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642a0a2-32c5-4462-97c1-51d9c08539c9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:29.925028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642a0a2-32c5-4462-97c1-51d9c08539c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:29.925451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642a0a2-32c5-4462-97c1-51d9c08539c9 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:29.926326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642a0a2-32c5-4462-97c1-51d9c08539c9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:29.926793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642a0a2-32c5-4462-97c1-51d9c08539c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:29.928450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642a0a2-32c5-4462-97c1-51d9c08539c9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:29.950956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 298/594] 10.222.0.73 () {56 vars in 1139 bytes} [Mon Aug 29 23:38:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:29.952782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642a0a2-32c5-4462-97c1-51d9c08539c9 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:29.983108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 297/595] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:38:29 2022] PUT /identity/v3/projects/da13e1cbae664d5a92198052526ee459/users/7a10328a436c4159b6519e5493ba57f8/roles/ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:29.984405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e3578-2aab-4030-b06b-bde0c63976eb None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:30.009707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:30.068666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642a0a2-32c5-4462-97c1-51d9c08539c9 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:30.124598 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e237f-a78e-4f0d-b161-33ce04bcb376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:30.126248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e237f-a78e-4f0d-b161-33ce04bcb376 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:30.126910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e237f-a78e-4f0d-b161-33ce04bcb376 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:30.129714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e237f-a78e-4f0d-b161-33ce04bcb376 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:30.141993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e237f-a78e-4f0d-b161-33ce04bcb376 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:30.143955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e237f-a78e-4f0d-b161-33ce04bcb376 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-db7e237f-a78e-4f0d-b161-33ce04bcb376 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:30.168528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:30.169730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:30.171508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:30.171508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:30.171508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:30.171508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:30.171508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:30.171508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:30.171508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:30.171508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:30.171508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:38:30.171508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:30.173840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 299/596] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:30.179974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e237f-a78e-4f0d-b161-33ce04bcb376 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:30.200504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e3578-2aab-4030-b06b-bde0c63976eb None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:30.235098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:30.242584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f09a7d-2637-47ae-b889-d1f58e20f837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:30.243535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f09a7d-2637-47ae-b889-d1f58e20f837 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:30.244002 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f09a7d-2637-47ae-b889-d1f58e20f837 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:30.244460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f09a7d-2637-47ae-b889-d1f58e20f837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:30.257212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f09a7d-2637-47ae-b889-d1f58e20f837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:30.258939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f09a7d-2637-47ae-b889-d1f58e20f837 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-64f09a7d-2637-47ae-b889-d1f58e20f837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:30.274424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:30.275426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:30.276386 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:30.276386 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:30.276386 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:30.278869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 298/597] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:30.285189 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f09a7d-2637-47ae-b889-d1f58e20f837 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:30.303663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e237f-a78e-4f0d-b161-33ce04bcb376 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:30.316997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:30.343547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86c1a9-37e2-486a-8a27-5341eb46de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:30.344580 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86c1a9-37e2-486a-8a27-5341eb46de8a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:30.345068 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86c1a9-37e2-486a-8a27-5341eb46de8a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:30.345543 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86c1a9-37e2-486a-8a27-5341eb46de8a None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:30.346648 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86c1a9-37e2-486a-8a27-5341eb46de8a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:30.347292 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86c1a9-37e2-486a-8a27-5341eb46de8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:30.349375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86c1a9-37e2-486a-8a27-5341eb46de8a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:30.370097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 300/598] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Aug 29 23:38:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:30.387613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86c1a9-37e2-486a-8a27-5341eb46de8a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:30.412751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f09a7d-2637-47ae-b889-d1f58e20f837 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:30.455615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d81ea8-5c6a-440d-aa58-cf8163d267e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:30.456692 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d81ea8-5c6a-440d-aa58-cf8163d267e6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:30.457180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d81ea8-5c6a-440d-aa58-cf8163d267e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:30.457715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d81ea8-5c6a-440d-aa58-cf8163d267e6 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:30.458561 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d81ea8-5c6a-440d-aa58-cf8163d267e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:30.459153 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d81ea8-5c6a-440d-aa58-cf8163d267e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:30.461361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d81ea8-5c6a-440d-aa58-cf8163d267e6 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:30.491109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 299/599] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:30.498815 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d81ea8-5c6a-440d-aa58-cf8163d267e6 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:30.548069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86c1a9-37e2-486a-8a27-5341eb46de8a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:30.557107 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:30.607617 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32aaa-e58f-4eb7-b6eb-73c6adeff229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:30.608267 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32aaa-e58f-4eb7-b6eb-73c6adeff229 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:30.608549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32aaa-e58f-4eb7-b6eb-73c6adeff229 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:30.608827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32aaa-e58f-4eb7-b6eb-73c6adeff229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:30.629300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d81ea8-5c6a-440d-aa58-cf8163d267e6 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:30.633945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf32aaa-e58f-4eb7-b6eb-73c6adeff229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:30.635459 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf32aaa-e58f-4eb7-b6eb-73c6adeff229 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-bbf32aaa-e58f-4eb7-b6eb-73c6adeff229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:30.662364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:30.663568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:30.664642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:30.664642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:30.664642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:30.664642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 301/600] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:30.671394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bf2ce-66fd-4eea-960a-7c6b5ae7b3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:30.671773 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32aaa-e58f-4eb7-b6eb-73c6adeff229 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:30.672486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf2ce-66fd-4eea-960a-7c6b5ae7b3ec None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:30.672921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf2ce-66fd-4eea-960a-7c6b5ae7b3ec None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:30.673498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf2ce-66fd-4eea-960a-7c6b5ae7b3ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:30.680773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bf2ce-66fd-4eea-960a-7c6b5ae7b3ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:30.682415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bf2ce-66fd-4eea-960a-7c6b5ae7b3ec None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-370bf2ce-66fd-4eea-960a-7c6b5ae7b3ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:30.694282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:30.695393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:30.696494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:30.696494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:30.696494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:30.696494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:30.696494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:30.696494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:30.696494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:30.696494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:30.698552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 300/601] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:30.704709 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bf2ce-66fd-4eea-960a-7c6b5ae7b3ec None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:30.719232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:30.811495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bf2ce-66fd-4eea-960a-7c6b5ae7b3ec None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:30.812996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:30.845119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32aaa-e58f-4eb7-b6eb-73c6adeff229 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:30.847494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2cb54-634d-4833-8731-6a827918bf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:30.848252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2cb54-634d-4833-8731-6a827918bf7d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:30.848633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2cb54-634d-4833-8731-6a827918bf7d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:30.848978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2cb54-634d-4833-8731-6a827918bf7d None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:30.849739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2cb54-634d-4833-8731-6a827918bf7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:30.850150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2cb54-634d-4833-8731-6a827918bf7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:30.851717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2cb54-634d-4833-8731-6a827918bf7d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:30.864858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 301/602] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:30.866184 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bea94-8d66-4966-856e-1e67b4d93291 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:30.871179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bea94-8d66-4966-856e-1e67b4d93291 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:30.871542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bea94-8d66-4966-856e-1e67b4d93291 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:30.873469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 302/603] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:30.874250 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bea94-8d66-4966-856e-1e67b4d93291 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:30.885001 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976e526-993c-4147-8334-5b6c6bd958ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:30.885720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976e526-993c-4147-8334-5b6c6bd958ac None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:30.886005 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976e526-993c-4147-8334-5b6c6bd958ac None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:30.886275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976e526-993c-4147-8334-5b6c6bd958ac None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:30.886966 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976e526-993c-4147-8334-5b6c6bd958ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:30.887339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976e526-993c-4147-8334-5b6c6bd958ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:30.889252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976e526-993c-4147-8334-5b6c6bd958ac None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:30.908105 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 302/604] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:30.909403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7537e8-d003-495f-a20d-c6c73ca9c68f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:30.909686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7537e8-d003-495f-a20d-c6c73ca9c68f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:30.909955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7537e8-d003-495f-a20d-c6c73ca9c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:30.928732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-ba7537e8-d003-495f-a20d-c6c73ca9c68f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:30.930532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ba7537e8-d003-495f-a20d-c6c73ca9c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:30.992653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bea94-8d66-4966-856e-1e67b4d93291 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:31.011814 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 303/605] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:31.012845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7537e8-d003-495f-a20d-c6c73ca9c68f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:31.043246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:31.055196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa6f61-93b1-445b-9f71-70a3f7177dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:31.055859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa6f61-93b1-445b-9f71-70a3f7177dec None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:31.056135 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa6f61-93b1-445b-9f71-70a3f7177dec None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:31.057542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa6f61-93b1-445b-9f71-70a3f7177dec None admin] PATH_INFO: `/v3/projects/da13e1cbae664d5a92198052526ee459/users/707518bbe380425aa793f005548bc9d5/roles/ec4f9fa2b3e6483f97993b78c43ea7a4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:31.086931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa6f61-93b1-445b-9f71-70a3f7177dec None admin] RBAC: Authorizing `identity:create_grant(project_id=da13e1cbae664d5a92198052526ee459, user_id=707518bbe380425aa793f005548bc9d5, role_id=ec4f9fa2b3e6483f97993b78c43ea7a4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:31.088375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa6f61-93b1-445b-9f71-70a3f7177dec None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:31.156241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7537e8-d003-495f-a20d-c6c73ca9c68f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:31.199241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 303/606] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:38:30 2022] PUT /identity/v3/projects/da13e1cbae664d5a92198052526ee459/users/707518bbe380425aa793f005548bc9d5/roles/ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:31.199694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72500aa9-4db9-4e59-9181-96fd8b3bc3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:31.200349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72500aa9-4db9-4e59-9181-96fd8b3bc3cd None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:31.200628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72500aa9-4db9-4e59-9181-96fd8b3bc3cd None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:31.200902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72500aa9-4db9-4e59-9181-96fd8b3bc3cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:31.210256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72500aa9-4db9-4e59-9181-96fd8b3bc3cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:31.212100 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72500aa9-4db9-4e59-9181-96fd8b3bc3cd None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-72500aa9-4db9-4e59-9181-96fd8b3bc3cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:31.226104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:31.227154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:31.228104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:31.228104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:31.228104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:31.228104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:31.228104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:31.228104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:31.228104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:31.228104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:31.228104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 304/607] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:31.234455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa6f61-93b1-445b-9f71-70a3f7177dec None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:31.252468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:31.370943 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa6f61-93b1-445b-9f71-70a3f7177dec None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:31.377451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72500aa9-4db9-4e59-9181-96fd8b3bc3cd None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:31.418476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b2109-6b6e-4b20-af20-c353613f55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:31.419189 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2109-6b6e-4b20-af20-c353613f55cc None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:31.420848 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2109-6b6e-4b20-af20-c353613f55cc None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:31.421131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2109-6b6e-4b20-af20-c353613f55cc None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:31.421844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b2109-6b6e-4b20-af20-c353613f55cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:31.422159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b2109-6b6e-4b20-af20-c353613f55cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:31.424987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b2109-6b6e-4b20-af20-c353613f55cc None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:31.443287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 304/608] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:31.448834 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b2109-6b6e-4b20-af20-c353613f55cc None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:31.495510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:31.533723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:31.536654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72500aa9-4db9-4e59-9181-96fd8b3bc3cd None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:31.569990 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b2109-6b6e-4b20-af20-c353613f55cc None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:31.576697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c66a2-31cf-44d9-82da-512cad2250ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:31.577578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c66a2-31cf-44d9-82da-512cad2250ca None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:31.577935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c66a2-31cf-44d9-82da-512cad2250ca None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:31.578271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c66a2-31cf-44d9-82da-512cad2250ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:31.591447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c66a2-31cf-44d9-82da-512cad2250ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-cd5c66a2-31cf-44d9-82da-512cad2250ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:31.599007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:31.600002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:31.600847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 305/609] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:31.612552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c66a2-31cf-44d9-82da-512cad2250ca None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:31.627330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba53c15-cf96-4529-bfb6-9b8e4dc4caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:31.628333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53c15-cf96-4529-bfb6-9b8e4dc4caa5 None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:31.628797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53c15-cf96-4529-bfb6-9b8e4dc4caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:31.629253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53c15-cf96-4529-bfb6-9b8e4dc4caa5 None admin] PATH_INFO: `/v3/projects/da13e1cbae664d5a92198052526ee459/users/ea872bd7ac2f4640a97648ccf96c02da/roles/ec4f9fa2b3e6483f97993b78c43ea7a4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:31.659484 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba53c15-cf96-4529-bfb6-9b8e4dc4caa5 None admin] RBAC: Authorizing `identity:create_grant(project_id=da13e1cbae664d5a92198052526ee459, user_id=ea872bd7ac2f4640a97648ccf96c02da, role_id=ec4f9fa2b3e6483f97993b78c43ea7a4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:31.662174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba53c15-cf96-4529-bfb6-9b8e4dc4caa5 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:31.745480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 305/610] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:38:31 2022] PUT /identity/v3/projects/da13e1cbae664d5a92198052526ee459/users/ea872bd7ac2f4640a97648ccf96c02da/roles/ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:31.757797 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c66a2-31cf-44d9-82da-512cad2250ca None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:31.802040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:31.811502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d8ee2-4814-4c9b-a320-efdadcb74b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:31.814223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d8ee2-4814-4c9b-a320-efdadcb74b79 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:31.814223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d8ee2-4814-4c9b-a320-efdadcb74b79 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:31.814223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d8ee2-4814-4c9b-a320-efdadcb74b79 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:31.814223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d8ee2-4814-4c9b-a320-efdadcb74b79 None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:31.814700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d8ee2-4814-4c9b-a320-efdadcb74b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:31.816296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d8ee2-4814-4c9b-a320-efdadcb74b79 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:31.831085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 306/611] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:31.838272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba53c15-cf96-4529-bfb6-9b8e4dc4caa5 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:31.871186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485cfe1-0c8c-42db-845e-3ccd663f0b80 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:31.871798 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485cfe1-0c8c-42db-845e-3ccd663f0b80 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:31.872254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485cfe1-0c8c-42db-845e-3ccd663f0b80 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:31.874785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 307/612] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:31.893810 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53e774-5928-4a03-8fa3-a50b823f2c7d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:31.894396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53e774-5928-4a03-8fa3-a50b823f2c7d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:31.894908 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53e774-5928-4a03-8fa3-a50b823f2c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:31.929807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-9f53e774-5928-4a03-8fa3-a50b823f2c7d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:31.931067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9f53e774-5928-4a03-8fa3-a50b823f2c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:31.991533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba53c15-cf96-4529-bfb6-9b8e4dc4caa5 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:32.019138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:32.032267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bf2d9-b6c2-45e3-bd26-2e2c7024fa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:32.043203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bf2d9-b6c2-45e3-bd26-2e2c7024fa5e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:32.043203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bf2d9-b6c2-45e3-bd26-2e2c7024fa5e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:32.043203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bf2d9-b6c2-45e3-bd26-2e2c7024fa5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:32.043484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 308/613] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:32.047968 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bf2d9-b6c2-45e3-bd26-2e2c7024fa5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:32.049417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bf2d9-b6c2-45e3-bd26-2e2c7024fa5e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-ce8bf2d9-b6c2-45e3-bd26-2e2c7024fa5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:32.064906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:32.065899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:32.066845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:32.066845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:32.066845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:32.066845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 306/614] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:32.073160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53e774-5928-4a03-8fa3-a50b823f2c7d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:32.205920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53e774-5928-4a03-8fa3-a50b823f2c7d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:32.229468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:32.241478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3097635-d727-4c30-9406-9a8effec8d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:32.242669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3097635-d727-4c30-9406-9a8effec8d07 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:32.243024 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3097635-d727-4c30-9406-9a8effec8d07 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:32.243299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3097635-d727-4c30-9406-9a8effec8d07 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:32.244007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3097635-d727-4c30-9406-9a8effec8d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:32.244314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3097635-d727-4c30-9406-9a8effec8d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:32.245727 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3097635-d727-4c30-9406-9a8effec8d07 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:32.258058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 309/615] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:32.263541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bf2d9-b6c2-45e3-bd26-2e2c7024fa5e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:32.382227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bf2d9-b6c2-45e3-bd26-2e2c7024fa5e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:32.404549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c87fc-c067-45e3-bae0-4ee2397636cc None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:32.405055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c87fc-c067-45e3-bae0-4ee2397636cc None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:32.405163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c87fc-c067-45e3-bae0-4ee2397636cc None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:32.406554 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 310/616] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:38:32.412293 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f7781-0f49-4a7f-973a-bacd5432c46b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:32.412683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f7781-0f49-4a7f-973a-bacd5432c46b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:32.412962 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f7781-0f49-4a7f-973a-bacd5432c46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:32.427434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c41c3-4824-4101-a016-1c317d442741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:32.428065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c41c3-4824-4101-a016-1c317d442741 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:32.428349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c41c3-4824-4101-a016-1c317d442741 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:32.428622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c41c3-4824-4101-a016-1c317d442741 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:32.436487 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c41c3-4824-4101-a016-1c317d442741 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:32.437930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c41c3-4824-4101-a016-1c317d442741 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-165c41c3-4824-4101-a016-1c317d442741 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:32.449186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:32.450087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:32.451067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:32.451067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:32.451067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:32.451067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:32.451067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:32.451067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:32.451067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:32.451067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:32.451067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:38:32.451067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:32.451067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 307/617] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Aug 29 23:38:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:32.451640 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c41c3-4824-4101-a016-1c317d442741 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:32.451716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-b42f7781-0f49-4a7f-973a-bacd5432c46b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:32.453736 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b42f7781-0f49-4a7f-973a-bacd5432c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:32.494507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:32.555574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 311/618] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:38:32.557065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f7781-0f49-4a7f-973a-bacd5432c46b None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:32.565871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c41c3-4824-4101-a016-1c317d442741 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:32.601704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6e528-1b88-4872-a20c-97016c4494ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:32.602341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e528-1b88-4872-a20c-97016c4494ac None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:32.602620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e528-1b88-4872-a20c-97016c4494ac None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:32.602917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e528-1b88-4872-a20c-97016c4494ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:32.614585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6e528-1b88-4872-a20c-97016c4494ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-8de6e528-1b88-4872-a20c-97016c4494ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:32.619546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:32.620458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:32.621699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 308/619] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:32.627780 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6e528-1b88-4872-a20c-97016c4494ac None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:32.720340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f7781-0f49-4a7f-973a-bacd5432c46b None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:32.752815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:32.785230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8afeaa-d250-43cf-9950-9c6fc03b4039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:32.785847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8afeaa-d250-43cf-9950-9c6fc03b4039 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:32.786119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8afeaa-d250-43cf-9950-9c6fc03b4039 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:32.786382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8afeaa-d250-43cf-9950-9c6fc03b4039 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:32.787130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8afeaa-d250-43cf-9950-9c6fc03b4039 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:32.787431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8afeaa-d250-43cf-9950-9c6fc03b4039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:32.789774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8afeaa-d250-43cf-9950-9c6fc03b4039 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:32.804192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:32.817212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6e528-1b88-4872-a20c-97016c4494ac None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:32.827101 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 312/620] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Aug 29 23:38:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:32.832889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8afeaa-d250-43cf-9950-9c6fc03b4039 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:32.875045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e249eca-3f29-4f90-8e0b-a22d8687a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:32.875651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e249eca-3f29-4f90-8e0b-a22d8687a3ac None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:32.875926 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e249eca-3f29-4f90-8e0b-a22d8687a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:32.876192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e249eca-3f29-4f90-8e0b-a22d8687a3ac None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:32.876846 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e249eca-3f29-4f90-8e0b-a22d8687a3ac None admin] RBAC: Adding query filter params (name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:32.877143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e249eca-3f29-4f90-8e0b-a22d8687a3ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:32.878480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e249eca-3f29-4f90-8e0b-a22d8687a3ac None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:32.889461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 309/621] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:32.895050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e249eca-3f29-4f90-8e0b-a22d8687a3ac None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:32.980789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8afeaa-d250-43cf-9950-9c6fc03b4039 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:33.003908 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e249eca-3f29-4f90-8e0b-a22d8687a3ac None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:33.028828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4007ee-4760-4634-b6a3-2c27c1bc2b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:33.030354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4007ee-4760-4634-b6a3-2c27c1bc2b3c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:33.030864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4007ee-4760-4634-b6a3-2c27c1bc2b3c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:33.031468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4007ee-4760-4634-b6a3-2c27c1bc2b3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:33.049912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9ebb2-300d-43d8-ad9e-4a5f09fea76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:33.050554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9ebb2-300d-43d8-ad9e-4a5f09fea76e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:33.050838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9ebb2-300d-43d8-ad9e-4a5f09fea76e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:33.051427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9ebb2-300d-43d8-ad9e-4a5f09fea76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:33.067686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9ebb2-300d-43d8-ad9e-4a5f09fea76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:33.069141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9ebb2-300d-43d8-ad9e-4a5f09fea76e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:33.083240 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-c8d9ebb2-300d-43d8-ad9e-4a5f09fea76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:33.088149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:33.089110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:33.090639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:33.090639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:33.090639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:33.090639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 310/622] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:33.090639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9ebb2-300d-43d8-ad9e-4a5f09fea76e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:33.103929 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:33.114224 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4007ee-4760-4634-b6a3-2c27c1bc2b3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:33.118854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4007ee-4760-4634-b6a3-2c27c1bc2b3c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:33.219217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9ebb2-300d-43d8-ad9e-4a5f09fea76e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:33.253544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 313/623] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:33.253544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4007ee-4760-4634-b6a3-2c27c1bc2b3c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:33.262562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee372594-8057-4539-b52b-69acb14b716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:33.263570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee372594-8057-4539-b52b-69acb14b716a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:33.264566 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee372594-8057-4539-b52b-69acb14b716a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:33.265039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee372594-8057-4539-b52b-69acb14b716a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:33.276528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee372594-8057-4539-b52b-69acb14b716a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-ee372594-8057-4539-b52b-69acb14b716a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:33.282568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:33.283548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:33.284430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:33.284430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:33.284430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:33.284430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:33.284430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:33.284430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:33.284430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:33.284430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:33.284430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:33.284430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:33.284430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:33.284430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:33.291304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 311/624] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:33.292329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee372594-8057-4539-b52b-69acb14b716a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:33.332348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:33.367727 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4007ee-4760-4634-b6a3-2c27c1bc2b3c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:33.370285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:33.410238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee372594-8057-4539-b52b-69acb14b716a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:33.412099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0c6b7-c5e5-43be-9d04-a29632a9d88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:33.412763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0c6b7-c5e5-43be-9d04-a29632a9d88d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:33.412989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0c6b7-c5e5-43be-9d04-a29632a9d88d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:33.413284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0c6b7-c5e5-43be-9d04-a29632a9d88d None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:33.414082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0c6b7-c5e5-43be-9d04-a29632a9d88d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:33.414388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0c6b7-c5e5-43be-9d04-a29632a9d88d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:33.416663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0c6b7-c5e5-43be-9d04-a29632a9d88d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:33.431770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 314/625] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:33.432646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0c6b7-c5e5-43be-9d04-a29632a9d88d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:33.450463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c3411-d252-419c-887f-b1aa30256440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:33.451869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c3411-d252-419c-887f-b1aa30256440 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:33.452356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c3411-d252-419c-887f-b1aa30256440 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:33.452853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c3411-d252-419c-887f-b1aa30256440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:33.464827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c3411-d252-419c-887f-b1aa30256440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:33.467186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c3411-d252-419c-887f-b1aa30256440 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-467c3411-d252-419c-887f-b1aa30256440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:33.483172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:33.484173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:33.485065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:33.485065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:33.485065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:33.491009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 312/626] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:33.492196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c3411-d252-419c-887f-b1aa30256440 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:33.552010 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0c6b7-c5e5-43be-9d04-a29632a9d88d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:33.585835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:33.596040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e60442-1b97-4ddb-bb92-a35364cae412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:33.596908 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e60442-1b97-4ddb-bb92-a35364cae412 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:33.598606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e60442-1b97-4ddb-bb92-a35364cae412 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:33.598606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e60442-1b97-4ddb-bb92-a35364cae412 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:33.598606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e60442-1b97-4ddb-bb92-a35364cae412 None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:33.599226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e60442-1b97-4ddb-bb92-a35364cae412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:33.600683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e60442-1b97-4ddb-bb92-a35364cae412 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:33.612010 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 315/627] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:33.612844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e60442-1b97-4ddb-bb92-a35364cae412 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:33.629182 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c3411-d252-419c-887f-b1aa30256440 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:33.656865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:33.671883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcf89c-a735-4dde-9586-402d581b6ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:33.672954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcf89c-a735-4dde-9586-402d581b6ad0 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:33.672954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcf89c-a735-4dde-9586-402d581b6ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:33.673235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcf89c-a735-4dde-9586-402d581b6ad0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:33.681002 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcf89c-a735-4dde-9586-402d581b6ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:33.682469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcf89c-a735-4dde-9586-402d581b6ad0 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-cafcf89c-a735-4dde-9586-402d581b6ad0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:33.693856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:33.694851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:33.695872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:33.695872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:33.695872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:33.695872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:33.695872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:33.695872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:33.695872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:33.695872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:33.695872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:38:33.695872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:33.695872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 313/628] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:33.696852 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358d274-5f37-4a5a-87be-1e3c55f2a229 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:33.696852 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358d274-5f37-4a5a-87be-1e3c55f2a229 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:33.696852 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358d274-5f37-4a5a-87be-1e3c55f2a229 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:33.698573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 314/629] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:33.699425 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358d274-5f37-4a5a-87be-1e3c55f2a229 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:33.732132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e60442-1b97-4ddb-bb92-a35364cae412 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:33.771050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902052c1-d2d3-4bf6-b2e8-0aa5acf5291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:33.771655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902052c1-d2d3-4bf6-b2e8-0aa5acf5291e None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:33.771931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902052c1-d2d3-4bf6-b2e8-0aa5acf5291e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:33.772195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902052c1-d2d3-4bf6-b2e8-0aa5acf5291e None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:33.772820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902052c1-d2d3-4bf6-b2e8-0aa5acf5291e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:33.773121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902052c1-d2d3-4bf6-b2e8-0aa5acf5291e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:33.774464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902052c1-d2d3-4bf6-b2e8-0aa5acf5291e None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:33.790660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 316/630] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:33.790660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902052c1-d2d3-4bf6-b2e8-0aa5acf5291e None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:33.820017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358d274-5f37-4a5a-87be-1e3c55f2a229 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:33.843901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:33.856455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f16b-64dd-4818-9537-d13190a59fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:33.857194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f16b-64dd-4818-9537-d13190a59fc5 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:33.857495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f16b-64dd-4818-9537-d13190a59fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:33.857823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f16b-64dd-4818-9537-d13190a59fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:33.869897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f16b-64dd-4818-9537-d13190a59fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:33.871316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f16b-64dd-4818-9537-d13190a59fc5 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-fc86f16b-64dd-4818-9537-d13190a59fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:33.886730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:33.887818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:33.889948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:33.889948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:33.889948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:33.889948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 315/631] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:33.894179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88514fe9-9fd9-4db2-b196-24fde5f3ad87 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:33.894463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88514fe9-9fd9-4db2-b196-24fde5f3ad87 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:33.894730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88514fe9-9fd9-4db2-b196-24fde5f3ad87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:33.895480 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902052c1-d2d3-4bf6-b2e8-0aa5acf5291e None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:33.913424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-88514fe9-9fd9-4db2-b196-24fde5f3ad87 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:33.914609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-88514fe9-9fd9-4db2-b196-24fde5f3ad87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:33.933689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daf5c6-8351-441d-965c-8dfc74c13012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:33.934294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daf5c6-8351-441d-965c-8dfc74c13012 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:33.934570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daf5c6-8351-441d-965c-8dfc74c13012 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:33.934839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daf5c6-8351-441d-965c-8dfc74c13012 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:33.936114 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72daf5c6-8351-441d-965c-8dfc74c13012 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:33.936422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72daf5c6-8351-441d-965c-8dfc74c13012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:33.937847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72daf5c6-8351-441d-965c-8dfc74c13012 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:33.942794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:33.959159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 317/632] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Aug 29 23:38:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:33.961298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daf5c6-8351-441d-965c-8dfc74c13012 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:33.986678 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 316/633] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:33.987563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88514fe9-9fd9-4db2-b196-24fde5f3ad87 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:34.076050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daf5c6-8351-441d-965c-8dfc74c13012 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:34.087297 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:34.099291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88514fe9-9fd9-4db2-b196-24fde5f3ad87 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:34.111821 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b257a6-841b-46ad-a851-cad51546867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:34.112569 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b257a6-841b-46ad-a851-cad51546867d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:34.112847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b257a6-841b-46ad-a851-cad51546867d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:34.113119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b257a6-841b-46ad-a851-cad51546867d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:34.120035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b257a6-841b-46ad-a851-cad51546867d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:34.121483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b257a6-841b-46ad-a851-cad51546867d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-b8b257a6-841b-46ad-a851-cad51546867d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:34.133093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:34.133983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:34.134868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:34.134868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:34.134868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:34.134868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:34.134868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:34.134868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:34.134868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:34.134868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:34.136105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c49ca-bf43-401b-bf1a-f2ed61351347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:34.136714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c49ca-bf43-401b-bf1a-f2ed61351347 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:34.136988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c49ca-bf43-401b-bf1a-f2ed61351347 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:34.137259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c49ca-bf43-401b-bf1a-f2ed61351347 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:34.137898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c49ca-bf43-401b-bf1a-f2ed61351347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:34.138215 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c49ca-bf43-401b-bf1a-f2ed61351347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:34.139622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c49ca-bf43-401b-bf1a-f2ed61351347 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:34.144739 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 318/634] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:34.144739 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b257a6-841b-46ad-a851-cad51546867d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:34.156224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 317/635] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:34.156224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508b0ef-c103-4da1-967a-3ddc3f4663ff None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:34.156224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508b0ef-c103-4da1-967a-3ddc3f4663ff None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:34.156224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508b0ef-c103-4da1-967a-3ddc3f4663ff None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:34.156224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 318/636] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:34.156839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508b0ef-c103-4da1-967a-3ddc3f4663ff None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:34.182686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:34.254811 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b257a6-841b-46ad-a851-cad51546867d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:34.265417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508b0ef-c103-4da1-967a-3ddc3f4663ff None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:34.289039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a504a1-f752-405d-b5ce-8671455f0ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:34.289803 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a504a1-f752-405d-b5ce-8671455f0ee6 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:34.290183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a504a1-f752-405d-b5ce-8671455f0ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:34.290555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a504a1-f752-405d-b5ce-8671455f0ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:34.298798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059cff8-f14a-4a16-930d-21a19dbe909d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:34.299433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059cff8-f14a-4a16-930d-21a19dbe909d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:34.299715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059cff8-f14a-4a16-930d-21a19dbe909d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:34.299987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059cff8-f14a-4a16-930d-21a19dbe909d None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:34.300673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059cff8-f14a-4a16-930d-21a19dbe909d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:34.300979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059cff8-f14a-4a16-930d-21a19dbe909d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:34.301114 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a504a1-f752-405d-b5ce-8671455f0ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:34.302389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059cff8-f14a-4a16-930d-21a19dbe909d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:34.302538 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a504a1-f752-405d-b5ce-8671455f0ee6 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:34.314205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 319/637] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:34.315016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059cff8-f14a-4a16-930d-21a19dbe909d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-05a504a1-f752-405d-b5ce-8671455f0ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:34.316879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:34.317776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:34.318771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:34.318771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:34.318771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:34.318771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 319/638] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:34.322980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6b913-97e0-4f77-9fe8-b05f4df0f967 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:34.322980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6b913-97e0-4f77-9fe8-b05f4df0f967 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:34.322980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6b913-97e0-4f77-9fe8-b05f4df0f967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:34.337821 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-60d6b913-97e0-4f77-9fe8-b05f4df0f967 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:34.338998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-60d6b913-97e0-4f77-9fe8-b05f4df0f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:34.357248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:34.402056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:34.408903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 320/639] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:34.409788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6b913-97e0-4f77-9fe8-b05f4df0f967 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:34.432483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059cff8-f14a-4a16-930d-21a19dbe909d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:34.470464 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc8449-6516-4412-bea9-0d4c4ed97a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:34.471146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc8449-6516-4412-bea9-0d4c4ed97a80 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:34.471378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc8449-6516-4412-bea9-0d4c4ed97a80 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:34.471665 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc8449-6516-4412-bea9-0d4c4ed97a80 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:34.478608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc8449-6516-4412-bea9-0d4c4ed97a80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:34.480331 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc8449-6516-4412-bea9-0d4c4ed97a80 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-57bc8449-6516-4412-bea9-0d4c4ed97a80 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:34.492095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:34.493218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:34.498807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:34.498807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:34.498807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:34.498807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:34.498807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:34.498807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:34.498807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:34.498807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:34.498807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:38:34.498807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:34.498807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 320/640] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:34.498807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc8449-6516-4412-bea9-0d4c4ed97a80 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:34.520657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6b913-97e0-4f77-9fe8-b05f4df0f967 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:34.562408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6397c-a80a-4556-ab62-691599675148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:34.563342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6397c-a80a-4556-ab62-691599675148 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:34.563774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6397c-a80a-4556-ab62-691599675148 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:34.564043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6397c-a80a-4556-ab62-691599675148 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:34.579583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6397c-a80a-4556-ab62-691599675148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-ebe6397c-a80a-4556-ab62-691599675148 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:34.585511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:34.586485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 321/641] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:34.587375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6397c-a80a-4556-ab62-691599675148 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:34.607347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:34.614273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc8449-6516-4412-bea9-0d4c4ed97a80 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:34.649072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67054781-a0c8-488b-9401-2dcaa03d70f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:34.649766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054781-a0c8-488b-9401-2dcaa03d70f6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:34.649949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054781-a0c8-488b-9401-2dcaa03d70f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:34.650215 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054781-a0c8-488b-9401-2dcaa03d70f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:34.650954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67054781-a0c8-488b-9401-2dcaa03d70f6 None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=59a1b0b274294a288dbf07cd99f95407) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:34.651274 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67054781-a0c8-488b-9401-2dcaa03d70f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:34.652683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67054781-a0c8-488b-9401-2dcaa03d70f6 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:34.666915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 321/642] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:34 2022] GET /identity/v3/role_assignments?user.id=59a1b0b274294a288dbf07cd99f95407&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:34.666915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67054781-a0c8-488b-9401-2dcaa03d70f6 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:34.677277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:34.718225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6397c-a80a-4556-ab62-691599675148 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:34.763104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f096a9-b002-4f93-8ed6-9e44e5c2f021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:34.764617 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f096a9-b002-4f93-8ed6-9e44e5c2f021 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:34.764903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f096a9-b002-4f93-8ed6-9e44e5c2f021 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:34.765179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f096a9-b002-4f93-8ed6-9e44e5c2f021 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:34.765868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f096a9-b002-4f93-8ed6-9e44e5c2f021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:34.766173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f096a9-b002-4f93-8ed6-9e44e5c2f021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:34.767616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f096a9-b002-4f93-8ed6-9e44e5c2f021 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:34.784786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 322/643] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:34.784786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f096a9-b002-4f93-8ed6-9e44e5c2f021 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:34.794762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67054781-a0c8-488b-9401-2dcaa03d70f6 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:34.834805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47d8f-d079-4a44-9543-89bb1fd252f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:34.835799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47d8f-d079-4a44-9543-89bb1fd252f9 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:34.835799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47d8f-d079-4a44-9543-89bb1fd252f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:34.835994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47d8f-d079-4a44-9543-89bb1fd252f9 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:34.836686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc47d8f-d079-4a44-9543-89bb1fd252f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:34.836990 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc47d8f-d079-4a44-9543-89bb1fd252f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:34.838411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc47d8f-d079-4a44-9543-89bb1fd252f9 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:34.858500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 322/644] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Aug 29 23:38:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:34.859543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47d8f-d079-4a44-9543-89bb1fd252f9 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:34.864326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:34.900902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f096a9-b002-4f93-8ed6-9e44e5c2f021 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:34.932139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:34.940208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09431c96-661b-4653-a9bc-e0d3b0118085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:34.940848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09431c96-661b-4653-a9bc-e0d3b0118085 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:34.941122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09431c96-661b-4653-a9bc-e0d3b0118085 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:34.941396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09431c96-661b-4653-a9bc-e0d3b0118085 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:34.942145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09431c96-661b-4653-a9bc-e0d3b0118085 None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:34.942472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09431c96-661b-4653-a9bc-e0d3b0118085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:34.943878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09431c96-661b-4653-a9bc-e0d3b0118085 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:34.957589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 323/645] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:34.957589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09431c96-661b-4653-a9bc-e0d3b0118085 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:34.977806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47d8f-d079-4a44-9543-89bb1fd252f9 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:35.016867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851027e3-7668-4857-b25b-8fdc9f077911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:35.017497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851027e3-7668-4857-b25b-8fdc9f077911 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:35.017780 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851027e3-7668-4857-b25b-8fdc9f077911 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:35.018052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851027e3-7668-4857-b25b-8fdc9f077911 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:35.028566 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851027e3-7668-4857-b25b-8fdc9f077911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-851027e3-7668-4857-b25b-8fdc9f077911 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:35.033408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:35.034479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:35.035442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 323/646] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:35.036176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851027e3-7668-4857-b25b-8fdc9f077911 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:35.068939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09431c96-661b-4653-a9bc-e0d3b0118085 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:35.104958 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bd79d-a754-4351-a80c-eaaff09243fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:35.105586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bd79d-a754-4351-a80c-eaaff09243fa None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:35.105867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bd79d-a754-4351-a80c-eaaff09243fa None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:35.106138 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bd79d-a754-4351-a80c-eaaff09243fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:35.109297 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:35.115073 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bd79d-a754-4351-a80c-eaaff09243fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:35.116666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bd79d-a754-4351-a80c-eaaff09243fa None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-537bd79d-a754-4351-a80c-eaaff09243fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:35.129390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:35.130494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:35.131456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:35.131456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:35.131456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:35.131456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:35.131456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:35.131456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:35.131456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:35.131456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:35.131456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 324/647] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:35.131934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bd79d-a754-4351-a80c-eaaff09243fa None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:35.144321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851027e3-7668-4857-b25b-8fdc9f077911 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:35.172771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:35.189616 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1052351-1f7a-43d0-8164-9d4c505c0b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:35.199615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1052351-1f7a-43d0-8164-9d4c505c0b6e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:35.199615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1052351-1f7a-43d0-8164-9d4c505c0b6e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:35.199615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1052351-1f7a-43d0-8164-9d4c505c0b6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:35.239354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bd79d-a754-4351-a80c-eaaff09243fa None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:35.273283 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1052351-1f7a-43d0-8164-9d4c505c0b6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:35.274707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1052351-1f7a-43d0-8164-9d4c505c0b6e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:35.276085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b794c2-c0f0-41ea-adca-eb79d64b2c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:35.276837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b794c2-c0f0-41ea-adca-eb79d64b2c78 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:35.277228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b794c2-c0f0-41ea-adca-eb79d64b2c78 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:35.277505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b794c2-c0f0-41ea-adca-eb79d64b2c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:35.288842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b794c2-c0f0-41ea-adca-eb79d64b2c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:35.290376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b794c2-c0f0-41ea-adca-eb79d64b2c78 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-c3b794c2-c0f0-41ea-adca-eb79d64b2c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:35.305842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:35.306795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:35.307737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:35.307737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:35.307737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:35.307737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 325/648] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:35.308357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b794c2-c0f0-41ea-adca-eb79d64b2c78 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:35.355964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:35.384875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 324/649] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:35.384875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1052351-1f7a-43d0-8164-9d4c505c0b6e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:35.408497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:35.420239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b794c2-c0f0-41ea-adca-eb79d64b2c78 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:35.455552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1db5e2-c7ae-40af-a59a-02b171f329b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:35.456414 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1db5e2-c7ae-40af-a59a-02b171f329b9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:35.456787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1db5e2-c7ae-40af-a59a-02b171f329b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:35.457122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1db5e2-c7ae-40af-a59a-02b171f329b9 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:35.457866 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1db5e2-c7ae-40af-a59a-02b171f329b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:35.458169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1db5e2-c7ae-40af-a59a-02b171f329b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:35.459541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1db5e2-c7ae-40af-a59a-02b171f329b9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:35.468134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 326/650] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:35.473497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1db5e2-c7ae-40af-a59a-02b171f329b9 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:35.488710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1052351-1f7a-43d0-8164-9d4c505c0b6e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:35.526642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e6ddd-32e2-4ba1-8fc4-38957a50e568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:35.527284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e6ddd-32e2-4ba1-8fc4-38957a50e568 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:35.527570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e6ddd-32e2-4ba1-8fc4-38957a50e568 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:35.527842 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e6ddd-32e2-4ba1-8fc4-38957a50e568 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:35.528534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e6ddd-32e2-4ba1-8fc4-38957a50e568 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:35.528841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e6ddd-32e2-4ba1-8fc4-38957a50e568 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:35.530797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e6ddd-32e2-4ba1-8fc4-38957a50e568 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:35.542541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 325/651] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:35.543375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e6ddd-32e2-4ba1-8fc4-38957a50e568 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:35.589012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1db5e2-c7ae-40af-a59a-02b171f329b9 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:35.599976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:35.625743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d77ee5-93ca-4f2e-9ce1-306298685887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:35.626345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d77ee5-93ca-4f2e-9ce1-306298685887 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:35.626612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d77ee5-93ca-4f2e-9ce1-306298685887 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:35.626886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d77ee5-93ca-4f2e-9ce1-306298685887 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:35.627536 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d77ee5-93ca-4f2e-9ce1-306298685887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:35.627833 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d77ee5-93ca-4f2e-9ce1-306298685887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:35.629363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d77ee5-93ca-4f2e-9ce1-306298685887 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:35.637039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:35.641086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 327/652] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:35.641710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d77ee5-93ca-4f2e-9ce1-306298685887 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:35.657886 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e6ddd-32e2-4ba1-8fc4-38957a50e568 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:35.696192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0fb23-ccbc-4ad4-9a76-f67eb2211983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:35.696831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0fb23-ccbc-4ad4-9a76-f67eb2211983 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:35.697111 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0fb23-ccbc-4ad4-9a76-f67eb2211983 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:35.697785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0fb23-ccbc-4ad4-9a76-f67eb2211983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:35.708763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0fb23-ccbc-4ad4-9a76-f67eb2211983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:35.710241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0fb23-ccbc-4ad4-9a76-f67eb2211983 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-b7d0fb23-ccbc-4ad4-9a76-f67eb2211983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:35.725798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:35.726856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:35.727796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:35.727796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:35.727796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:35.727796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 326/653] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:35.727796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0fb23-ccbc-4ad4-9a76-f67eb2211983 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:35.757704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d77ee5-93ca-4f2e-9ce1-306298685887 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:35.793788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38049e-2a7d-43e1-9f07-39390373891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:35.794411 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38049e-2a7d-43e1-9f07-39390373891a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:35.795250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38049e-2a7d-43e1-9f07-39390373891a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:35.795530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38049e-2a7d-43e1-9f07-39390373891a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:35.807092 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38049e-2a7d-43e1-9f07-39390373891a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:35.808591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38049e-2a7d-43e1-9f07-39390373891a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-fe38049e-2a7d-43e1-9f07-39390373891a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:35.824688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:35.825711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:35.829248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:35.829248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:35.829248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:35.829248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 328/654] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:35.829248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38049e-2a7d-43e1-9f07-39390373891a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:35.844016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0fb23-ccbc-4ad4-9a76-f67eb2211983 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:35.852262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:35.882092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773ff1a-9dde-440d-8b9d-fe1d0bd960d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:35.882756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ff1a-9dde-440d-8b9d-fe1d0bd960d2 None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:35.883069 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ff1a-9dde-440d-8b9d-fe1d0bd960d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:35.883346 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ff1a-9dde-440d-8b9d-fe1d0bd960d2 None admin] PATH_INFO: `/v3/projects/da13e1cbae664d5a92198052526ee459/users/a75fb249079b4831be08cc4c9f94d6df/roles/ec4f9fa2b3e6483f97993b78c43ea7a4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:35.886787 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:35.899623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773ff1a-9dde-440d-8b9d-fe1d0bd960d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=da13e1cbae664d5a92198052526ee459, user_id=a75fb249079b4831be08cc4c9f94d6df, role_id=ec4f9fa2b3e6483f97993b78c43ea7a4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:35.900984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773ff1a-9dde-440d-8b9d-fe1d0bd960d2 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:35.936282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38049e-2a7d-43e1-9f07-39390373891a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:35.969965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa06a3-ee1b-4f18-aa62-7f39fa040df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:35.970600 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa06a3-ee1b-4f18-aa62-7f39fa040df8 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:35.970908 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa06a3-ee1b-4f18-aa62-7f39fa040df8 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:35.971214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa06a3-ee1b-4f18-aa62-7f39fa040df8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:35.978468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa06a3-ee1b-4f18-aa62-7f39fa040df8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:35.980177 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa06a3-ee1b-4f18-aa62-7f39fa040df8 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:35.990095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 327/655] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:38:35 2022] PUT /identity/v3/projects/da13e1cbae664d5a92198052526ee459/users/a75fb249079b4831be08cc4c9f94d6df/roles/ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-6baa06a3-ee1b-4f18-aa62-7f39fa040df8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:35.991294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:35.998272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:35.999472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:35.999472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:35.999472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:35.999472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:35.999472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:35.999472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:35.999472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:35.999472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:35.999472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:38:35.999472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:35.999472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 329/656] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:35.999472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa06a3-ee1b-4f18-aa62-7f39fa040df8 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:36.001000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773ff1a-9dde-440d-8b9d-fe1d0bd960d2 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:36.109511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:36.132843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa06a3-ee1b-4f18-aa62-7f39fa040df8 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:36.140803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773ff1a-9dde-440d-8b9d-fe1d0bd960d2 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:36.174137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ee4a7-a253-40cb-b984-45cd7c30809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:36.174681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ee4a7-a253-40cb-b984-45cd7c30809a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:36.175002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ee4a7-a253-40cb-b984-45cd7c30809a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:36.175281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ee4a7-a253-40cb-b984-45cd7c30809a None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:36.175961 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ee4a7-a253-40cb-b984-45cd7c30809a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:36.176266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ee4a7-a253-40cb-b984-45cd7c30809a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:36.177669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ee4a7-a253-40cb-b984-45cd7c30809a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:36.186217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbb32a-9b3d-491b-b42e-fb15173eb4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:36.186645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbb32a-9b3d-491b-b42e-fb15173eb4d3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:36.187652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbb32a-9b3d-491b-b42e-fb15173eb4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:36.187652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbb32a-9b3d-491b-b42e-fb15173eb4d3 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:36.187955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbb32a-9b3d-491b-b42e-fb15173eb4d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:36.188157 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbb32a-9b3d-491b-b42e-fb15173eb4d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:36.189516 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbb32a-9b3d-491b-b42e-fb15173eb4d3 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:36.192674 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 330/657] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:36.193513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ee4a7-a253-40cb-b984-45cd7c30809a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:36.207949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 328/658] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:36.210178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbb32a-9b3d-491b-b42e-fb15173eb4d3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:36.268796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:36.319388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ee4a7-a253-40cb-b984-45cd7c30809a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:36.332067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbb32a-9b3d-491b-b42e-fb15173eb4d3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:36.358531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e96f4b-a9c4-4b0f-8905-ffc3d0044014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:36.359422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e96f4b-a9c4-4b0f-8905-ffc3d0044014 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:36.359550 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e96f4b-a9c4-4b0f-8905-ffc3d0044014 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:36.359828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e96f4b-a9c4-4b0f-8905-ffc3d0044014 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:36.360654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e96f4b-a9c4-4b0f-8905-ffc3d0044014 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:36.360866 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e96f4b-a9c4-4b0f-8905-ffc3d0044014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:36.362400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e96f4b-a9c4-4b0f-8905-ffc3d0044014 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:36.371499 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298cfb5-c5b4-4787-b8aa-4cdee61209c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:36.372418 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298cfb5-c5b4-4787-b8aa-4cdee61209c8 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:36.372931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298cfb5-c5b4-4787-b8aa-4cdee61209c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:36.373416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298cfb5-c5b4-4787-b8aa-4cdee61209c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:36.379216 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:36.381351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 331/659] 10.222.0.73 () {56 vars in 1139 bytes} [Mon Aug 29 23:38:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:36.382239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298cfb5-c5b4-4787-b8aa-4cdee61209c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:36.384362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298cfb5-c5b4-4787-b8aa-4cdee61209c8 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:36.384706 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e96f4b-a9c4-4b0f-8905-ffc3d0044014 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-b298cfb5-c5b4-4787-b8aa-4cdee61209c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:36.401617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:36.402825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:36.404571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:36.404571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:36.404571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:36.404571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:36.404571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:36.404571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:36.404571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:36.404571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:36.404571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:38:36.404571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:36.407759 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 329/660] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:36.408804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298cfb5-c5b4-4787-b8aa-4cdee61209c8 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:36.521980 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298cfb5-c5b4-4787-b8aa-4cdee61209c8 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:36.530853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:36.531704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e96f4b-a9c4-4b0f-8905-ffc3d0044014 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:36.560529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c0855-f7be-4940-a86e-dd57c140eb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:36.561435 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c0855-f7be-4940-a86e-dd57c140eb3a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:36.561893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c0855-f7be-4940-a86e-dd57c140eb3a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:36.562369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c0855-f7be-4940-a86e-dd57c140eb3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:36.579934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632dbe1-65b5-48b5-ae55-79a19f961e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:36.580981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632dbe1-65b5-48b5-ae55-79a19f961e2c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:36.581359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632dbe1-65b5-48b5-ae55-79a19f961e2c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:36.581732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632dbe1-65b5-48b5-ae55-79a19f961e2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:36.591084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632dbe1-65b5-48b5-ae55-79a19f961e2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:36.593884 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632dbe1-65b5-48b5-ae55-79a19f961e2c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-5632dbe1-65b5-48b5-ae55-79a19f961e2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:36.610476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:36.611673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:36.612604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:36.612604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:36.612604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:36.612604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:36.612604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:36.612604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:36.612604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:36.612604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:36.613308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 332/661] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:36.614119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632dbe1-65b5-48b5-ae55-79a19f961e2c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:36.643877 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c0855-f7be-4940-a86e-dd57c140eb3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:36.645659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c0855-f7be-4940-a86e-dd57c140eb3a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:36.684002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:36.728397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632dbe1-65b5-48b5-ae55-79a19f961e2c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:36.761008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 330/662] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:36.761767 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c0855-f7be-4940-a86e-dd57c140eb3a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:36.770538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:36.782844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21475be-987f-4d28-9f5e-190544d4b74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:36.782844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21475be-987f-4d28-9f5e-190544d4b74f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:36.782844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21475be-987f-4d28-9f5e-190544d4b74f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:36.782844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21475be-987f-4d28-9f5e-190544d4b74f None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:36.783287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21475be-987f-4d28-9f5e-190544d4b74f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:36.783287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21475be-987f-4d28-9f5e-190544d4b74f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:36.783287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21475be-987f-4d28-9f5e-190544d4b74f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:36.803353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 333/663] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Aug 29 23:38:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:36.803353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed7e57-93a5-413e-b187-884a108cc701 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:36.803353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed7e57-93a5-413e-b187-884a108cc701 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:36.803353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed7e57-93a5-413e-b187-884a108cc701 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:36.803353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 334/664] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:36.803353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed7e57-93a5-413e-b187-884a108cc701 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:36.867766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c0855-f7be-4940-a86e-dd57c140eb3a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:36.903628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddf3c3-bd9e-47ec-af92-0b2ade0e0059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:36.905078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddf3c3-bd9e-47ec-af92-0b2ade0e0059 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:36.905515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddf3c3-bd9e-47ec-af92-0b2ade0e0059 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:36.905938 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddf3c3-bd9e-47ec-af92-0b2ade0e0059 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:36.907188 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddf3c3-bd9e-47ec-af92-0b2ade0e0059 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:36.907664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddf3c3-bd9e-47ec-af92-0b2ade0e0059 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:36.907973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed7e57-93a5-413e-b187-884a108cc701 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:36.909418 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddf3c3-bd9e-47ec-af92-0b2ade0e0059 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:36.925808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:36.926772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 331/665] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:36.927515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddf3c3-bd9e-47ec-af92-0b2ade0e0059 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:36.944661 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70cae4-ce05-4806-9fe3-2fecda54474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:36.945291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70cae4-ce05-4806-9fe3-2fecda54474b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:36.945569 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70cae4-ce05-4806-9fe3-2fecda54474b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:36.945838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70cae4-ce05-4806-9fe3-2fecda54474b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:36.958950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70cae4-ce05-4806-9fe3-2fecda54474b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:36.960372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70cae4-ce05-4806-9fe3-2fecda54474b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-4f70cae4-ce05-4806-9fe3-2fecda54474b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:36.977116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:36.978116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:36.979557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:36.979557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:36.979557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:36.979557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 335/666] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:36.979801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e76c3-1f72-4748-938f-4d9abc8b523f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:36.979986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e76c3-1f72-4748-938f-4d9abc8b523f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:36.980262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e76c3-1f72-4748-938f-4d9abc8b523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:36.998764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-996e76c3-1f72-4748-938f-4d9abc8b523f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:36.999990 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-996e76c3-1f72-4748-938f-4d9abc8b523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:37.006429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:37.043883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddf3c3-bd9e-47ec-af92-0b2ade0e0059 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:37.074286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 336/667] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:37.075397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e76c3-1f72-4748-938f-4d9abc8b523f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:37.087366 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d511228-3789-474b-8dee-f806e999ab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:37.087996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d511228-3789-474b-8dee-f806e999ab20 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:37.088276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d511228-3789-474b-8dee-f806e999ab20 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:37.088553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d511228-3789-474b-8dee-f806e999ab20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:37.165607 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d511228-3789-474b-8dee-f806e999ab20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:37.167237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d511228-3789-474b-8dee-f806e999ab20 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:37.190225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:37.194493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e76c3-1f72-4748-938f-4d9abc8b523f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:37.232521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f03b4-11b5-41aa-be31-833654abcdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:37.233132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f03b4-11b5-41aa-be31-833654abcdf8 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:37.233409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f03b4-11b5-41aa-be31-833654abcdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:37.233683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f03b4-11b5-41aa-be31-833654abcdf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:37.234456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f03b4-11b5-41aa-be31-833654abcdf8 None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=7a10328a436c4159b6519e5493ba57f8) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:37.234805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f03b4-11b5-41aa-be31-833654abcdf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:37.236378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f03b4-11b5-41aa-be31-833654abcdf8 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:37.247321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 337/668] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:37 2022] GET /identity/v3/role_assignments?user.id=7a10328a436c4159b6519e5493ba57f8&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:37.248604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f03b4-11b5-41aa-be31-833654abcdf8 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:37.249948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:37.346931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 332/669] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:37.352781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d511228-3789-474b-8dee-f806e999ab20 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:37.383490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f03b4-11b5-41aa-be31-833654abcdf8 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:37.420176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d3620-8c39-4372-ba68-b34707e17ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:37.420796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d3620-8c39-4372-ba68-b34707e17ddf None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:37.421075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d3620-8c39-4372-ba68-b34707e17ddf None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:37.421350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d3620-8c39-4372-ba68-b34707e17ddf None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:37.421996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d3620-8c39-4372-ba68-b34707e17ddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:37.422300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d3620-8c39-4372-ba68-b34707e17ddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:37.423699 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d3620-8c39-4372-ba68-b34707e17ddf None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:37.437445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 338/670] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:37.444586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d3620-8c39-4372-ba68-b34707e17ddf None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:37.479769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:37.481953 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d511228-3789-474b-8dee-f806e999ab20 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:37.525060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed54c7-9474-4549-ae73-d8b7fe752db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:37.525699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed54c7-9474-4549-ae73-d8b7fe752db3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:37.525951 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed54c7-9474-4549-ae73-d8b7fe752db3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:37.526218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed54c7-9474-4549-ae73-d8b7fe752db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:37.538867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed54c7-9474-4549-ae73-d8b7fe752db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:37.540695 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed54c7-9474-4549-ae73-d8b7fe752db3 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-65ed54c7-9474-4549-ae73-d8b7fe752db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:37.559621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:37.561197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:37.562109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:37.562109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:37.562109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:37.562109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 333/671] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:37.563281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed54c7-9474-4549-ae73-d8b7fe752db3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:37.577931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d3620-8c39-4372-ba68-b34707e17ddf None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:37.588792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:37.626039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0054e20-1f54-4436-a8c6-b39969bf87ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:37.626578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0054e20-1f54-4436-a8c6-b39969bf87ad None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:37.626850 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0054e20-1f54-4436-a8c6-b39969bf87ad None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:37.627141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0054e20-1f54-4436-a8c6-b39969bf87ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:37.638443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0054e20-1f54-4436-a8c6-b39969bf87ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:37.639910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0054e20-1f54-4436-a8c6-b39969bf87ad None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-e0054e20-1f54-4436-a8c6-b39969bf87ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:37.651568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:37.652568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:37.653476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:37.653476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:37.653476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:37.653476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:37.653476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:37.653476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:37.653476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:37.653476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:37.653476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 339/672] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:37.654021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0054e20-1f54-4436-a8c6-b39969bf87ad None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:37.700376 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed54c7-9474-4549-ae73-d8b7fe752db3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:37.746633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc90fb-94ec-4ad4-9326-66aab00a30c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:37.747654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc90fb-94ec-4ad4-9326-66aab00a30c3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:37.748146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc90fb-94ec-4ad4-9326-66aab00a30c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:37.748622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc90fb-94ec-4ad4-9326-66aab00a30c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:37.758578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:37.763159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc90fb-94ec-4ad4-9326-66aab00a30c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-8afc90fb-94ec-4ad4-9326-66aab00a30c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:37.769611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:37.772040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:37.772879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:37.772879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:37.772879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:37.772879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:37.772879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:37.772879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:37.772879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:37.772879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:37.772879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:37.772879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:37.772879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:37.772879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:37.779704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 334/673] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:37.779704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc90fb-94ec-4ad4-9326-66aab00a30c3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:37.785165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0054e20-1f54-4436-a8c6-b39969bf87ad None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:37.820160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a09841-2cf6-4610-bea1-2c54bd5d6154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:37.820790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a09841-2cf6-4610-bea1-2c54bd5d6154 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:37.821067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a09841-2cf6-4610-bea1-2c54bd5d6154 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:37.821334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a09841-2cf6-4610-bea1-2c54bd5d6154 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:37.821974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a09841-2cf6-4610-bea1-2c54bd5d6154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:37.822304 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a09841-2cf6-4610-bea1-2c54bd5d6154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:37.823649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a09841-2cf6-4610-bea1-2c54bd5d6154 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:37.835584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 340/674] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:37.836466 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a09841-2cf6-4610-bea1-2c54bd5d6154 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:37.890516 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:37.915542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc90fb-94ec-4ad4-9326-66aab00a30c3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:37.951482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d541a4-fe20-4e8b-8f12-443453f5d652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:37.952094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d541a4-fe20-4e8b-8f12-443453f5d652 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:37.952370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d541a4-fe20-4e8b-8f12-443453f5d652 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:37.952637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d541a4-fe20-4e8b-8f12-443453f5d652 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:37.953325 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d541a4-fe20-4e8b-8f12-443453f5d652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:37.953626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d541a4-fe20-4e8b-8f12-443453f5d652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:37.955178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d541a4-fe20-4e8b-8f12-443453f5d652 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:37.957701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a09841-2cf6-4610-bea1-2c54bd5d6154 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:37.968449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 335/675] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:37.969289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d541a4-fe20-4e8b-8f12-443453f5d652 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:38.006387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224ed2f-d6f0-41a8-88bf-832714ae3be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:38.007030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224ed2f-d6f0-41a8-88bf-832714ae3be7 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:38.007636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224ed2f-d6f0-41a8-88bf-832714ae3be7 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:38.007942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224ed2f-d6f0-41a8-88bf-832714ae3be7 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:38.009539 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224ed2f-d6f0-41a8-88bf-832714ae3be7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:38.009850 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224ed2f-d6f0-41a8-88bf-832714ae3be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:38.011248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224ed2f-d6f0-41a8-88bf-832714ae3be7 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:38.020952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 341/676] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:38.021753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224ed2f-d6f0-41a8-88bf-832714ae3be7 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:38.027148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:38.081334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d541a4-fe20-4e8b-8f12-443453f5d652 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:38.117124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d32ce-bbdd-4e47-9cf8-b1c8e6d639d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:38.117982 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d32ce-bbdd-4e47-9cf8-b1c8e6d639d7 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:38.118613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d32ce-bbdd-4e47-9cf8-b1c8e6d639d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:38.118912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d32ce-bbdd-4e47-9cf8-b1c8e6d639d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:38.125452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d32ce-bbdd-4e47-9cf8-b1c8e6d639d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:38.126903 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d32ce-bbdd-4e47-9cf8-b1c8e6d639d7 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:38.128576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:38.132014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224ed2f-d6f0-41a8-88bf-832714ae3be7 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-0f3d32ce-bbdd-4e47-9cf8-b1c8e6d639d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:38.138728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:38.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:38.140648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:38.140648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:38.140648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:38.140648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:38.140648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:38.140648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:38.140648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:38.140648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:38.140648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 336/677] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:38.141135 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d285d0-1b42-42cd-ac22-9ab791200757 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:38.141637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d285d0-1b42-42cd-ac22-9ab791200757 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:38.141637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d285d0-1b42-42cd-ac22-9ab791200757 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:38.146822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 337/678] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:38.146822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d285d0-1b42-42cd-ac22-9ab791200757 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:38.175248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec45147-c2bc-4226-99bb-d191c555e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:38.176206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec45147-c2bc-4226-99bb-d191c555e313 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:38.176488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec45147-c2bc-4226-99bb-d191c555e313 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:38.176917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec45147-c2bc-4226-99bb-d191c555e313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:38.177957 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec45147-c2bc-4226-99bb-d191c555e313 None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=707518bbe380425aa793f005548bc9d5) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:38.178411 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec45147-c2bc-4226-99bb-d191c555e313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:38.180151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec45147-c2bc-4226-99bb-d191c555e313 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:38.194994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 342/679] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:38 2022] GET /identity/v3/role_assignments?user.id=707518bbe380425aa793f005548bc9d5&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:38.194994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec45147-c2bc-4226-99bb-d191c555e313 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:38.263140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d285d0-1b42-42cd-ac22-9ab791200757 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:38.303945 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8c930-8567-4f52-84be-63fbe2db3b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:38.304622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8c930-8567-4f52-84be-63fbe2db3b8b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:38.304963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8c930-8567-4f52-84be-63fbe2db3b8b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:38.305241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8c930-8567-4f52-84be-63fbe2db3b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:38.307608 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:38.320111 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8c930-8567-4f52-84be-63fbe2db3b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:38.322135 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8c930-8567-4f52-84be-63fbe2db3b8b None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-6ef8c930-8567-4f52-84be-63fbe2db3b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:38.345089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:38.346108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:38.347040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:38.347040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:38.347040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:38.347040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 338/680] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:38.348768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f944-c298-4bb8-be03-f723a7466dd1 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:38.348768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f944-c298-4bb8-be03-f723a7466dd1 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:38.348768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f944-c298-4bb8-be03-f723a7466dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:38.358007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec45147-c2bc-4226-99bb-d191c555e313 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:38.370053 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-2264f944-c298-4bb8-be03-f723a7466dd1 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:38.371297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2264f944-c298-4bb8-be03-f723a7466dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:38.395442 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07d011-0ad6-4397-a72d-93b369ea8fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:38.396460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07d011-0ad6-4397-a72d-93b369ea8fc6 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:38.396914 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07d011-0ad6-4397-a72d-93b369ea8fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:38.397361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07d011-0ad6-4397-a72d-93b369ea8fc6 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:38.398288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07d011-0ad6-4397-a72d-93b369ea8fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:38.398397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07d011-0ad6-4397-a72d-93b369ea8fc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:38.399834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07d011-0ad6-4397-a72d-93b369ea8fc6 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:38.414135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 343/681] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:38.415318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07d011-0ad6-4397-a72d-93b369ea8fc6 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:38.432882 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:38.464955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 339/682] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:38.466134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264f944-c298-4bb8-be03-f723a7466dd1 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:38.582440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07d011-0ad6-4397-a72d-93b369ea8fc6 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:38.620840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:38.636600 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926951-eeda-416d-a390-62635d53c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:38.637179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264f944-c298-4bb8-be03-f723a7466dd1 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:38.638468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926951-eeda-416d-a390-62635d53c16b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:38.639104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926951-eeda-416d-a390-62635d53c16b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:38.639577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926951-eeda-416d-a390-62635d53c16b None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:38.640481 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32926951-eeda-416d-a390-62635d53c16b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:38.641023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32926951-eeda-416d-a390-62635d53c16b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:38.642599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32926951-eeda-416d-a390-62635d53c16b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:38.665555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 344/683] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:38.675928 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926951-eeda-416d-a390-62635d53c16b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:38.695241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60366589-50ab-444a-a03d-241216de40d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:38.695848 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60366589-50ab-444a-a03d-241216de40d5 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:38.696124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60366589-50ab-444a-a03d-241216de40d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:38.696392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60366589-50ab-444a-a03d-241216de40d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:38.697307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60366589-50ab-444a-a03d-241216de40d5 None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=ea872bd7ac2f4640a97648ccf96c02da) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:38.697612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60366589-50ab-444a-a03d-241216de40d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:38.699042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60366589-50ab-444a-a03d-241216de40d5 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:38.713468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 340/684] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:38 2022] GET /identity/v3/role_assignments?user.id=ea872bd7ac2f4640a97648ccf96c02da&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:38.792351 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60366589-50ab-444a-a03d-241216de40d5 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:38.829289 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926951-eeda-416d-a390-62635d53c16b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:38.883274 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:38.903670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a335a-bea6-4409-8f41-d4b936b9e459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:38.904793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a335a-bea6-4409-8f41-d4b936b9e459 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:38.905278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a335a-bea6-4409-8f41-d4b936b9e459 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:38.905751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a335a-bea6-4409-8f41-d4b936b9e459 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:38.918564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a335a-bea6-4409-8f41-d4b936b9e459 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:38.922134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a335a-bea6-4409-8f41-d4b936b9e459 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-1c8a335a-bea6-4409-8f41-d4b936b9e459 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:38.936540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:38.937521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:38.938447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:38.938447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:38.938447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:38.938447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:38.938447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:38.938447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:38.938447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:38.938447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:38.938447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:38:38.938447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:38.941434 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 345/685] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Aug 29 23:38:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:38.947680 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a335a-bea6-4409-8f41-d4b936b9e459 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:38.972627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60366589-50ab-444a-a03d-241216de40d5 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:39.008830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0358cfd-fcb6-4f5d-a948-e823acf1cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:39.009495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0358cfd-fcb6-4f5d-a948-e823acf1cd0a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:39.009607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:39.009771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0358cfd-fcb6-4f5d-a948-e823acf1cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:39.010042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0358cfd-fcb6-4f5d-a948-e823acf1cd0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:39.021836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0358cfd-fcb6-4f5d-a948-e823acf1cd0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-c0358cfd-fcb6-4f5d-a948-e823acf1cd0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:39.027920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:39.029489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:39.030534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 341/686] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:39.035544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0358cfd-fcb6-4f5d-a948-e823acf1cd0a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:39.073428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a335a-bea6-4409-8f41-d4b936b9e459 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:39.112709 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db8947-def9-4e45-b1cf-7298ef1fc694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:39.113400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db8947-def9-4e45-b1cf-7298ef1fc694 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:39.113679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db8947-def9-4e45-b1cf-7298ef1fc694 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:39.113952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db8947-def9-4e45-b1cf-7298ef1fc694 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:39.114717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db8947-def9-4e45-b1cf-7298ef1fc694 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:39.115120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db8947-def9-4e45-b1cf-7298ef1fc694 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:39.116624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db8947-def9-4e45-b1cf-7298ef1fc694 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:39.138953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 346/687] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Aug 29 23:38:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:39.140849 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0358cfd-fcb6-4f5d-a948-e823acf1cd0a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:39.143752 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:39.145352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db8947-def9-4e45-b1cf-7298ef1fc694 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:39.178914 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6debd-847a-41e9-b770-37ecf0bf959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:39.179444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6debd-847a-41e9-b770-37ecf0bf959e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:39.179725 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6debd-847a-41e9-b770-37ecf0bf959e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:39.180000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6debd-847a-41e9-b770-37ecf0bf959e None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:39.180769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6debd-847a-41e9-b770-37ecf0bf959e None admin] RBAC: Adding query filter params (name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:39.181080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6debd-847a-41e9-b770-37ecf0bf959e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:39.182447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6debd-847a-41e9-b770-37ecf0bf959e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:39.191679 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 342/688] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:39.197108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6debd-847a-41e9-b770-37ecf0bf959e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:39.274698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db8947-def9-4e45-b1cf-7298ef1fc694 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:39.283158 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:39.335361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222da5b7-534d-4dfd-bf25-944a5e933623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:39.335978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222da5b7-534d-4dfd-bf25-944a5e933623 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:39.336257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222da5b7-534d-4dfd-bf25-944a5e933623 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:39.336528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222da5b7-534d-4dfd-bf25-944a5e933623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:39.374158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6debd-847a-41e9-b770-37ecf0bf959e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:39.445261 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed267d-d6aa-475f-ba76-3ebb6e74069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:39.445820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed267d-d6aa-475f-ba76-3ebb6e74069e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:39.446109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed267d-d6aa-475f-ba76-3ebb6e74069e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:39.451023 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed267d-d6aa-475f-ba76-3ebb6e74069e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:39.462724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222da5b7-534d-4dfd-bf25-944a5e933623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:39.464278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222da5b7-534d-4dfd-bf25-944a5e933623 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:39.476344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed267d-d6aa-475f-ba76-3ebb6e74069e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:39.477779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed267d-d6aa-475f-ba76-3ebb6e74069e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-0eed267d-d6aa-475f-ba76-3ebb6e74069e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:39.492637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:39.493631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:39.495253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:39.495253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:39.495253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:39.495253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 343/689] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:39.495253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b51b2-9b04-4a63-985a-04546814b55b None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:39.495529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b51b2-9b04-4a63-985a-04546814b55b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:39.495755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b51b2-9b04-4a63-985a-04546814b55b None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:39.497267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 344/690] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:39.499949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b51b2-9b04-4a63-985a-04546814b55b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:39.543299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:39.574682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 347/691] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:39.576079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b17c19-b3a0-4692-a5d4-6c220539bf20 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:39.576359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b17c19-b3a0-4692-a5d4-6c220539bf20 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:39.576629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b17c19-b3a0-4692-a5d4-6c220539bf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:39.588483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:39.594594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-24b17c19-b3a0-4692-a5d4-6c220539bf20 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:39.595841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-24b17c19-b3a0-4692-a5d4-6c220539bf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:39.627469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b51b2-9b04-4a63-985a-04546814b55b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:39.666675 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cf965-6252-44c1-b5fb-9294160e9038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:39.668161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cf965-6252-44c1-b5fb-9294160e9038 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:39.668629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cf965-6252-44c1-b5fb-9294160e9038 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:39.669084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cf965-6252-44c1-b5fb-9294160e9038 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:39.670529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cf965-6252-44c1-b5fb-9294160e9038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:39.671174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cf965-6252-44c1-b5fb-9294160e9038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:39.671473 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 348/692] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:39.672842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b17c19-b3a0-4692-a5d4-6c220539bf20 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:39.683123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cf965-6252-44c1-b5fb-9294160e9038 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:39.701599 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 345/693] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:39.706565 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cf965-6252-44c1-b5fb-9294160e9038 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:39.784603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b17c19-b3a0-4692-a5d4-6c220539bf20 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:39.820353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb28e0f-84dd-4fe5-84ba-865048f8a3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:39.821412 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb28e0f-84dd-4fe5-84ba-865048f8a3f3 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:39.821903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb28e0f-84dd-4fe5-84ba-865048f8a3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:39.822375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb28e0f-84dd-4fe5-84ba-865048f8a3f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:39.835460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:39.845582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb28e0f-84dd-4fe5-84ba-865048f8a3f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:39.847062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb28e0f-84dd-4fe5-84ba-865048f8a3f3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:39.852514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-bdb28e0f-84dd-4fe5-84ba-865048f8a3f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:39.876082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:39.885683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:39.886627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:39.886627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:39.886627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:39.886627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 349/694] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:39.886627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb28e0f-84dd-4fe5-84ba-865048f8a3f3 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:39.901035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cf965-6252-44c1-b5fb-9294160e9038 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:40.004223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb28e0f-84dd-4fe5-84ba-865048f8a3f3 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:40.032131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337a587-2be2-403b-91e1-37a277f1618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:40.032783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337a587-2be2-403b-91e1-37a277f1618b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:40.033065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337a587-2be2-403b-91e1-37a277f1618b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:40.033340 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337a587-2be2-403b-91e1-37a277f1618b None admin] PATH_INFO: `/v3/users/swift` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:40.039373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09899496-7ade-486a-a881-e0db5a064025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:40.039984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09899496-7ade-486a-a881-e0db5a064025 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:40.040264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09899496-7ade-486a-a881-e0db5a064025 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:40.040539 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09899496-7ade-486a-a881-e0db5a064025 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:40.041179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09899496-7ade-486a-a881-e0db5a064025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:40.041479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09899496-7ade-486a-a881-e0db5a064025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:40.043061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09899496-7ade-486a-a881-e0db5a064025 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:40.052159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337a587-2be2-403b-91e1-37a277f1618b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:40.053611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337a587-2be2-403b-91e1-37a277f1618b None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:40.056424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 350/695] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:40.063932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09899496-7ade-486a-a881-e0db5a064025 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-2337a587-2be2-403b-91e1-37a277f1618b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:40.065615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:40.066552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:40.067523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:40.067523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:40.067523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:40.067523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:40.067523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:40.067523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:40.067523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:40.067523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:40.067523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:38:40.067523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:40.071071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 346/696] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:40.072366 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337a587-2be2-403b-91e1-37a277f1618b None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:40.123512 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:40.179252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09899496-7ade-486a-a881-e0db5a064025 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:40.202804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337a587-2be2-403b-91e1-37a277f1618b None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:40.221000 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae0f18-fc35-4169-a0b1-f1c039169d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:40.221726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae0f18-fc35-4169-a0b1-f1c039169d00 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:40.222001 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae0f18-fc35-4169-a0b1-f1c039169d00 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:40.222272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae0f18-fc35-4169-a0b1-f1c039169d00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:40.235895 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae0f18-fc35-4169-a0b1-f1c039169d00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:40.238280 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae0f18-fc35-4169-a0b1-f1c039169d00 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:40.244424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73cae9-806b-4de2-9f59-72eabafcd7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:40.245038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73cae9-806b-4de2-9f59-72eabafcd7a8 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:40.245318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73cae9-806b-4de2-9f59-72eabafcd7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:40.245593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73cae9-806b-4de2-9f59-72eabafcd7a8 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:40.246327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73cae9-806b-4de2-9f59-72eabafcd7a8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:40.246639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73cae9-806b-4de2-9f59-72eabafcd7a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:40.248742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73cae9-806b-4de2-9f59-72eabafcd7a8 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-f1ae0f18-fc35-4169-a0b1-f1c039169d00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:40.255549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:40.256446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:40.257301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:40.257301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:40.257301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:40.257301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:40.257301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:40.257301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:40.257301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:40.257301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:40.259913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 351/697] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:40.260954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae0f18-fc35-4169-a0b1-f1c039169d00 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:40.261612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:40.280149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 347/698] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Aug 29 23:38:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:40.281515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73cae9-806b-4de2-9f59-72eabafcd7a8 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:40.379379 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae0f18-fc35-4169-a0b1-f1c039169d00 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:40.389831 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:40.393505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73cae9-806b-4de2-9f59-72eabafcd7a8 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:40.420061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486f333-8586-47db-893b-6f162c0a1c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:40.421270 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f333-8586-47db-893b-6f162c0a1c8d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:40.422944 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f333-8586-47db-893b-6f162c0a1c8d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:40.423572 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f333-8586-47db-893b-6f162c0a1c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:40.429719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13bab6-4fe9-4395-a58b-d75f21558432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:40.430323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13bab6-4fe9-4395-a58b-d75f21558432 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:40.430602 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13bab6-4fe9-4395-a58b-d75f21558432 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:40.430872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13bab6-4fe9-4395-a58b-d75f21558432 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:40.431594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13bab6-4fe9-4395-a58b-d75f21558432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:40.432126 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13bab6-4fe9-4395-a58b-d75f21558432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:40.433299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13bab6-4fe9-4395-a58b-d75f21558432 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:40.436383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486f333-8586-47db-893b-6f162c0a1c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:40.437814 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486f333-8586-47db-893b-6f162c0a1c8d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:40.445994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 348/699] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:40.446854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13bab6-4fe9-4395-a58b-d75f21558432 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-4486f333-8586-47db-893b-6f162c0a1c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:40.457347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:40.458281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:40.462658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:40.462658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:40.462658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:40.462658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 352/700] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:40.462658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9dbda-6f4f-4c31-b55e-c03c45b55d6e None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:40.462658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9dbda-6f4f-4c31-b55e-c03c45b55d6e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:40.462658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9dbda-6f4f-4c31-b55e-c03c45b55d6e None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:40.462658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 353/701] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:40.462658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9dbda-6f4f-4c31-b55e-c03c45b55d6e None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:40.518463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:40.566549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13bab6-4fe9-4395-a58b-d75f21558432 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:40.570233 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9dbda-6f4f-4c31-b55e-c03c45b55d6e None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:40.604761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65b61c-7ec5-4d47-94bc-244b71f7e653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:40.605379 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65b61c-7ec5-4d47-94bc-244b71f7e653 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:40.605635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9cbb5-35e2-468e-aa34-fe21f8154478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:40.605771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65b61c-7ec5-4d47-94bc-244b71f7e653 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:40.605960 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65b61c-7ec5-4d47-94bc-244b71f7e653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:40.606240 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9cbb5-35e2-468e-aa34-fe21f8154478 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:40.606582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9cbb5-35e2-468e-aa34-fe21f8154478 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:40.607387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9cbb5-35e2-468e-aa34-fe21f8154478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:40.608236 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9cbb5-35e2-468e-aa34-fe21f8154478 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=59a1b0b274294a288dbf07cd99f95407) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:40.608551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9cbb5-35e2-468e-aa34-fe21f8154478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:40.610012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9cbb5-35e2-468e-aa34-fe21f8154478 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:40.615935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 354/702] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:40 2022] GET /identity/v3/role_assignments?user.id=59a1b0b274294a288dbf07cd99f95407&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:40.617106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11254af1-995d-4227-ba74-fddcd9fa209b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:40.617397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11254af1-995d-4227-ba74-fddcd9fa209b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:40.617673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11254af1-995d-4227-ba74-fddcd9fa209b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:40.637790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-11254af1-995d-4227-ba74-fddcd9fa209b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:40.639142 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-11254af1-995d-4227-ba74-fddcd9fa209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:40.659636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:40.700446 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65b61c-7ec5-4d47-94bc-244b71f7e653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:40.703417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65b61c-7ec5-4d47-94bc-244b71f7e653 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:40.723810 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 355/703] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:40.725032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11254af1-995d-4227-ba74-fddcd9fa209b None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:40.779972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:40.829945 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 349/704] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:38:40.835335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65b61c-7ec5-4d47-94bc-244b71f7e653 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:40.903347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11254af1-995d-4227-ba74-fddcd9fa209b None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:40.944865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f540f4-9c19-4bff-b39a-9bd4b6c06a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:40.945531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f540f4-9c19-4bff-b39a-9bd4b6c06a58 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:40.945819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f540f4-9c19-4bff-b39a-9bd4b6c06a58 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:40.946093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f540f4-9c19-4bff-b39a-9bd4b6c06a58 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:40.946976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f540f4-9c19-4bff-b39a-9bd4b6c06a58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:40.947295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f540f4-9c19-4bff-b39a-9bd4b6c06a58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:40.948662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f540f4-9c19-4bff-b39a-9bd4b6c06a58 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:40.964666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 356/705] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:40.971749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f540f4-9c19-4bff-b39a-9bd4b6c06a58 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:41.002701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:41.018449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65b61c-7ec5-4d47-94bc-244b71f7e653 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:41.063627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5636b0-96b6-473a-b767-c823a32e124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:41.064636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5636b0-96b6-473a-b767-c823a32e124f None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:41.065388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5636b0-96b6-473a-b767-c823a32e124f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:41.066068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5636b0-96b6-473a-b767-c823a32e124f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:41.079754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5636b0-96b6-473a-b767-c823a32e124f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:41.082370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5636b0-96b6-473a-b767-c823a32e124f None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-0c5636b0-96b6-473a-b767-c823a32e124f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:41.101305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:41.102442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:41.103455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:41.103455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:41.103455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:41.106322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 350/706] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:41.107562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5636b0-96b6-473a-b767-c823a32e124f None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:41.118224 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f540f4-9c19-4bff-b39a-9bd4b6c06a58 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:41.122352 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:41.162619 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093d672-c811-4530-83cd-ab50e6abb08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:41.164057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093d672-c811-4530-83cd-ab50e6abb08b None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:41.164578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093d672-c811-4530-83cd-ab50e6abb08b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:41.165031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093d672-c811-4530-83cd-ab50e6abb08b None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:41.165825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093d672-c811-4530-83cd-ab50e6abb08b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:41.167986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093d672-c811-4530-83cd-ab50e6abb08b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:41.222152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5636b0-96b6-473a-b767-c823a32e124f None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:41.255371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f56482-0cde-4499-be71-2ee3574aae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:41.263668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f56482-0cde-4499-be71-2ee3574aae9d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:41.263668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f56482-0cde-4499-be71-2ee3574aae9d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:41.263668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f56482-0cde-4499-be71-2ee3574aae9d None admin] PATH_INFO: `/v3/services/network` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:41.263668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f56482-0cde-4499-be71-2ee3574aae9d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:41.263668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f56482-0cde-4499-be71-2ee3574aae9d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-c9f56482-0cde-4499-be71-2ee3574aae9d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:41.270027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:41.271200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:41.272108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 351/707] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:41 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:41.272924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f56482-0cde-4499-be71-2ee3574aae9d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:41.292841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 357/708] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:38:40 2022] POST /identity/v3/users => generated 254 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:38:41.297758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb5b95-eca9-4c8e-af17-8544a5545485 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:41.297758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb5b95-eca9-4c8e-af17-8544a5545485 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:41.297758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb5b95-eca9-4c8e-af17-8544a5545485 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:41.297758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 358/709] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:41.297758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb5b95-eca9-4c8e-af17-8544a5545485 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:41.377070 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:41.404765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:41.417656 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f56482-0cde-4499-be71-2ee3574aae9d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:41.448651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb5b95-eca9-4c8e-af17-8544a5545485 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:41.461974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fca786-2b63-4d5f-ab17-355e6fd86948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:41.462592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fca786-2b63-4d5f-ab17-355e6fd86948 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:41.462937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fca786-2b63-4d5f-ab17-355e6fd86948 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:41.463180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fca786-2b63-4d5f-ab17-355e6fd86948 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:41.463870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fca786-2b63-4d5f-ab17-355e6fd86948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:41.464219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fca786-2b63-4d5f-ab17-355e6fd86948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:41.465635 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fca786-2b63-4d5f-ab17-355e6fd86948 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:41.480143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 352/710] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:41.486630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa1f66-c452-447c-b235-2de1284e76d3 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:41.486630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa1f66-c452-447c-b235-2de1284e76d3 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:41.486630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa1f66-c452-447c-b235-2de1284e76d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:41.488135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b319237-ad0c-4ce0-9b93-f3ba197a3467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:41.488922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b319237-ad0c-4ce0-9b93-f3ba197a3467 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:41.489430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b319237-ad0c-4ce0-9b93-f3ba197a3467 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:41.489934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b319237-ad0c-4ce0-9b93-f3ba197a3467 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:41.490951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b319237-ad0c-4ce0-9b93-f3ba197a3467 None admin] RBAC: Adding query filter params (name=network) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:41.491259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b319237-ad0c-4ce0-9b93-f3ba197a3467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:41.492632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b319237-ad0c-4ce0-9b93-f3ba197a3467 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:41.497585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 359/711] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:38:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:41.498252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b319237-ad0c-4ce0-9b93-f3ba197a3467 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:41.502625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-e6fa1f66-c452-447c-b235-2de1284e76d3 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:41.504159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e6fa1f66-c452-447c-b235-2de1284e76d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:41.583367 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 353/712] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:41.584218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa1f66-c452-447c-b235-2de1284e76d3 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:41.651232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b319237-ad0c-4ce0-9b93-f3ba197a3467 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:41.694780 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:41.713729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98488d-8af4-415e-8380-6f5579eb49cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:41.714719 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98488d-8af4-415e-8380-6f5579eb49cc None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:41.716929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98488d-8af4-415e-8380-6f5579eb49cc None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:41.716929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98488d-8af4-415e-8380-6f5579eb49cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:41.719041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:41.726149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98488d-8af4-415e-8380-6f5579eb49cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:41.728574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98488d-8af4-415e-8380-6f5579eb49cc None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:41.750975 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa1f66-c452-447c-b235-2de1284e76d3 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-8d98488d-8af4-415e-8380-6f5579eb49cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:41.755750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:41.756867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:41.759026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:41.759026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:41.759026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:41.759026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:41.759026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:41.759026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:41.759026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:41.759026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:41.759026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 360/713] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:41.766689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98488d-8af4-415e-8380-6f5579eb49cc None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:41.814791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd731dc-d395-4fc0-8414-af8c294ae030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:41.815434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd731dc-d395-4fc0-8414-af8c294ae030 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:41.815717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd731dc-d395-4fc0-8414-af8c294ae030 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:41.815992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd731dc-d395-4fc0-8414-af8c294ae030 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:41.816627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd731dc-d395-4fc0-8414-af8c294ae030 None admin] RBAC: Adding query filter params (type=network) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:41.816931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd731dc-d395-4fc0-8414-af8c294ae030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:41.818322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd731dc-d395-4fc0-8414-af8c294ae030 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:41.831436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 354/714] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:38:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:41.912804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98488d-8af4-415e-8380-6f5579eb49cc None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:41.954421 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd731dc-d395-4fc0-8414-af8c294ae030 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:41.959899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39e65e-979d-421b-882b-776aa70a9c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:41.960801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39e65e-979d-421b-882b-776aa70a9c79 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:41.961235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39e65e-979d-421b-882b-776aa70a9c79 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:41.961682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39e65e-979d-421b-882b-776aa70a9c79 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:41.962560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39e65e-979d-421b-882b-776aa70a9c79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:41.963889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39e65e-979d-421b-882b-776aa70a9c79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:41.966195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39e65e-979d-421b-882b-776aa70a9c79 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:41.987187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 361/715] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:41.990475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39e65e-979d-421b-882b-776aa70a9c79 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:42.078059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:42.105563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd731dc-d395-4fc0-8414-af8c294ae030 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:42.129932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39e65e-979d-421b-882b-776aa70a9c79 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:42.136915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:42.147693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcd7db-46bc-41f1-819b-7f9b1677200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:42.148681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcd7db-46bc-41f1-819b-7f9b1677200c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:42.148969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcd7db-46bc-41f1-819b-7f9b1677200c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:42.149486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcd7db-46bc-41f1-819b-7f9b1677200c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:42.150123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcd7db-46bc-41f1-819b-7f9b1677200c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:42.151744 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcd7db-46bc-41f1-819b-7f9b1677200c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-debcd7db-46bc-41f1-819b-7f9b1677200c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:42.163983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:42.165088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:42.165946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 355/716] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Aug 29 23:38:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:42.173029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcd7db-46bc-41f1-819b-7f9b1677200c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:42.177434 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ab7b0-6d60-4db4-893d-5f70b4c99e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:42.178050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ab7b0-6d60-4db4-893d-5f70b4c99e0f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:42.178327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ab7b0-6d60-4db4-893d-5f70b4c99e0f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:42.178612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ab7b0-6d60-4db4-893d-5f70b4c99e0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:42.180233 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ab7b0-6d60-4db4-893d-5f70b4c99e0f None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=a75fb249079b4831be08cc4c9f94d6df) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:42.180555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ab7b0-6d60-4db4-893d-5f70b4c99e0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:42.181983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ab7b0-6d60-4db4-893d-5f70b4c99e0f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:42.190745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 362/717] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:41 2022] GET /identity/v3/role_assignments?user.id=a75fb249079b4831be08cc4c9f94d6df&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:42.293972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcd7db-46bc-41f1-819b-7f9b1677200c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:42.332620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325bbd1-053a-467c-9d56-f50949250b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:42.333480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325bbd1-053a-467c-9d56-f50949250b5e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:42.333932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325bbd1-053a-467c-9d56-f50949250b5e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:42.334363 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325bbd1-053a-467c-9d56-f50949250b5e None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:42.335199 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325bbd1-053a-467c-9d56-f50949250b5e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:42.335667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325bbd1-053a-467c-9d56-f50949250b5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:42.337251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325bbd1-053a-467c-9d56-f50949250b5e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:42.343470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 356/718] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Aug 29 23:38:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:42.349417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ab7b0-6d60-4db4-893d-5f70b4c99e0f None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:42.486136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ab7b0-6d60-4db4-893d-5f70b4c99e0f None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:42.503929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:42.521200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e58368-87f3-4bbf-af7b-acc08706522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:42.521813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e58368-87f3-4bbf-af7b-acc08706522d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:42.522089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e58368-87f3-4bbf-af7b-acc08706522d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:42.522358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e58368-87f3-4bbf-af7b-acc08706522d None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:42.523030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e58368-87f3-4bbf-af7b-acc08706522d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:42.523333 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e58368-87f3-4bbf-af7b-acc08706522d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:42.524695 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e58368-87f3-4bbf-af7b-acc08706522d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:42.530949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 363/719] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Aug 29 23:38:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:42.784457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f1e49-7877-447f-957c-de0eeb91722f None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:42.785402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f1e49-7877-447f-957c-de0eeb91722f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:42.785902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f1e49-7877-447f-957c-de0eeb91722f None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:42.787746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 357/720] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:42.793839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865d553-cc55-451f-a29d-a18c2404664b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:42.794709 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865d553-cc55-451f-a29d-a18c2404664b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:42.795226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865d553-cc55-451f-a29d-a18c2404664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:42.817866 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d865d553-cc55-451f-a29d-a18c2404664b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:42.819099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d865d553-cc55-451f-a29d-a18c2404664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:42.892917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 364/721] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:43.202472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f1e49-7877-447f-957c-de0eeb91722f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:43.288092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:43.340317 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f1e49-7877-447f-957c-de0eeb91722f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:43.376765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a61558-a4b2-487f-8490-a368b1ca6c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:43.377772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a61558-a4b2-487f-8490-a368b1ca6c36 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:43.378288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a61558-a4b2-487f-8490-a368b1ca6c36 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:43.378771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a61558-a4b2-487f-8490-a368b1ca6c36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:43.389633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a61558-a4b2-487f-8490-a368b1ca6c36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-74a61558-a4b2-487f-8490-a368b1ca6c36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:43.395230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:43.396160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:43.397000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:43.397000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:43.397000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:43.397000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:43.397000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:43.397000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:43.397000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:43.397000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:43.397000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:43.397000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:43.397000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:43.397000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:43.399616 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 358/722] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:43.406925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865d553-cc55-451f-a29d-a18c2404664b None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:43.530048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865d553-cc55-451f-a29d-a18c2404664b None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:43.543658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:43.566069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a38fe-e2a4-4cd2-ace5-ec8979a1503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:43.566688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a38fe-e2a4-4cd2-ace5-ec8979a1503f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:43.566992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a38fe-e2a4-4cd2-ace5-ec8979a1503f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:43.567269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a38fe-e2a4-4cd2-ace5-ec8979a1503f None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:43.567933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a38fe-e2a4-4cd2-ace5-ec8979a1503f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:43.568232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a38fe-e2a4-4cd2-ace5-ec8979a1503f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:43.569607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a38fe-e2a4-4cd2-ace5-ec8979a1503f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:43.578710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 365/723] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:43.584431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a61558-a4b2-487f-8490-a368b1ca6c36 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:43.717693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c03b10-aa5a-40ba-97c6-0f4e7da44b18 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:43.718083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c03b10-aa5a-40ba-97c6-0f4e7da44b18 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:43.718262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c03b10-aa5a-40ba-97c6-0f4e7da44b18 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:43.723369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 366/724] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:43.726223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a61558-a4b2-487f-8490-a368b1ca6c36 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:43.732382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e52cc-8079-49e2-ab09-c9ae48bf5276 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:43.732382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e52cc-8079-49e2-ab09-c9ae48bf5276 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:43.732382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e52cc-8079-49e2-ab09-c9ae48bf5276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:43.743249 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:43.765272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f443f-d03b-4705-ae60-6e8e29975898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:43.765917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f443f-d03b-4705-ae60-6e8e29975898 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:43.766200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f443f-d03b-4705-ae60-6e8e29975898 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:43.766475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f443f-d03b-4705-ae60-6e8e29975898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:43.775877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d20e52cc-8079-49e2-ab09-c9ae48bf5276 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:43.777101 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d20e52cc-8079-49e2-ab09-c9ae48bf5276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:43.777633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f443f-d03b-4705-ae60-6e8e29975898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:43.779640 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f443f-d03b-4705-ae60-6e8e29975898 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-755f443f-d03b-4705-ae60-6e8e29975898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:43.795194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:43.796742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:43.797630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:43.797630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:43.797630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:43.797630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 359/725] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:43.808822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f443f-d03b-4705-ae60-6e8e29975898 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:43.907575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 367/726] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:43.970639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f443f-d03b-4705-ae60-6e8e29975898 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:44.019050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f09363-95e9-4901-9f89-fa5957294083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:44.019659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09363-95e9-4901-9f89-fa5957294083 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:44.019941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09363-95e9-4901-9f89-fa5957294083 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:44.020213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09363-95e9-4901-9f89-fa5957294083 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:44.020850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f09363-95e9-4901-9f89-fa5957294083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:44.021151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f09363-95e9-4901-9f89-fa5957294083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:44.022517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f09363-95e9-4901-9f89-fa5957294083 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:44.041154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 360/727] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:44.047087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e52cc-8079-49e2-ab09-c9ae48bf5276 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:44.194177 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e52cc-8079-49e2-ab09-c9ae48bf5276 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:44.196981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:44.208325 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d77e61-349d-43ed-9e73-1c1aaf7a3997 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:44.208946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d77e61-349d-43ed-9e73-1c1aaf7a3997 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:44.209436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d77e61-349d-43ed-9e73-1c1aaf7a3997 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:44.211296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 361/728] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:38:44.217686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee5dcd-c6c4-4901-98de-5c3d8283bc9d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:44.217971 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee5dcd-c6c4-4901-98de-5c3d8283bc9d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:44.218461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee5dcd-c6c4-4901-98de-5c3d8283bc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:44.238202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529729ab-1622-429e-8956-9b695ad4acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:44.238440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-e4ee5dcd-c6c4-4901-98de-5c3d8283bc9d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:44.239402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529729ab-1622-429e-8956-9b695ad4acf7 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:44.239602 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e4ee5dcd-c6c4-4901-98de-5c3d8283bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:44.240071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529729ab-1622-429e-8956-9b695ad4acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:44.240562 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529729ab-1622-429e-8956-9b695ad4acf7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:44.252293 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529729ab-1622-429e-8956-9b695ad4acf7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:44.254693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529729ab-1622-429e-8956-9b695ad4acf7 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:44.267373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-529729ab-1622-429e-8956-9b695ad4acf7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:44.269668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:44.277779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:44.279329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:44.279329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:44.279329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:44.279329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:44.279329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:44.279329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:44.279329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:44.279329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:44.279329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:38:44.279329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:44.279329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 368/729] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Aug 29 23:38:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:44.279329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529729ab-1622-429e-8956-9b695ad4acf7 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:44.334916 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 362/730] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:38:44.336192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee5dcd-c6c4-4901-98de-5c3d8283bc9d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:44.402030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529729ab-1622-429e-8956-9b695ad4acf7 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:44.440643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ea004-b881-4bea-aa45-cc3547e92b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:44.441271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea004-b881-4bea-aa45-cc3547e92b62 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:44.441553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea004-b881-4bea-aa45-cc3547e92b62 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:44.441820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea004-b881-4bea-aa45-cc3547e92b62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:44.453872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ea004-b881-4bea-aa45-cc3547e92b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-2a2ea004-b881-4bea-aa45-cc3547e92b62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:44.459508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:44.460447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:44.461282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:44.461282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:44.461282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:44.461282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:44.461282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:44.461282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:44.461282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:44.461282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:44.461282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:44.461282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:44.461282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:44.461282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:44.461942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 369/731] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:44.467056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ea004-b881-4bea-aa45-cc3547e92b62 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:44.523010 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:44.528570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee5dcd-c6c4-4901-98de-5c3d8283bc9d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:44.569222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c2dd3-83dc-44d4-ade9-5f52daec31d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:44.570183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c2dd3-83dc-44d4-ade9-5f52daec31d3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:44.570858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c2dd3-83dc-44d4-ade9-5f52daec31d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:44.571354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c2dd3-83dc-44d4-ade9-5f52daec31d3 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:44.572280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c2dd3-83dc-44d4-ade9-5f52daec31d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:44.572824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c2dd3-83dc-44d4-ade9-5f52daec31d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:44.574451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c2dd3-83dc-44d4-ade9-5f52daec31d3 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:44.595188 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 363/732] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Aug 29 23:38:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:44.601773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c2dd3-83dc-44d4-ade9-5f52daec31d3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:44.620998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:44.685544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ea004-b881-4bea-aa45-cc3547e92b62 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:44.723578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1d11e-24b4-4d10-a10c-2d0d7a363c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:44.724213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1d11e-24b4-4d10-a10c-2d0d7a363c66 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:44.724493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1d11e-24b4-4d10-a10c-2d0d7a363c66 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:44.724780 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1d11e-24b4-4d10-a10c-2d0d7a363c66 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:44.725553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1d11e-24b4-4d10-a10c-2d0d7a363c66 None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:44.725875 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1d11e-24b4-4d10-a10c-2d0d7a363c66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:44.727430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1d11e-24b4-4d10-a10c-2d0d7a363c66 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:44.730556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c2dd3-83dc-44d4-ade9-5f52daec31d3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:44.737086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 370/733] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:44.742228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1d11e-24b4-4d10-a10c-2d0d7a363c66 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:44.779358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca46d4-f255-4179-9ffb-75e2c9dbb95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:44.780626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca46d4-f255-4179-9ffb-75e2c9dbb95d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:44.781979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca46d4-f255-4179-9ffb-75e2c9dbb95d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:44.782461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca46d4-f255-4179-9ffb-75e2c9dbb95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:44.796421 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca46d4-f255-4179-9ffb-75e2c9dbb95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:44.799196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca46d4-f255-4179-9ffb-75e2c9dbb95d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-87ca46d4-f255-4179-9ffb-75e2c9dbb95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:44.820014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:44.821003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:44.821963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:44.821963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:44.821963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:44.829040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 364/734] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:44.830027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca46d4-f255-4179-9ffb-75e2c9dbb95d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:44.840599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:44.860385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1d11e-24b4-4d10-a10c-2d0d7a363c66 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:44.899139 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25848d52-85de-49c0-b4f7-9ac7b0e0de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:44.900024 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25848d52-85de-49c0-b4f7-9ac7b0e0de12 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:44.900453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25848d52-85de-49c0-b4f7-9ac7b0e0de12 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:44.900859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:44.900997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25848d52-85de-49c0-b4f7-9ac7b0e0de12 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:44.901525 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25848d52-85de-49c0-b4f7-9ac7b0e0de12 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:44.902903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25848d52-85de-49c0-b4f7-9ac7b0e0de12 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:44.938509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca46d4-f255-4179-9ffb-75e2c9dbb95d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:44.972254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321208a-4c4b-4488-8bf8-75cadfc4ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:44.972880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321208a-4c4b-4488-8bf8-75cadfc4ba84 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:44.973163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321208a-4c4b-4488-8bf8-75cadfc4ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:44.973438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321208a-4c4b-4488-8bf8-75cadfc4ba84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:44.985176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321208a-4c4b-4488-8bf8-75cadfc4ba84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:44.986775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321208a-4c4b-4488-8bf8-75cadfc4ba84 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:45.000407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 371/735] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:38:44 2022] POST /identity/v3/services => generated 240 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-9321208a-4c4b-4488-8bf8-75cadfc4ba84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:45.003268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:45.004196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:45.005089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:45.005089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:45.005089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:45.008169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 365/736] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:45.009190 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25848d52-85de-49c0-b4f7-9ac7b0e0de12 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:45.009625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871217-ee79-4c71-8d63-f20c61fb91e4 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:45.009881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871217-ee79-4c71-8d63-f20c61fb91e4 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:45.010155 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871217-ee79-4c71-8d63-f20c61fb91e4 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:45.015879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 366/737] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:45.015879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871217-ee79-4c71-8d63-f20c61fb91e4 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:45.155838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871217-ee79-4c71-8d63-f20c61fb91e4 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:45.160435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25848d52-85de-49c0-b4f7-9ac7b0e0de12 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:45.173415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:45.198178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f02e7-61ba-4017-832d-5b9500e91cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:45.198851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f02e7-61ba-4017-832d-5b9500e91cce None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:45.199165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f02e7-61ba-4017-832d-5b9500e91cce None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:45.199441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f02e7-61ba-4017-832d-5b9500e91cce None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:45.200134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f02e7-61ba-4017-832d-5b9500e91cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:45.200464 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f02e7-61ba-4017-832d-5b9500e91cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:45.201580 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b0eb5-276d-49aa-bd16-047c3cb6628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:45.201820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f02e7-61ba-4017-832d-5b9500e91cce None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:45.202194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b0eb5-276d-49aa-bd16-047c3cb6628b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:45.202474 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b0eb5-276d-49aa-bd16-047c3cb6628b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:45.202749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b0eb5-276d-49aa-bd16-047c3cb6628b None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:45.203427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b0eb5-276d-49aa-bd16-047c3cb6628b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:45.203741 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b0eb5-276d-49aa-bd16-047c3cb6628b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:45.205480 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b0eb5-276d-49aa-bd16-047c3cb6628b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:45.219303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 367/738] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:45.220572 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 372/739] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:45.220686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e656afb-3e6b-4bc8-803e-aef965110ef7 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:45.221742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e656afb-3e6b-4bc8-803e-aef965110ef7 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:45.221742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e656afb-3e6b-4bc8-803e-aef965110ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:45.226789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b0eb5-276d-49aa-bd16-047c3cb6628b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:45.230014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:45.248447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-9e656afb-3e6b-4bc8-803e-aef965110ef7 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:45.250362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9e656afb-3e6b-4bc8-803e-aef965110ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:45.327241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 368/740] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:45 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:45.335123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e656afb-3e6b-4bc8-803e-aef965110ef7 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:45.347403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b0eb5-276d-49aa-bd16-047c3cb6628b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:45.395183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63bba2-00b4-4098-a730-cec46adf8e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:45.395848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63bba2-00b4-4098-a730-cec46adf8e8d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:45.396515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63bba2-00b4-4098-a730-cec46adf8e8d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:45.396795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63bba2-00b4-4098-a730-cec46adf8e8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:45.406986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63bba2-00b4-4098-a730-cec46adf8e8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:45.409362 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63bba2-00b4-4098-a730-cec46adf8e8d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-ae63bba2-00b4-4098-a730-cec46adf8e8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:45.425624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:45.426531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:45.427440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:45.427440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:45.427440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:45.427440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:45.427440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:45.427440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:45.427440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:45.427440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:45.427440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 373/741] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:45.430899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d811-79fe-4d81-b9c4-a24558eaafeb None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:45.430899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d811-79fe-4d81-b9c4-a24558eaafeb None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:45.430899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d811-79fe-4d81-b9c4-a24558eaafeb None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:45.430899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 374/742] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:45.435989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89d811-79fe-4d81-b9c4-a24558eaafeb None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:45.452605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e656afb-3e6b-4bc8-803e-aef965110ef7 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:45.456054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:45.496507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5c1d5-49b1-4618-b7a3-fa866f6e574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:45.497382 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5c1d5-49b1-4618-b7a3-fa866f6e574a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:45.497731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5c1d5-49b1-4618-b7a3-fa866f6e574a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:45.498082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5c1d5-49b1-4618-b7a3-fa866f6e574a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:45.506212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5c1d5-49b1-4618-b7a3-fa866f6e574a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:45.508333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5c1d5-49b1-4618-b7a3-fa866f6e574a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:45.518256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-4eb5c1d5-49b1-4618-b7a3-fa866f6e574a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:45.521984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:45.524133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 369/743] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Aug 29 23:38:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020df1f3-c63c-47e4-8c9c-3535f69fa654 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:45.526384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020df1f3-c63c-47e4-8c9c-3535f69fa654 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:45.528066 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020df1f3-c63c-47e4-8c9c-3535f69fa654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:45.545347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-020df1f3-c63c-47e4-8c9c-3535f69fa654 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:45.546541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-020df1f3-c63c-47e4-8c9c-3535f69fa654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:45.566518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89d811-79fe-4d81-b9c4-a24558eaafeb None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:45.608664 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2a9d2-2e53-4947-b0ea-19bc5d884b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:45.609281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a9d2-2e53-4947-b0ea-19bc5d884b80 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:45.609560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a9d2-2e53-4947-b0ea-19bc5d884b80 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:45.609894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a9d2-2e53-4947-b0ea-19bc5d884b80 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:45.610593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2a9d2-2e53-4947-b0ea-19bc5d884b80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:45.610984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2a9d2-2e53-4947-b0ea-19bc5d884b80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:45.612605 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2a9d2-2e53-4947-b0ea-19bc5d884b80 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:45.626628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 375/744] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:45.627460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2a9d2-2e53-4947-b0ea-19bc5d884b80 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:45.632584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 370/745] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:45 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:38:45.633411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020df1f3-c63c-47e4-8c9c-3535f69fa654 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:45.748289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:45.755562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020df1f3-c63c-47e4-8c9c-3535f69fa654 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:45.755910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2a9d2-2e53-4947-b0ea-19bc5d884b80 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:45.789980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:45.792186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a1337-2877-492f-840b-7bac4642abaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:45.792962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a1337-2877-492f-840b-7bac4642abaa None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:45.793247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a1337-2877-492f-840b-7bac4642abaa None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:45.793519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a1337-2877-492f-840b-7bac4642abaa None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:45.795025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a1337-2877-492f-840b-7bac4642abaa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:45.796688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a1337-2877-492f-840b-7bac4642abaa None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:45.800738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235ba14-fa74-40e3-b11d-cb2b91b3c45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:45.804632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235ba14-fa74-40e3-b11d-cb2b91b3c45c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:45.804632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235ba14-fa74-40e3-b11d-cb2b91b3c45c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:45.804632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235ba14-fa74-40e3-b11d-cb2b91b3c45c None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:45.804632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235ba14-fa74-40e3-b11d-cb2b91b3c45c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:45.804632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235ba14-fa74-40e3-b11d-cb2b91b3c45c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:45.805357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235ba14-fa74-40e3-b11d-cb2b91b3c45c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:45.823099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 376/746] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Aug 29 23:38:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:45.823762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235ba14-fa74-40e3-b11d-cb2b91b3c45c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:45.898081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 371/747] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:38:45 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:38:45.899082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a1337-2877-492f-840b-7bac4642abaa None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:45.945041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235ba14-fa74-40e3-b11d-cb2b91b3c45c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:45.992836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeee54-ae23-433d-bf70-cc3cf02be097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:45.993653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeee54-ae23-433d-bf70-cc3cf02be097 None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:45.994155 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeee54-ae23-433d-bf70-cc3cf02be097 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:45.994506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeee54-ae23-433d-bf70-cc3cf02be097 None admin] PATH_INFO: `/v3/projects/da13e1cbae664d5a92198052526ee459/users/59a1b0b274294a288dbf07cd99f95407/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:45.996646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeee54-ae23-433d-bf70-cc3cf02be097 None admin] RBAC: Authorizing `identity:create_grant(project_id=da13e1cbae664d5a92198052526ee459, user_id=59a1b0b274294a288dbf07cd99f95407, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:45.998791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeee54-ae23-433d-bf70-cc3cf02be097 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:46.039881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a1337-2877-492f-840b-7bac4642abaa None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:46.077734 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198364f6-63b6-4b2d-a926-1c52d4b6f4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:46.078419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198364f6-63b6-4b2d-a926-1c52d4b6f4dd None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:46.078706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198364f6-63b6-4b2d-a926-1c52d4b6f4dd None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:46.079007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198364f6-63b6-4b2d-a926-1c52d4b6f4dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:46.099215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 377/748] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:38:45 2022] PUT /identity/v3/projects/da13e1cbae664d5a92198052526ee459/users/59a1b0b274294a288dbf07cd99f95407/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:46.101375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeee54-ae23-433d-bf70-cc3cf02be097 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:46.118034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:46.150416 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:46.215459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198364f6-63b6-4b2d-a926-1c52d4b6f4dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:46.217840 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198364f6-63b6-4b2d-a926-1c52d4b6f4dd None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:46.289213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeee54-ae23-433d-bf70-cc3cf02be097 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:46.329646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ba3ef-c98e-4c86-b6ef-3d1e7c843749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:46.330378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ba3ef-c98e-4c86-b6ef-3d1e7c843749 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:46.330732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ba3ef-c98e-4c86-b6ef-3d1e7c843749 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:46.331106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ba3ef-c98e-4c86-b6ef-3d1e7c843749 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:46.343387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ba3ef-c98e-4c86-b6ef-3d1e7c843749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-721ba3ef-c98e-4c86-b6ef-3d1e7c843749 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:46.348469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:46.349389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:46.350505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 378/749] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:46.357235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ba3ef-c98e-4c86-b6ef-3d1e7c843749 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:46.375775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 372/750] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:38:46.383885 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198364f6-63b6-4b2d-a926-1c52d4b6f4dd None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:46.449377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:46.496925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:46.497970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198364f6-63b6-4b2d-a926-1c52d4b6f4dd None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:46.504200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ba3ef-c98e-4c86-b6ef-3d1e7c843749 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:46.552230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb1656-634e-4fc5-bf09-0eef6956a9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:46.553607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb1656-634e-4fc5-bf09-0eef6956a9b4 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:46.554397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb1656-634e-4fc5-bf09-0eef6956a9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:46.555469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb1656-634e-4fc5-bf09-0eef6956a9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:46.556277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d23ab-424a-4c8f-bfcc-0c7ac20929b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:46.557235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb1656-634e-4fc5-bf09-0eef6956a9b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:46.558078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d23ab-424a-4c8f-bfcc-0c7ac20929b6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:46.558671 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb1656-634e-4fc5-bf09-0eef6956a9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:46.560930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb1656-634e-4fc5-bf09-0eef6956a9b4 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:46.561440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d23ab-424a-4c8f-bfcc-0c7ac20929b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:46.561927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d23ab-424a-4c8f-bfcc-0c7ac20929b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:46.579949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 379/751] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:46.582257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d23ab-424a-4c8f-bfcc-0c7ac20929b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:46.585615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb1656-634e-4fc5-bf09-0eef6956a9b4 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:46.591182 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d23ab-424a-4c8f-bfcc-0c7ac20929b6 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-e63d23ab-424a-4c8f-bfcc-0c7ac20929b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:46.627294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:46.628896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:46.630244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:46.630244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:46.630244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:46.630244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 373/752] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:46.634973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d23ab-424a-4c8f-bfcc-0c7ac20929b6 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:46.754613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb1656-634e-4fc5-bf09-0eef6956a9b4 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:46.793805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5919be9-e675-4716-86de-bfa60855b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:46.795451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5919be9-e675-4716-86de-bfa60855b57f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:46.795928 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5919be9-e675-4716-86de-bfa60855b57f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:46.796829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5919be9-e675-4716-86de-bfa60855b57f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:46.809767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5919be9-e675-4716-86de-bfa60855b57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:46.811475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5919be9-e675-4716-86de-bfa60855b57f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-c5919be9-e675-4716-86de-bfa60855b57f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:46.827573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:46.828582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:46.829479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:46.829479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:46.829479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:46.831845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 380/753] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:46.837611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5919be9-e675-4716-86de-bfa60855b57f None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:46.853140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:46.860976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d23ab-424a-4c8f-bfcc-0c7ac20929b6 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:46.875820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:46.952994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5919be9-e675-4716-86de-bfa60855b57f None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:46.987687 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74019ff-0ce3-4649-9ffd-0b6b35604ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:46.988322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74019ff-0ce3-4649-9ffd-0b6b35604ab4 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:46.988608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74019ff-0ce3-4649-9ffd-0b6b35604ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:46.988884 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74019ff-0ce3-4649-9ffd-0b6b35604ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:46.989535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74019ff-0ce3-4649-9ffd-0b6b35604ab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:46.989840 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74019ff-0ce3-4649-9ffd-0b6b35604ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:46.994943 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74019ff-0ce3-4649-9ffd-0b6b35604ab4 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:47.003354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bd165-0529-4ce7-8de3-054d0333d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:47.004227 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bd165-0529-4ce7-8de3-054d0333d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:47.004656 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bd165-0529-4ce7-8de3-054d0333d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:47.005075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bd165-0529-4ce7-8de3-054d0333d8d6 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:47.005869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bd165-0529-4ce7-8de3-054d0333d8d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:47.006328 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bd165-0529-4ce7-8de3-054d0333d8d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:47.009375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bd165-0529-4ce7-8de3-054d0333d8d6 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:47.015951 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 374/754] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:47.020166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74019ff-0ce3-4649-9ffd-0b6b35604ab4 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:47.035641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 381/755] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:47.041735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bd165-0529-4ce7-8de3-054d0333d8d6 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:47.143669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:47.178096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bd165-0529-4ce7-8de3-054d0333d8d6 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:47.184121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74019ff-0ce3-4649-9ffd-0b6b35604ab4 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:47.222922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a26b8-e0d0-4fff-9dd3-5d4eb0adb61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:47.223806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a26b8-e0d0-4fff-9dd3-5d4eb0adb61b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:47.224432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a26b8-e0d0-4fff-9dd3-5d4eb0adb61b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:47.224961 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a26b8-e0d0-4fff-9dd3-5d4eb0adb61b None admin] PATH_INFO: `/v3/users/swift` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:47.225712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48c32b-ec68-46cb-b12a-76931d791671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:47.226495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48c32b-ec68-46cb-b12a-76931d791671 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:47.226871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48c32b-ec68-46cb-b12a-76931d791671 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:47.227277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48c32b-ec68-46cb-b12a-76931d791671 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:47.235389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a26b8-e0d0-4fff-9dd3-5d4eb0adb61b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:47.235657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48c32b-ec68-46cb-b12a-76931d791671 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:47.237283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a26b8-e0d0-4fff-9dd3-5d4eb0adb61b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:47.237412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48c32b-ec68-46cb-b12a-76931d791671 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-9d48c32b-ec68-46cb-b12a-76931d791671 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:47.251106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:47.252275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:47.253375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:47.253375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:47.253375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:47.253375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:47.253375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:47.253375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:47.253375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:47.253375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-d67a26b8-e0d0-4fff-9dd3-5d4eb0adb61b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:47.254269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:47.255410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:47.256561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:47.256561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:47.256561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:47.256561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:47.256561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:47.256561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:47.256561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:47.256561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:47.256561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:38:47.256561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:47.258623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 382/756] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:47.259996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca02bb7-75d8-406e-8d3d-3e06654e32da None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:47.260441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca02bb7-75d8-406e-8d3d-3e06654e32da None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:47.260932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca02bb7-75d8-406e-8d3d-3e06654e32da None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:47.262664 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 383/757] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:47.263855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 375/758] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:47.264757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca02bb7-75d8-406e-8d3d-3e06654e32da None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:47.268037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48c32b-ec68-46cb-b12a-76931d791671 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:47.298096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:47.382074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48c32b-ec68-46cb-b12a-76931d791671 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:47.407696 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca02bb7-75d8-406e-8d3d-3e06654e32da None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:47.428346 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2ec8f-8dae-44c0-aa10-5f550fb035ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:47.429906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2ec8f-8dae-44c0-aa10-5f550fb035ff None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:47.430626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2ec8f-8dae-44c0-aa10-5f550fb035ff None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:47.431123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2ec8f-8dae-44c0-aa10-5f550fb035ff None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:47.432356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2ec8f-8dae-44c0-aa10-5f550fb035ff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:47.433337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2ec8f-8dae-44c0-aa10-5f550fb035ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:47.436230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2ec8f-8dae-44c0-aa10-5f550fb035ff None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:47.439635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:47.445801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2138c9-a33d-46d7-b903-a44c74b1ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:47.449998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2138c9-a33d-46d7-b903-a44c74b1ec60 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:47.449998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2138c9-a33d-46d7-b903-a44c74b1ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:47.449998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2138c9-a33d-46d7-b903-a44c74b1ec60 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:47.449998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2138c9-a33d-46d7-b903-a44c74b1ec60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:47.449998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2138c9-a33d-46d7-b903-a44c74b1ec60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:47.449998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2138c9-a33d-46d7-b903-a44c74b1ec60 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:47.462406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 376/759] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Aug 29 23:38:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:47.464081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecac3f3-d019-414e-b74d-99337c83e3cb None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:47.464564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecac3f3-d019-414e-b74d-99337c83e3cb None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:47.464989 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecac3f3-d019-414e-b74d-99337c83e3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:47.468185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 384/760] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:47.469329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2138c9-a33d-46d7-b903-a44c74b1ec60 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:47.490384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-6ecac3f3-d019-414e-b74d-99337c83e3cb None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:47.491875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6ecac3f3-d019-414e-b74d-99337c83e3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:47.576635 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 377/761] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:47.577685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecac3f3-d019-414e-b74d-99337c83e3cb None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:47.592352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2138c9-a33d-46d7-b903-a44c74b1ec60 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:47.593426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:47.640806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e559e2-de00-4b61-b9e3-6a31b917e9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:47.640806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e559e2-de00-4b61-b9e3-6a31b917e9b3 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:47.640806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e559e2-de00-4b61-b9e3-6a31b917e9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:47.640806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e559e2-de00-4b61-b9e3-6a31b917e9b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:47.718758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecac3f3-d019-414e-b74d-99337c83e3cb None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:47.765876 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:47.786304 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e559e2-de00-4b61-b9e3-6a31b917e9b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:47.787879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e559e2-de00-4b61-b9e3-6a31b917e9b3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:47.803229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71232836-f3d7-47fb-97c9-c3dc53e61d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:47.803854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71232836-f3d7-47fb-97c9-c3dc53e61d20 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:47.804133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71232836-f3d7-47fb-97c9-c3dc53e61d20 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:47.804405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71232836-f3d7-47fb-97c9-c3dc53e61d20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:47.805137 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71232836-f3d7-47fb-97c9-c3dc53e61d20 None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=ef922e08ae644f6a84034366f59d5591) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:47.805447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71232836-f3d7-47fb-97c9-c3dc53e61d20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:47.806871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71232836-f3d7-47fb-97c9-c3dc53e61d20 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:47.823304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 378/762] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:47 2022] GET /identity/v3/role_assignments?user.id=ef922e08ae644f6a84034366f59d5591&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:47.909592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71232836-f3d7-47fb-97c9-c3dc53e61d20 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:47.946031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 385/763] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:38:47.951446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e559e2-de00-4b61-b9e3-6a31b917e9b3 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:48.042415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:48.067455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71232836-f3d7-47fb-97c9-c3dc53e61d20 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:48.091256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:48.101199 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e559e2-de00-4b61-b9e3-6a31b917e9b3 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:48.124624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0fb8d-f993-4adf-a929-0fb6418ff524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:48.125266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0fb8d-f993-4adf-a929-0fb6418ff524 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:48.125544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0fb8d-f993-4adf-a929-0fb6418ff524 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:48.125816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0fb8d-f993-4adf-a929-0fb6418ff524 None admin] PATH_INFO: `/v3/services/network` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:48.126398 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0fb8d-f993-4adf-a929-0fb6418ff524 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:48.127935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0fb8d-f993-4adf-a929-0fb6418ff524 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-21c0fb8d-f993-4adf-a929-0fb6418ff524 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:48.137433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:48.138519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:48.139795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 379/764] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:47 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:48.140966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553f55a-fec3-4ca4-9533-8dd926177375 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:48.140966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553f55a-fec3-4ca4-9533-8dd926177375 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:48.140966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553f55a-fec3-4ca4-9533-8dd926177375 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:48.142238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 380/765] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:48.147437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb59e9-b53e-4c40-84af-0bcf507ea94e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:48.152689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb59e9-b53e-4c40-84af-0bcf507ea94e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:48.152689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb59e9-b53e-4c40-84af-0bcf507ea94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:48.152885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06e26-e5fe-48e6-b4d8-47502b57756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:48.152885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06e26-e5fe-48e6-b4d8-47502b57756f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:48.152885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06e26-e5fe-48e6-b4d8-47502b57756f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:48.152885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06e26-e5fe-48e6-b4d8-47502b57756f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:48.164401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e06e26-e5fe-48e6-b4d8-47502b57756f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:48.165989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e06e26-e5fe-48e6-b4d8-47502b57756f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:48.171224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-c5eb59e9-b53e-4c40-84af-0bcf507ea94e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:48.172583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c5eb59e9-b53e-4c40-84af-0bcf507ea94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-94e06e26-e5fe-48e6-b4d8-47502b57756f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:48.182863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:48.184131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:48.185862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:48.185862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:48.185862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:48.191309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 386/766] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:48.191309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06e26-e5fe-48e6-b4d8-47502b57756f None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:48.268602 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 381/767] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:48.269879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb59e9-b53e-4c40-84af-0bcf507ea94e None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:48.329286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06e26-e5fe-48e6-b4d8-47502b57756f None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:48.347366 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:48.384790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb59e9-b53e-4c40-84af-0bcf507ea94e None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:48.391001 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc89b6-42c7-454e-a779-8e4236b55b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:48.391728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc89b6-42c7-454e-a779-8e4236b55b3b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:48.392021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc89b6-42c7-454e-a779-8e4236b55b3b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:48.392296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc89b6-42c7-454e-a779-8e4236b55b3b None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:48.392979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc89b6-42c7-454e-a779-8e4236b55b3b None admin] RBAC: Adding query filter params (name=network) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:48.393285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc89b6-42c7-454e-a779-8e4236b55b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:48.394675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc89b6-42c7-454e-a779-8e4236b55b3b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:48.400336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 387/768] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:38:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:48.401860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e9665-d1c3-42ad-b6da-a7dc735c057f None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:48.402156 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e9665-d1c3-42ad-b6da-a7dc735c057f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:48.402433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e9665-d1c3-42ad-b6da-a7dc735c057f None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:48.404640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 388/769] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:48.406197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e9665-d1c3-42ad-b6da-a7dc735c057f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:48.416574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:48.525870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e9665-d1c3-42ad-b6da-a7dc735c057f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:48.547550 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8117f-8a43-4e1c-9f4e-ae3962263f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:48.548574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8117f-8a43-4e1c-9f4e-ae3962263f1b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:48.549058 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8117f-8a43-4e1c-9f4e-ae3962263f1b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:48.549524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8117f-8a43-4e1c-9f4e-ae3962263f1b None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:48.550355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8117f-8a43-4e1c-9f4e-ae3962263f1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:48.550871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8117f-8a43-4e1c-9f4e-ae3962263f1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:48.552625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8117f-8a43-4e1c-9f4e-ae3962263f1b None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:48.563387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a619dc-abea-420b-8743-bf8b4ff5ee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:48.563996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a619dc-abea-420b-8743-bf8b4ff5ee3c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:48.564304 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a619dc-abea-420b-8743-bf8b4ff5ee3c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:48.564541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a619dc-abea-420b-8743-bf8b4ff5ee3c None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:48.565175 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a619dc-abea-420b-8743-bf8b4ff5ee3c None admin] RBAC: Adding query filter params (type=network) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:48.565481 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a619dc-abea-420b-8743-bf8b4ff5ee3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:48.566843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a619dc-abea-420b-8743-bf8b4ff5ee3c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:48.571128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 382/770] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:48.572265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 389/771] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:38:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:48.573071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292474a-06ec-4d3b-abcc-69619fdb0c46 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:48.573548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292474a-06ec-4d3b-abcc-69619fdb0c46 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:48.574011 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292474a-06ec-4d3b-abcc-69619fdb0c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:48.577090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a619dc-abea-420b-8743-bf8b4ff5ee3c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:48.594485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-9292474a-06ec-4d3b-abcc-69619fdb0c46 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:48.596106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9292474a-06ec-4d3b-abcc-69619fdb0c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:48.656099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:48.670230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 383/772] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:48.671276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292474a-06ec-4d3b-abcc-69619fdb0c46 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:48.689185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a619dc-abea-420b-8743-bf8b4ff5ee3c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:48.727438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8149dd0-1e3e-4469-8758-5c33e74ad9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:48.728428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149dd0-1e3e-4469-8758-5c33e74ad9ec None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:48.728893 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149dd0-1e3e-4469-8758-5c33e74ad9ec None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:48.729589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149dd0-1e3e-4469-8758-5c33e74ad9ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:48.737365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8149dd0-1e3e-4469-8758-5c33e74ad9ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:48.739085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8149dd0-1e3e-4469-8758-5c33e74ad9ec None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:48.749183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-d8149dd0-1e3e-4469-8758-5c33e74ad9ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:48.753740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:48.754663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:48.755613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:48.755613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:48.755613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:48.755613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:48.755613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:48.755613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:48.755613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:48.755613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:48.757612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 390/773] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:48.758530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8149dd0-1e3e-4469-8758-5c33e74ad9ec None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:48.795101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292474a-06ec-4d3b-abcc-69619fdb0c46 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:48.835623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec21f91-c6ba-483f-9db2-0e9b701c83a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:48.836245 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec21f91-c6ba-483f-9db2-0e9b701c83a6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:48.836774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec21f91-c6ba-483f-9db2-0e9b701c83a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:48.837107 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec21f91-c6ba-483f-9db2-0e9b701c83a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:48.838691 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec21f91-c6ba-483f-9db2-0e9b701c83a6 None admin] RBAC: Adding query filter params (interface=public, service_id=cdeabe186b024188bc21bae79f9a2fc2, region_id=RegionOne) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:48.839044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec21f91-c6ba-483f-9db2-0e9b701c83a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:48.840417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec21f91-c6ba-483f-9db2-0e9b701c83a6 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:48.850608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 384/774] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Aug 29 23:38:48 2022] GET /identity/v3/endpoints?service_id=cdeabe186b024188bc21bae79f9a2fc2&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:48.851651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec21f91-c6ba-483f-9db2-0e9b701c83a6 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:48.877592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8149dd0-1e3e-4469-8758-5c33e74ad9ec None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:48.917937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:48.925511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0b313-8591-4152-8724-9c959ffb3a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:48.926371 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b313-8591-4152-8724-9c959ffb3a19 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:48.926783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b313-8591-4152-8724-9c959ffb3a19 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:48.927056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b313-8591-4152-8724-9c959ffb3a19 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:48.930138 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0b313-8591-4152-8724-9c959ffb3a19 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:48.930138 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0b313-8591-4152-8724-9c959ffb3a19 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-80f0b313-8591-4152-8724-9c959ffb3a19 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:48.942228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:48.943492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:38:48.944449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:48.947342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 391/775] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Aug 29 23:38:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:48.948188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0b313-8591-4152-8724-9c959ffb3a19 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:48.971910 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec21f91-c6ba-483f-9db2-0e9b701c83a6 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:48.999912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:49.008912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b5485-c30d-40c0-bd19-b393f2a04fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:49.009717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b5485-c30d-40c0-bd19-b393f2a04fd4 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:49.010263 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b5485-c30d-40c0-bd19-b393f2a04fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:49.010697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b5485-c30d-40c0-bd19-b393f2a04fd4 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:49.011642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b5485-c30d-40c0-bd19-b393f2a04fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:49.012096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b5485-c30d-40c0-bd19-b393f2a04fd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:49.013941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b5485-c30d-40c0-bd19-b393f2a04fd4 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:49.027028 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 385/776] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:49.027847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b5485-c30d-40c0-bd19-b393f2a04fd4 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:49.060605 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0b313-8591-4152-8724-9c959ffb3a19 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:49.095938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea44009-6a2e-4b8d-9d7b-6d8549698c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:49.096611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea44009-6a2e-4b8d-9d7b-6d8549698c80 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:49.096891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea44009-6a2e-4b8d-9d7b-6d8549698c80 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:49.097168 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea44009-6a2e-4b8d-9d7b-6d8549698c80 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:49.097769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea44009-6a2e-4b8d-9d7b-6d8549698c80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:49.099218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea44009-6a2e-4b8d-9d7b-6d8549698c80 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:49.104949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 392/777] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Aug 29 23:38:48 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:49.105664 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea44009-6a2e-4b8d-9d7b-6d8549698c80 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:49.164323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b5485-c30d-40c0-bd19-b393f2a04fd4 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:49.184092 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:49.217866 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74445309-ea87-4f4f-9f38-bea97d67a013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:49.219768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74445309-ea87-4f4f-9f38-bea97d67a013 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:49.220556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74445309-ea87-4f4f-9f38-bea97d67a013 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:49.221028 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74445309-ea87-4f4f-9f38-bea97d67a013 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:49.222140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74445309-ea87-4f4f-9f38-bea97d67a013 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:49.223146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74445309-ea87-4f4f-9f38-bea97d67a013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:49.225341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74445309-ea87-4f4f-9f38-bea97d67a013 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:49.233070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea44009-6a2e-4b8d-9d7b-6d8549698c80 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:49.234021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 386/778] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Aug 29 23:38:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:49.235116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74445309-ea87-4f4f-9f38-bea97d67a013 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:49.285391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601eb0f-e4f8-442a-bef7-242a6ec2de09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:49.286126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601eb0f-e4f8-442a-bef7-242a6ec2de09 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:49.286408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601eb0f-e4f8-442a-bef7-242a6ec2de09 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:49.286676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601eb0f-e4f8-442a-bef7-242a6ec2de09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:49.295814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:49.300767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601eb0f-e4f8-442a-bef7-242a6ec2de09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-6601eb0f-e4f8-442a-bef7-242a6ec2de09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:49.305722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:49.309591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 393/779] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:49.310462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601eb0f-e4f8-442a-bef7-242a6ec2de09 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:49.365733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74445309-ea87-4f4f-9f38-bea97d67a013 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:49.402247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f24e63-4076-47f5-9ed1-7877e962c4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:49.403066 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f24e63-4076-47f5-9ed1-7877e962c4df None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:49.404015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f24e63-4076-47f5-9ed1-7877e962c4df None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:49.404385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f24e63-4076-47f5-9ed1-7877e962c4df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:49.405208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f24e63-4076-47f5-9ed1-7877e962c4df None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=a75fb249079b4831be08cc4c9f94d6df) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:49.405614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f24e63-4076-47f5-9ed1-7877e962c4df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:49.407338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f24e63-4076-47f5-9ed1-7877e962c4df None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:49.413665 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 387/780] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:49 2022] GET /identity/v3/role_assignments?user.id=a75fb249079b4831be08cc4c9f94d6df&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:49.414581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f24e63-4076-47f5-9ed1-7877e962c4df None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:49.439656 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601eb0f-e4f8-442a-bef7-242a6ec2de09 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:49.462246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:49.482532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac5ae9-e99d-44ab-be6a-427217304d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:49.483447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5ae9-e99d-44ab-be6a-427217304d13 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:49.488255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5ae9-e99d-44ab-be6a-427217304d13 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:49.488255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5ae9-e99d-44ab-be6a-427217304d13 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:49.488255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac5ae9-e99d-44ab-be6a-427217304d13 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:49.488255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac5ae9-e99d-44ab-be6a-427217304d13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:49.488255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac5ae9-e99d-44ab-be6a-427217304d13 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:49.492934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 394/781] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Aug 29 23:38:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:49.499275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac5ae9-e99d-44ab-be6a-427217304d13 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:49.557282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f24e63-4076-47f5-9ed1-7877e962c4df None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:49.577512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:49.628595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fde156-43ed-4354-925d-9325962454fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:49.629144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fde156-43ed-4354-925d-9325962454fb None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:49.629513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fde156-43ed-4354-925d-9325962454fb None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:49.629799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fde156-43ed-4354-925d-9325962454fb None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:49.630472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fde156-43ed-4354-925d-9325962454fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:49.630775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fde156-43ed-4354-925d-9325962454fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:49.632276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fde156-43ed-4354-925d-9325962454fb None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:49.635414 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac5ae9-e99d-44ab-be6a-427217304d13 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:49.642764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 388/782] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:49.650756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fde156-43ed-4354-925d-9325962454fb None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:49.709590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2be24-473a-4a34-9daa-bd13d0f5004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:49.710212 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2be24-473a-4a34-9daa-bd13d0f5004a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:49.710494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2be24-473a-4a34-9daa-bd13d0f5004a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:49.710763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2be24-473a-4a34-9daa-bd13d0f5004a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:49.711500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2be24-473a-4a34-9daa-bd13d0f5004a None admin] RBAC: Adding query filter params (interface=public, service_id=d9df81939bd247df952081b65a3f9492, region_id=RegionOne) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:49.711806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2be24-473a-4a34-9daa-bd13d0f5004a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:49.713181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2be24-473a-4a34-9daa-bd13d0f5004a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:49.730457 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 395/783] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Aug 29 23:38:49 2022] GET /identity/v3/endpoints?service_id=d9df81939bd247df952081b65a3f9492&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:49.738903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2be24-473a-4a34-9daa-bd13d0f5004a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:49.771588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fde156-43ed-4354-925d-9325962454fb None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:49.816853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5e95b-10f3-457f-a2f5-e61cca3be5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:49.817494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5e95b-10f3-457f-a2f5-e61cca3be5b7 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:49.817774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5e95b-10f3-457f-a2f5-e61cca3be5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:49.818047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5e95b-10f3-457f-a2f5-e61cca3be5b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:49.845178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5e95b-10f3-457f-a2f5-e61cca3be5b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:49.846730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5e95b-10f3-457f-a2f5-e61cca3be5b7 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:49.862126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-2db5e95b-10f3-457f-a2f5-e61cca3be5b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:49.876583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:49.881228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:49.882125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:49.882125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:49.882125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:49.882125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 389/784] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:49.883867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5e95b-10f3-457f-a2f5-e61cca3be5b7 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:49.933274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2be24-473a-4a34-9daa-bd13d0f5004a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:49.946937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:49.992117 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbea9b-15b0-466c-a5f5-39a265e952ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:49.992736 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbea9b-15b0-466c-a5f5-39a265e952ae None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:49.993521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbea9b-15b0-466c-a5f5-39a265e952ae None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:49.993802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbea9b-15b0-466c-a5f5-39a265e952ae None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:49.994687 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbea9b-15b0-466c-a5f5-39a265e952ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:49.996278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbea9b-15b0-466c-a5f5-39a265e952ae None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:50.003955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 396/785] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Aug 29 23:38:49 2022] GET /identity/v3/services => generated 772 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:50.005187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185fb7-764b-45ac-81bb-f7ebc5866e24 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:50.005473 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185fb7-764b-45ac-81bb-f7ebc5866e24 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:50.005802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185fb7-764b-45ac-81bb-f7ebc5866e24 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:50.011229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 397/786] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:50.013779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a5fea-a330-445b-b58a-880f0852c04f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:50.014917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a5fea-a330-445b-b58a-880f0852c04f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:50.015229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a5fea-a330-445b-b58a-880f0852c04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:50.037766 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-327a5fea-a330-445b-b58a-880f0852c04f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:50.039049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-327a5fea-a330-445b-b58a-880f0852c04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:50.064562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5e95b-10f3-457f-a2f5-e61cca3be5b7 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:50.147825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 398/787] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:50.163737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21147a-0a7a-46db-877a-be3dcba5ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:50.164699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21147a-0a7a-46db-877a-be3dcba5ed0c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:50.165289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21147a-0a7a-46db-877a-be3dcba5ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:50.165754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21147a-0a7a-46db-877a-be3dcba5ed0c None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:50.166606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21147a-0a7a-46db-877a-be3dcba5ed0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:50.167127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21147a-0a7a-46db-877a-be3dcba5ed0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:50.168708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21147a-0a7a-46db-877a-be3dcba5ed0c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:50.192103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 390/788] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:50.197842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a5fea-a330-445b-b58a-880f0852c04f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:50.244575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:50.315540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a5fea-a330-445b-b58a-880f0852c04f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:50.352298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb636bcd-72f9-4910-a8e2-3246d73fdab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:50.352935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb636bcd-72f9-4910-a8e2-3246d73fdab5 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:50.353212 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb636bcd-72f9-4910-a8e2-3246d73fdab5 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:50.353484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb636bcd-72f9-4910-a8e2-3246d73fdab5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:50.364229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb636bcd-72f9-4910-a8e2-3246d73fdab5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:50.365707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb636bcd-72f9-4910-a8e2-3246d73fdab5 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-fb636bcd-72f9-4910-a8e2-3246d73fdab5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:50.379121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:50.380165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:50.381763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:50.381763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:50.381763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:50.381763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:50.381763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:50.381763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:50.381763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:50.381763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:50.381763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:38:50.381763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:50.381763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 399/789] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Aug 29 23:38:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:50.388507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21147a-0a7a-46db-877a-be3dcba5ed0c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:50.445453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb636bcd-72f9-4910-a8e2-3246d73fdab5 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:50.540876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:50.565505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21147a-0a7a-46db-877a-be3dcba5ed0c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:50.616701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb636bcd-72f9-4910-a8e2-3246d73fdab5 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:50.619935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:50.642997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217374cd-f607-488d-9d10-1fd8abe04a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:50.643617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217374cd-f607-488d-9d10-1fd8abe04a15 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:50.643902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217374cd-f607-488d-9d10-1fd8abe04a15 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:50.644174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217374cd-f607-488d-9d10-1fd8abe04a15 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:50.644964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217374cd-f607-488d-9d10-1fd8abe04a15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:50.645270 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217374cd-f607-488d-9d10-1fd8abe04a15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:50.646736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217374cd-f607-488d-9d10-1fd8abe04a15 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:50.666666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 391/790] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Aug 29 23:38:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:50.674550 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217374cd-f607-488d-9d10-1fd8abe04a15 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:50.689555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70e122-7031-42fb-8e12-fd008ce6ce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:50.690208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e122-7031-42fb-8e12-fd008ce6ce82 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:50.690485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e122-7031-42fb-8e12-fd008ce6ce82 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:50.690755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e122-7031-42fb-8e12-fd008ce6ce82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:50.708798 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70e122-7031-42fb-8e12-fd008ce6ce82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-4f70e122-7031-42fb-8e12-fd008ce6ce82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:50.714453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:50.715428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:50.716316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 400/791] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:50.722862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70e122-7031-42fb-8e12-fd008ce6ce82 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:50.845307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217374cd-f607-488d-9d10-1fd8abe04a15 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:50.903666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c33f9-9481-4d9d-ac6d-f45751e7bf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:50.904275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c33f9-9481-4d9d-ac6d-f45751e7bf39 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:50.904554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c33f9-9481-4d9d-ac6d-f45751e7bf39 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:50.904822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c33f9-9481-4d9d-ac6d-f45751e7bf39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:50.923205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:50.933270 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70e122-7031-42fb-8e12-fd008ce6ce82 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:51.003480 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e31673-4767-42db-86cf-484f2999f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:51.004098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e31673-4767-42db-86cf-484f2999f263 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:51.004379 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e31673-4767-42db-86cf-484f2999f263 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:51.004655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e31673-4767-42db-86cf-484f2999f263 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:51.005324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e31673-4767-42db-86cf-484f2999f263 None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:51.005627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e31673-4767-42db-86cf-484f2999f263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:51.007037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e31673-4767-42db-86cf-484f2999f263 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:51.020995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 401/792] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:51.022101 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e31673-4767-42db-86cf-484f2999f263 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:51.022541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c33f9-9481-4d9d-ac6d-f45751e7bf39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:51.024268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c33f9-9481-4d9d-ac6d-f45751e7bf39 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:51.054907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:51.131440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e31673-4767-42db-86cf-484f2999f263 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:51.167461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c72a6-5386-4887-a00d-be803a6489da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:51.168157 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c72a6-5386-4887-a00d-be803a6489da None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:51.168436 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c72a6-5386-4887-a00d-be803a6489da None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:51.168713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c72a6-5386-4887-a00d-be803a6489da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:51.180889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c72a6-5386-4887-a00d-be803a6489da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:51.182826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c72a6-5386-4887-a00d-be803a6489da None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:51.206584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 392/793] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:38:51.208178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c33f9-9481-4d9d-ac6d-f45751e7bf39 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-379c72a6-5386-4887-a00d-be803a6489da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:51.228119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:51.229710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:51.230604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:51.230604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:51.230604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:51.230604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 402/794] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:51.239906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c72a6-5386-4887-a00d-be803a6489da None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:51.263390 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:51.315229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c33f9-9481-4d9d-ac6d-f45751e7bf39 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:51.350507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9d0ca-1e6d-4ad8-a347-92d1a9be7630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:51.351585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9d0ca-1e6d-4ad8-a347-92d1a9be7630 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:51.352022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9d0ca-1e6d-4ad8-a347-92d1a9be7630 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:51.352634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9d0ca-1e6d-4ad8-a347-92d1a9be7630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:51.365328 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9d0ca-1e6d-4ad8-a347-92d1a9be7630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:51.367062 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9d0ca-1e6d-4ad8-a347-92d1a9be7630 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-69e9d0ca-1e6d-4ad8-a347-92d1a9be7630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:51.382019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:51.383050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:51.383944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:51.383944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:51.383944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:51.385820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 393/795] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:51.392696 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9d0ca-1e6d-4ad8-a347-92d1a9be7630 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:51.403781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:51.437132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c72a6-5386-4887-a00d-be803a6489da None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:51.491227 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc4097-15e8-404a-8771-888eec4a3816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:51.492395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc4097-15e8-404a-8771-888eec4a3816 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:51.492887 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc4097-15e8-404a-8771-888eec4a3816 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:51.493802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc4097-15e8-404a-8771-888eec4a3816 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:51.494961 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc4097-15e8-404a-8771-888eec4a3816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:51.495449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc4097-15e8-404a-8771-888eec4a3816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:51.497985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc4097-15e8-404a-8771-888eec4a3816 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:51.517546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 403/796] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:51.517546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06a89d-40bb-49b7-9471-de36c24eaef4 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:51.517546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06a89d-40bb-49b7-9471-de36c24eaef4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:51.517546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06a89d-40bb-49b7-9471-de36c24eaef4 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:51.517546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 404/797] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:51.523159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06a89d-40bb-49b7-9471-de36c24eaef4 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:51.535280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:51.538024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9d0ca-1e6d-4ad8-a347-92d1a9be7630 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:51.577432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae9f3b-8792-4da3-8483-803d50aa90e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:51.578092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9f3b-8792-4da3-8483-803d50aa90e7 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:51.578380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9f3b-8792-4da3-8483-803d50aa90e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:51.578652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9f3b-8792-4da3-8483-803d50aa90e7 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:51.579343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae9f3b-8792-4da3-8483-803d50aa90e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:51.579643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae9f3b-8792-4da3-8483-803d50aa90e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:51.581566 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae9f3b-8792-4da3-8483-803d50aa90e7 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:51.597533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 394/798] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:51.597533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962d083-6006-4e20-868f-277d83be876c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:51.597533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962d083-6006-4e20-868f-277d83be876c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:51.597533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962d083-6006-4e20-868f-277d83be876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:51.614116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-b962d083-6006-4e20-868f-277d83be876c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:51.615399 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b962d083-6006-4e20-868f-277d83be876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:51.668719 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06a89d-40bb-49b7-9471-de36c24eaef4 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:51.688711 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 395/799] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:51.689762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962d083-6006-4e20-868f-277d83be876c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:51.707945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e860e-84a9-40ba-9297-1ca6b6ee6b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:51.709033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e860e-84a9-40ba-9297-1ca6b6ee6b84 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:51.709542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e860e-84a9-40ba-9297-1ca6b6ee6b84 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:51.710015 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e860e-84a9-40ba-9297-1ca6b6ee6b84 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:51.713492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:51.720109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e860e-84a9-40ba-9297-1ca6b6ee6b84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:51.722072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e860e-84a9-40ba-9297-1ca6b6ee6b84 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-f19e860e-84a9-40ba-9297-1ca6b6ee6b84 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:51.738274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:51.739370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:51.740319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:51.740319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:51.740319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:51.740319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:51.740319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:51.740319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:51.740319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:51.740319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:51.740319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:38:51.740319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:51.742998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 405/800] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Aug 29 23:38:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:51.744900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3a9a2-a1ae-48b3-bc70-7d5c57fa9f15 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:51.745191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3a9a2-a1ae-48b3-bc70-7d5c57fa9f15 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:51.745467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3a9a2-a1ae-48b3-bc70-7d5c57fa9f15 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:51.749722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 406/801] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:51.750140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3a9a2-a1ae-48b3-bc70-7d5c57fa9f15 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:51.796025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:51.809155 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962d083-6006-4e20-868f-277d83be876c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:51.844961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b7e9f-8389-4407-be5e-4fdae716a67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:51.846000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b7e9f-8389-4407-be5e-4fdae716a67e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:51.846538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b7e9f-8389-4407-be5e-4fdae716a67e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:51.847056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b7e9f-8389-4407-be5e-4fdae716a67e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:51.855029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b7e9f-8389-4407-be5e-4fdae716a67e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:51.857025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b7e9f-8389-4407-be5e-4fdae716a67e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-ff5b7e9f-8389-4407-be5e-4fdae716a67e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:51.870172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:51.871357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:51.872326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:51.872326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:51.872326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:51.872326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:51.872326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:51.872326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:51.872326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:51.872326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:51.879262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 396/802] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:51.880915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f6593-e3d9-4299-93af-5cd1c97f181a None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:51.881516 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f6593-e3d9-4299-93af-5cd1c97f181a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:51.882052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f6593-e3d9-4299-93af-5cd1c97f181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:51.882965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3a9a2-a1ae-48b3-bc70-7d5c57fa9f15 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:51.904091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-222f6593-e3d9-4299-93af-5cd1c97f181a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:51.905623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-222f6593-e3d9-4299-93af-5cd1c97f181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:51.932421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebf1f0-f4c4-45d1-bcc3-1d23f38a37b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:51.933126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebf1f0-f4c4-45d1-bcc3-1d23f38a37b9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:51.933518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebf1f0-f4c4-45d1-bcc3-1d23f38a37b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:51.933860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebf1f0-f4c4-45d1-bcc3-1d23f38a37b9 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:51.935465 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebf1f0-f4c4-45d1-bcc3-1d23f38a37b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:51.936244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebf1f0-f4c4-45d1-bcc3-1d23f38a37b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:51.938003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebf1f0-f4c4-45d1-bcc3-1d23f38a37b9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:51.963026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 407/803] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Aug 29 23:38:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:51.964186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebf1f0-f4c4-45d1-bcc3-1d23f38a37b9 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:51.988034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 397/804] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:51.989680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f6593-e3d9-4299-93af-5cd1c97f181a None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:52.026638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:52.077679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebf1f0-f4c4-45d1-bcc3-1d23f38a37b9 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:52.100762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:52.120305 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6bc63-19a1-4d1b-9a4f-beb6cd53d515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:52.121408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6bc63-19a1-4d1b-9a4f-beb6cd53d515 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:52.122396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6bc63-19a1-4d1b-9a4f-beb6cd53d515 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:52.122824 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6bc63-19a1-4d1b-9a4f-beb6cd53d515 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:52.123870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6bc63-19a1-4d1b-9a4f-beb6cd53d515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:52.124630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6bc63-19a1-4d1b-9a4f-beb6cd53d515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:52.126505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6bc63-19a1-4d1b-9a4f-beb6cd53d515 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:52.127278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f6593-e3d9-4299-93af-5cd1c97f181a None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:52.152095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 408/805] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:52.152095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6bc63-19a1-4d1b-9a4f-beb6cd53d515 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:52.174188 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701910b-73b2-4005-80d5-0287c5a1e408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:52.175211 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701910b-73b2-4005-80d5-0287c5a1e408 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:52.177764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701910b-73b2-4005-80d5-0287c5a1e408 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:52.177764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701910b-73b2-4005-80d5-0287c5a1e408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:52.191361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701910b-73b2-4005-80d5-0287c5a1e408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:52.193930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701910b-73b2-4005-80d5-0287c5a1e408 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-4701910b-73b2-4005-80d5-0287c5a1e408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:52.214100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:52.215751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:52.216854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:52.216854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:52.216854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:52.218527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 398/806] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:52.219556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701910b-73b2-4005-80d5-0287c5a1e408 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:52.274503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6bc63-19a1-4d1b-9a4f-beb6cd53d515 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:52.288752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:52.312520 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3db1a-d446-4fbb-b7de-49400f8705bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:52.315173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3db1a-d446-4fbb-b7de-49400f8705bd None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:52.315173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3db1a-d446-4fbb-b7de-49400f8705bd None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:52.315173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3db1a-d446-4fbb-b7de-49400f8705bd None admin] PATH_INFO: `/v3/services/network` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:52.315173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3db1a-d446-4fbb-b7de-49400f8705bd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:52.316297 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3db1a-d446-4fbb-b7de-49400f8705bd None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:52.325146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701910b-73b2-4005-80d5-0287c5a1e408 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-65c3db1a-d446-4fbb-b7de-49400f8705bd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:52.325871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:52.327160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:38:52.328238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:52.331514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 409/807] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:52 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:52.331514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3db1a-d446-4fbb-b7de-49400f8705bd None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:52.359322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:52.365243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f98e-b184-4545-a2ac-b77b8fcef185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:52.365988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f98e-b184-4545-a2ac-b77b8fcef185 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:52.368033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f98e-b184-4545-a2ac-b77b8fcef185 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:52.368033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f98e-b184-4545-a2ac-b77b8fcef185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:52.368033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4f98e-b184-4545-a2ac-b77b8fcef185 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=59a1b0b274294a288dbf07cd99f95407) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:52.368033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4f98e-b184-4545-a2ac-b77b8fcef185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:52.369286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4f98e-b184-4545-a2ac-b77b8fcef185 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:52.386934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 399/808] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:52 2022] GET /identity/v3/role_assignments?user.id=59a1b0b274294a288dbf07cd99f95407&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:52.386934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f98e-b184-4545-a2ac-b77b8fcef185 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:52.466128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3db1a-d446-4fbb-b7de-49400f8705bd None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:52.503832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f98e-b184-4545-a2ac-b77b8fcef185 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:52.508490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597183b1-6add-40bb-b536-a5710a3174e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:52.509284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597183b1-6add-40bb-b536-a5710a3174e7 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:52.509662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597183b1-6add-40bb-b536-a5710a3174e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:52.510035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597183b1-6add-40bb-b536-a5710a3174e7 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:52.510790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597183b1-6add-40bb-b536-a5710a3174e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:52.511221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597183b1-6add-40bb-b536-a5710a3174e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:52.512759 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597183b1-6add-40bb-b536-a5710a3174e7 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:52.529993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 410/809] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:52.529993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597183b1-6add-40bb-b536-a5710a3174e7 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:52.540630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd062d-9182-4406-aef6-5a0e2bfab8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:52.541269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd062d-9182-4406-aef6-5a0e2bfab8d9 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:52.541547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd062d-9182-4406-aef6-5a0e2bfab8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:52.541824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd062d-9182-4406-aef6-5a0e2bfab8d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:52.555341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd062d-9182-4406-aef6-5a0e2bfab8d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-acbd062d-9182-4406-aef6-5a0e2bfab8d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:52.561402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:52.562578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:52.563568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 400/810] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:52.564480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0683c-f0e6-46d1-932f-7faa63c48e58 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:52.564765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0683c-f0e6-46d1-932f-7faa63c48e58 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:52.565089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0683c-f0e6-46d1-932f-7faa63c48e58 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:52.566776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 401/811] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:52.568373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0683c-f0e6-46d1-932f-7faa63c48e58 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:52.580589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:52.635632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:52.651525 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597183b1-6add-40bb-b536-a5710a3174e7 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:52.682728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0683c-f0e6-46d1-932f-7faa63c48e58 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:52.689449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537ac5b-72cc-419f-ab4a-1d11761114b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:52.690059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537ac5b-72cc-419f-ab4a-1d11761114b7 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:52.690680 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537ac5b-72cc-419f-ab4a-1d11761114b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:52.690680 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537ac5b-72cc-419f-ab4a-1d11761114b7 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:52.691310 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537ac5b-72cc-419f-ab4a-1d11761114b7 None admin] RBAC: Adding query filter params (name=network) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:52.691609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537ac5b-72cc-419f-ab4a-1d11761114b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:52.693018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537ac5b-72cc-419f-ab4a-1d11761114b7 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:52.697624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 411/812] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:38:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:52.702847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537ac5b-72cc-419f-ab4a-1d11761114b7 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:52.720431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e387b9e-b03d-4dc0-a6a3-e7c04772555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:52.721084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e387b9e-b03d-4dc0-a6a3-e7c04772555b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:52.721447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e387b9e-b03d-4dc0-a6a3-e7c04772555b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:52.721723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e387b9e-b03d-4dc0-a6a3-e7c04772555b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:52.733057 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e387b9e-b03d-4dc0-a6a3-e7c04772555b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:52.734540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e387b9e-b03d-4dc0-a6a3-e7c04772555b None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-2e387b9e-b03d-4dc0-a6a3-e7c04772555b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:52.750046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:52.751105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:52.752024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:52.752024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:52.752024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:52.752024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:52.752024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:52.752024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:52.752024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:52.752024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:52.755260 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 402/813] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:52.757171 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384a4e5-95b9-49d3-9876-b04b335cdad9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:52.757460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384a4e5-95b9-49d3-9876-b04b335cdad9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:52.757739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384a4e5-95b9-49d3-9876-b04b335cdad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:52.777610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a384a4e5-95b9-49d3-9876-b04b335cdad9 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:52.779408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a384a4e5-95b9-49d3-9876-b04b335cdad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:52.855520 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 403/814] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:52.856882 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384a4e5-95b9-49d3-9876-b04b335cdad9 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:52.910710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:52.953348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:52.958570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537ac5b-72cc-419f-ab4a-1d11761114b7 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:52.967459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384a4e5-95b9-49d3-9876-b04b335cdad9 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:53.004714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851bfd-fbf3-4746-b2be-14d7cdc85cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:53.005476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598172be-fbc0-4a9c-a859-2b9d85d73b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:53.006026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851bfd-fbf3-4746-b2be-14d7cdc85cd2 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:53.006162 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598172be-fbc0-4a9c-a859-2b9d85d73b72 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:53.006343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598172be-fbc0-4a9c-a859-2b9d85d73b72 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:53.006598 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598172be-fbc0-4a9c-a859-2b9d85d73b72 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:53.007099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851bfd-fbf3-4746-b2be-14d7cdc85cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:53.007399 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598172be-fbc0-4a9c-a859-2b9d85d73b72 None admin] RBAC: Adding query filter params (type=network) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:53.007705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598172be-fbc0-4a9c-a859-2b9d85d73b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:53.008022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851bfd-fbf3-4746-b2be-14d7cdc85cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:53.008934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851bfd-fbf3-4746-b2be-14d7cdc85cd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:53.009051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598172be-fbc0-4a9c-a859-2b9d85d73b72 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:53.009553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851bfd-fbf3-4746-b2be-14d7cdc85cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:53.011880 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851bfd-fbf3-4746-b2be-14d7cdc85cd2 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:53.014620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 404/815] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:38:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:53.019874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598172be-fbc0-4a9c-a859-2b9d85d73b72 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:53.022832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 412/816] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:53.023874 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851bfd-fbf3-4746-b2be-14d7cdc85cd2 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:53.145041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598172be-fbc0-4a9c-a859-2b9d85d73b72 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:53.159582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:53.161362 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851bfd-fbf3-4746-b2be-14d7cdc85cd2 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:53.188945 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c2f5-cc84-4d60-801b-1095939b1785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:53.189559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c2f5-cc84-4d60-801b-1095939b1785 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:53.189843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c2f5-cc84-4d60-801b-1095939b1785 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:53.190118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c2f5-cc84-4d60-801b-1095939b1785 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:53.190809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958c2f5-cc84-4d60-801b-1095939b1785 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:53.191145 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958c2f5-cc84-4d60-801b-1095939b1785 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:53.192561 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958c2f5-cc84-4d60-801b-1095939b1785 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:53.201540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c190e-0244-411c-93d5-70fdc8ec6071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:53.201985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c190e-0244-411c-93d5-70fdc8ec6071 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:53.202257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c190e-0244-411c-93d5-70fdc8ec6071 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:53.202526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c190e-0244-411c-93d5-70fdc8ec6071 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:53.203213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c190e-0244-411c-93d5-70fdc8ec6071 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:53.204561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c190e-0244-411c-93d5-70fdc8ec6071 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:53.207257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 405/817] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:53.208803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c2f5-cc84-4d60-801b-1095939b1785 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:53.304160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 413/818] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:38:53 2022] POST /identity/v3/endpoints => generated 337 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:38:53.305651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c190e-0244-411c-93d5-70fdc8ec6071 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:53.322681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c2f5-cc84-4d60-801b-1095939b1785 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:53.338514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:53.371685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef4520-d0e5-4736-a427-04957f3184eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:53.372911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef4520-d0e5-4736-a427-04957f3184eb None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:53.373191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef4520-d0e5-4736-a427-04957f3184eb None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:53.373465 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef4520-d0e5-4736-a427-04957f3184eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:53.387442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef4520-d0e5-4736-a427-04957f3184eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:53.388950 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef4520-d0e5-4736-a427-04957f3184eb None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-58ef4520-d0e5-4736-a427-04957f3184eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:53.405534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:53.406477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:53.407480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:53.407480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:53.407480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:53.407480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 406/819] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:53.407752 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef4520-d0e5-4736-a427-04957f3184eb None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:53.427959 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:53.461566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c190e-0244-411c-93d5-70fdc8ec6071 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:53.506799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffcbd4-5ee1-41e6-a3d8-fb4c0b517314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:53.507874 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffcbd4-5ee1-41e6-a3d8-fb4c0b517314 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:53.508361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffcbd4-5ee1-41e6-a3d8-fb4c0b517314 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:53.508939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffcbd4-5ee1-41e6-a3d8-fb4c0b517314 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:53.509792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffcbd4-5ee1-41e6-a3d8-fb4c0b517314 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:53.511494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffcbd4-5ee1-41e6-a3d8-fb4c0b517314 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-51ffcbd4-5ee1-41e6-a3d8-fb4c0b517314 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:53.522668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:53.523949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:38:53.524982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:53.527880 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 414/820] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Aug 29 23:38:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:53.530900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffcbd4-5ee1-41e6-a3d8-fb4c0b517314 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:53.532104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef4520-d0e5-4736-a427-04957f3184eb None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:53.584484 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ea79e-56f4-4b3c-a9a8-8796b2fdb53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:53.585143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea79e-56f4-4b3c-a9a8-8796b2fdb53c None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:53.585521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea79e-56f4-4b3c-a9a8-8796b2fdb53c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:53.585895 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea79e-56f4-4b3c-a9a8-8796b2fdb53c None admin] PATH_INFO: `/v3/projects/da13e1cbae664d5a92198052526ee459/users/ef922e08ae644f6a84034366f59d5591/roles/ec4f9fa2b3e6483f97993b78c43ea7a4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:53.609993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ea79e-56f4-4b3c-a9a8-8796b2fdb53c None admin] RBAC: Authorizing `identity:create_grant(project_id=da13e1cbae664d5a92198052526ee459, user_id=ef922e08ae644f6a84034366f59d5591, role_id=ec4f9fa2b3e6483f97993b78c43ea7a4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:53.613275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ea79e-56f4-4b3c-a9a8-8796b2fdb53c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:53.653599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:53.672218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffcbd4-5ee1-41e6-a3d8-fb4c0b517314 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:53.702915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 407/821] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:38:53 2022] PUT /identity/v3/projects/da13e1cbae664d5a92198052526ee459/users/ef922e08ae644f6a84034366f59d5591/roles/ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:53.702915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ea79e-56f4-4b3c-a9a8-8796b2fdb53c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:53.721642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d291a50-998e-4d2a-8cfe-c2c69e5f1728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:53.722255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d291a50-998e-4d2a-8cfe-c2c69e5f1728 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:53.722535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d291a50-998e-4d2a-8cfe-c2c69e5f1728 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:53.722802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d291a50-998e-4d2a-8cfe-c2c69e5f1728 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:53.723964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d291a50-998e-4d2a-8cfe-c2c69e5f1728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:53.724256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d291a50-998e-4d2a-8cfe-c2c69e5f1728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:53.726731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d291a50-998e-4d2a-8cfe-c2c69e5f1728 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:53.751348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 415/822] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:53.758939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d291a50-998e-4d2a-8cfe-c2c69e5f1728 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:53.833485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:53.881109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ea79e-56f4-4b3c-a9a8-8796b2fdb53c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:53.933362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0496a-baf3-4ac9-9b02-da2aebce4f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:53.934050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0496a-baf3-4ac9-9b02-da2aebce4f57 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:53.934934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0496a-baf3-4ac9-9b02-da2aebce4f57 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:53.935320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0496a-baf3-4ac9-9b02-da2aebce4f57 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:53.936451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0496a-baf3-4ac9-9b02-da2aebce4f57 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:53.936884 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0496a-baf3-4ac9-9b02-da2aebce4f57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:53.939226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0496a-baf3-4ac9-9b02-da2aebce4f57 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:53.950526 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 408/823] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Aug 29 23:38:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:53.952421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d291a50-998e-4d2a-8cfe-c2c69e5f1728 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:53.956167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0496a-baf3-4ac9-9b02-da2aebce4f57 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:53.989043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02157c-a516-4d16-a59f-e1b06248c279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:53.989680 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02157c-a516-4d16-a59f-e1b06248c279 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:53.989963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02157c-a516-4d16-a59f-e1b06248c279 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:53.990238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02157c-a516-4d16-a59f-e1b06248c279 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:53.998564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02157c-a516-4d16-a59f-e1b06248c279 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:54.000053 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02157c-a516-4d16-a59f-e1b06248c279 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-cd02157c-a516-4d16-a59f-e1b06248c279 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:54.013738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:54.014747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:54.015728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:54.015728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:54.015728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:54.015728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:54.015728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:54.015728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:54.015728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:54.015728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:54.015728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:38:54.015728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:54.015728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 416/824] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:54.022940 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02157c-a516-4d16-a59f-e1b06248c279 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:54.030371 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:54.111141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0496a-baf3-4ac9-9b02-da2aebce4f57 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:54.147003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:54.154289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ce756-0bf0-4c1c-87d4-15a16944d150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:54.155087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce756-0bf0-4c1c-87d4-15a16944d150 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:54.155491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce756-0bf0-4c1c-87d4-15a16944d150 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:54.155870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce756-0bf0-4c1c-87d4-15a16944d150 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:54.156611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ce756-0bf0-4c1c-87d4-15a16944d150 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:54.157017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ce756-0bf0-4c1c-87d4-15a16944d150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:54.158487 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ce756-0bf0-4c1c-87d4-15a16944d150 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:54.164133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 409/825] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Aug 29 23:38:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:54.169290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ce756-0bf0-4c1c-87d4-15a16944d150 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:54.172313 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02157c-a516-4d16-a59f-e1b06248c279 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:54.220339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904171e-8e29-4191-bf1f-987377b0adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:54.221548 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904171e-8e29-4191-bf1f-987377b0adb3 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:54.221972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904171e-8e29-4191-bf1f-987377b0adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:54.222418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904171e-8e29-4191-bf1f-987377b0adb3 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:54.223513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904171e-8e29-4191-bf1f-987377b0adb3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:54.224335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904171e-8e29-4191-bf1f-987377b0adb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:54.226201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904171e-8e29-4191-bf1f-987377b0adb3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:54.252225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 417/826] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Aug 29 23:38:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:54.253763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904171e-8e29-4191-bf1f-987377b0adb3 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:54.297517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ce756-0bf0-4c1c-87d4-15a16944d150 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:54.319236 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:54.339651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804319e-7a84-48fa-84f9-2fcb2352a510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:54.340414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804319e-7a84-48fa-84f9-2fcb2352a510 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:54.340828 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804319e-7a84-48fa-84f9-2fcb2352a510 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:54.341198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804319e-7a84-48fa-84f9-2fcb2352a510 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:54.342020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804319e-7a84-48fa-84f9-2fcb2352a510 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:54.343625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804319e-7a84-48fa-84f9-2fcb2352a510 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:54.371107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904171e-8e29-4191-bf1f-987377b0adb3 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:54.406684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceb70c-3f19-4048-92e9-fa54d1525d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:54.407376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceb70c-3f19-4048-92e9-fa54d1525d2f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:54.407652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceb70c-3f19-4048-92e9-fa54d1525d2f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:54.407919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceb70c-3f19-4048-92e9-fa54d1525d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:54.417991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceb70c-3f19-4048-92e9-fa54d1525d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:54.419813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceb70c-3f19-4048-92e9-fa54d1525d2f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:54.435291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 410/827] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:38:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-07ceb70c-3f19-4048-92e9-fa54d1525d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:54.435555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:54.436627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:54.437713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:54.437713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:54.437713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:54.439222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 418/828] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:54.439614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80207159-0768-4705-97ba-fc8e0750412d None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:54.439904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80207159-0768-4705-97ba-fc8e0750412d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:54.440180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80207159-0768-4705-97ba-fc8e0750412d None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:54.441479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 411/829] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:54.448145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceb70c-3f19-4048-92e9-fa54d1525d2f None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:54.448912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930c8ae-1811-4078-ad73-3ff5ccaa26e2 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:54.449330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930c8ae-1811-4078-ad73-3ff5ccaa26e2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:54.449708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930c8ae-1811-4078-ad73-3ff5ccaa26e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:54.476460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-3930c8ae-1811-4078-ad73-3ff5ccaa26e2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:54.478514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3930c8ae-1811-4078-ad73-3ff5ccaa26e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:54.548192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:54.562674 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceb70c-3f19-4048-92e9-fa54d1525d2f None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:54.577338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:54.586417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 412/830] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:54.601859 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053150-7921-432b-9685-38ee59334f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:54.602670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053150-7921-432b-9685-38ee59334f42 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:54.603205 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053150-7921-432b-9685-38ee59334f42 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:54.603615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053150-7921-432b-9685-38ee59334f42 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:54.609287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d053150-7921-432b-9685-38ee59334f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:54.609287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d053150-7921-432b-9685-38ee59334f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:54.609287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d053150-7921-432b-9685-38ee59334f42 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:54.619768 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 419/831] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:54.626227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930c8ae-1811-4078-ad73-3ff5ccaa26e2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:54.751802 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930c8ae-1811-4078-ad73-3ff5ccaa26e2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:54.787814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc433b3c-1c4e-4bb7-a962-e3966598ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:54.788699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc433b3c-1c4e-4bb7-a962-e3966598ccda None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:54.789126 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc433b3c-1c4e-4bb7-a962-e3966598ccda None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:54.789574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc433b3c-1c4e-4bb7-a962-e3966598ccda None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:54.797421 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc433b3c-1c4e-4bb7-a962-e3966598ccda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:54.799072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc433b3c-1c4e-4bb7-a962-e3966598ccda None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-dc433b3c-1c4e-4bb7-a962-e3966598ccda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:54.811573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:54.812646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:54.813748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:54.813748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:54.813748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:54.813748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:54.813748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:54.813748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:54.813748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:54.813748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:54.815790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 413/832] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:54.825418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053150-7921-432b-9685-38ee59334f42 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:54.858797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc433b3c-1c4e-4bb7-a962-e3966598ccda None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:54.901792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:54.933288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053150-7921-432b-9685-38ee59334f42 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:54.972531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762ee7b-d0d7-4fb4-aa20-4e7547a2728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:54.973326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762ee7b-d0d7-4fb4-aa20-4e7547a2728c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:54.973613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762ee7b-d0d7-4fb4-aa20-4e7547a2728c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:54.973888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762ee7b-d0d7-4fb4-aa20-4e7547a2728c None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:54.974768 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762ee7b-d0d7-4fb4-aa20-4e7547a2728c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:54.974984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762ee7b-d0d7-4fb4-aa20-4e7547a2728c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:54.976454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762ee7b-d0d7-4fb4-aa20-4e7547a2728c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:54.993563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc433b3c-1c4e-4bb7-a962-e3966598ccda None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:54.994775 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 420/833] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:54.996066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762ee7b-d0d7-4fb4-aa20-4e7547a2728c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:55.031511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:55.037666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c0c28-ef9d-4b5b-9718-f5266930d485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:55.038311 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c0c28-ef9d-4b5b-9718-f5266930d485 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:55.038591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c0c28-ef9d-4b5b-9718-f5266930d485 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:55.038863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c0c28-ef9d-4b5b-9718-f5266930d485 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:55.039468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c0c28-ef9d-4b5b-9718-f5266930d485 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:55.040820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c0c28-ef9d-4b5b-9718-f5266930d485 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-0c1c0c28-ef9d-4b5b-9718-f5266930d485 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:55.053191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:55.054163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:38:55.055478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:55.059585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 414/834] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Aug 29 23:38:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:55.061184 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c0c28-ef9d-4b5b-9718-f5266930d485 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:55.111494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762ee7b-d0d7-4fb4-aa20-4e7547a2728c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:55.147504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb85f2b-b765-4fdd-88e6-1b20348c96cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:55.148513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85f2b-b765-4fdd-88e6-1b20348c96cb None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:55.148991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85f2b-b765-4fdd-88e6-1b20348c96cb None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:55.149460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85f2b-b765-4fdd-88e6-1b20348c96cb None admin] PATH_INFO: `/v3/projects/da13e1cbae664d5a92198052526ee459/users/a75fb249079b4831be08cc4c9f94d6df/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:55.151682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb85f2b-b765-4fdd-88e6-1b20348c96cb None admin] RBAC: Authorizing `identity:create_grant(project_id=da13e1cbae664d5a92198052526ee459, user_id=a75fb249079b4831be08cc4c9f94d6df, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:55.153959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb85f2b-b765-4fdd-88e6-1b20348c96cb None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:55.183571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:55.186507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c0c28-ef9d-4b5b-9718-f5266930d485 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:55.221133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb953a-3d1c-478b-b4f4-cfc8d3d5f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:55.221741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb953a-3d1c-478b-b4f4-cfc8d3d5f346 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:55.222016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb953a-3d1c-478b-b4f4-cfc8d3d5f346 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:55.222298 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb953a-3d1c-478b-b4f4-cfc8d3d5f346 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:55.222924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb953a-3d1c-478b-b4f4-cfc8d3d5f346 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:55.223227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb953a-3d1c-478b-b4f4-cfc8d3d5f346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:55.224563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb953a-3d1c-478b-b4f4-cfc8d3d5f346 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:55.230981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 415/835] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Aug 29 23:38:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:55.236774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb953a-3d1c-478b-b4f4-cfc8d3d5f346 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:55.238720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 421/836] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:38:54 2022] PUT /identity/v3/projects/da13e1cbae664d5a92198052526ee459/users/a75fb249079b4831be08cc4c9f94d6df/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:38:55.356053 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb953a-3d1c-478b-b4f4-cfc8d3d5f346 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:55.393318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fac3a8-01fc-40ac-b9ad-9a9442814311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:55.393921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac3a8-01fc-40ac-b9ad-9a9442814311 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:55.394205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac3a8-01fc-40ac-b9ad-9a9442814311 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:55.394480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac3a8-01fc-40ac-b9ad-9a9442814311 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:55.395170 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fac3a8-01fc-40ac-b9ad-9a9442814311 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:55.395451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fac3a8-01fc-40ac-b9ad-9a9442814311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:55.396818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fac3a8-01fc-40ac-b9ad-9a9442814311 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:55.402474 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 416/837] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Aug 29 23:38:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:55.739096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b83038-eacd-4f87-93e1-ceb3d90ac37f None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:55.739584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b83038-eacd-4f87-93e1-ceb3d90ac37f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:55.739584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b83038-eacd-4f87-93e1-ceb3d90ac37f None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:55.741154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 422/838] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:55.746495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1346f50-7743-476c-8614-3b7cbad54f97 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:55.747320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1346f50-7743-476c-8614-3b7cbad54f97 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:55.747596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1346f50-7743-476c-8614-3b7cbad54f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:55.766498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-e1346f50-7743-476c-8614-3b7cbad54f97 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:55.767727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e1346f50-7743-476c-8614-3b7cbad54f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:55.792118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:55.840422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 417/839] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:56.108226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b83038-eacd-4f87-93e1-ceb3d90ac37f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:56.204289 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:56.213810 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b83038-eacd-4f87-93e1-ceb3d90ac37f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:56.248728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366f5a0-0bc3-4950-96c6-b1e894d4996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:56.249556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366f5a0-0bc3-4950-96c6-b1e894d4996b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:56.250009 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366f5a0-0bc3-4950-96c6-b1e894d4996b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:56.250277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366f5a0-0bc3-4950-96c6-b1e894d4996b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:56.261109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366f5a0-0bc3-4950-96c6-b1e894d4996b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-3366f5a0-0bc3-4950-96c6-b1e894d4996b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:56.266151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:56.274378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:56.275265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 423/840] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:38:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:56.277689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1346f50-7743-476c-8614-3b7cbad54f97 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:56.382768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1346f50-7743-476c-8614-3b7cbad54f97 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:56.421260 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecf0de-d034-452f-9924-1cbbf09e3250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:56.422261 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecf0de-d034-452f-9924-1cbbf09e3250 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:56.422743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecf0de-d034-452f-9924-1cbbf09e3250 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:56.423344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecf0de-d034-452f-9924-1cbbf09e3250 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:56.424276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ecf0de-d034-452f-9924-1cbbf09e3250 None admin] RBAC: Adding query filter params (name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:56.424793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ecf0de-d034-452f-9924-1cbbf09e3250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:56.426415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ecf0de-d034-452f-9924-1cbbf09e3250 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:56.436101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 418/841] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:38:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:56.441819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366f5a0-0bc3-4950-96c6-b1e894d4996b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:56.529717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fa6d7-cfdc-4364-8f84-c485dc2a96b4 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:56.530369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fa6d7-cfdc-4364-8f84-c485dc2a96b4 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:56.530856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fa6d7-cfdc-4364-8f84-c485dc2a96b4 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:56.532763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 419/842] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:38:56.540202 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ae86a-2f41-4c09-92ac-99b603d2e19f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:56.540738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ae86a-2f41-4c09-92ac-99b603d2e19f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:56.541210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ae86a-2f41-4c09-92ac-99b603d2e19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:56.549156 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366f5a0-0bc3-4950-96c6-b1e894d4996b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:56.564859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-026ae86a-2f41-4c09-92ac-99b603d2e19f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:56.566573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-026ae86a-2f41-4c09-92ac-99b603d2e19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:56.584278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e52ac-1d85-4011-9299-905df2511f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:56.584906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e52ac-1d85-4011-9299-905df2511f74 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:56.585182 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e52ac-1d85-4011-9299-905df2511f74 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:56.585450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e52ac-1d85-4011-9299-905df2511f74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:56.586287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:56.599277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e52ac-1d85-4011-9299-905df2511f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:56.600973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e52ac-1d85-4011-9299-905df2511f74 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-c04e52ac-1d85-4011-9299-905df2511f74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:56.619223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:56.632843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:56.633728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:56.633728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:56.633728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:56.633728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 424/843] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:56.633728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e52ac-1d85-4011-9299-905df2511f74 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:56.633728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:56.650916 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 420/844] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:56.739336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e52ac-1d85-4011-9299-905df2511f74 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:56.774581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749aa1f-81b0-4b1e-9873-502ef496ae68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:56.775240 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749aa1f-81b0-4b1e-9873-502ef496ae68 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:56.775630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749aa1f-81b0-4b1e-9873-502ef496ae68 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:56.775903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749aa1f-81b0-4b1e-9873-502ef496ae68 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:56.776547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749aa1f-81b0-4b1e-9873-502ef496ae68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:56.776849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749aa1f-81b0-4b1e-9873-502ef496ae68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:56.778734 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749aa1f-81b0-4b1e-9873-502ef496ae68 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:56.791202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 425/845] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:56.800023 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ae86a-2f41-4c09-92ac-99b603d2e19f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:56.902966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ae86a-2f41-4c09-92ac-99b603d2e19f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:56.938218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f78c0-3de0-4281-82cd-40c6e17f9b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:56.938848 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f78c0-3de0-4281-82cd-40c6e17f9b4b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:56.939156 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f78c0-3de0-4281-82cd-40c6e17f9b4b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:56.939430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f78c0-3de0-4281-82cd-40c6e17f9b4b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:56.946814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f78c0-3de0-4281-82cd-40c6e17f9b4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:56.948345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f78c0-3de0-4281-82cd-40c6e17f9b4b None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:56.956865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749aa1f-81b0-4b1e-9873-502ef496ae68 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-b21f78c0-3de0-4281-82cd-40c6e17f9b4b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:56.960533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:56.961476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:56.962383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:56.962383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:56.962383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:56.962383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:56.962383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:56.962383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:56.962383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:56.962383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:56.962383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:38:56.962383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:56.962383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 421/846] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Aug 29 23:38:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:56.968798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f78c0-3de0-4281-82cd-40c6e17f9b4b None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:57.027253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:57.039116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:57.079992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749aa1f-81b0-4b1e-9873-502ef496ae68 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:57.085152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f78c0-3de0-4281-82cd-40c6e17f9b4b None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:57.119588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eac85-a134-43a7-85fa-9a17354743a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:57.120757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eac85-a134-43a7-85fa-9a17354743a2 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:57.121540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eac85-a134-43a7-85fa-9a17354743a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:57.122845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eac85-a134-43a7-85fa-9a17354743a2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:57.123948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251eac85-a134-43a7-85fa-9a17354743a2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:57.125308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251eac85-a134-43a7-85fa-9a17354743a2 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:57.127447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5e863-c1fc-4d73-9bda-d477eded98e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:57.128502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5e863-c1fc-4d73-9bda-d477eded98e1 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:57.128933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5e863-c1fc-4d73-9bda-d477eded98e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:57.129557 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5e863-c1fc-4d73-9bda-d477eded98e1 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:57.130559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5e863-c1fc-4d73-9bda-d477eded98e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:57.137176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5e863-c1fc-4d73-9bda-d477eded98e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:57.137176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5e863-c1fc-4d73-9bda-d477eded98e1 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-251eac85-a134-43a7-85fa-9a17354743a2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:57.137406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:57.138381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:38:57.139246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:57.143176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 426/847] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:38:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:57.144166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eac85-a134-43a7-85fa-9a17354743a2 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:57.155556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 422/848] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Aug 29 23:38:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:57.160750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5e863-c1fc-4d73-9bda-d477eded98e1 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:57.255659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eac85-a134-43a7-85fa-9a17354743a2 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:57.272313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5e863-c1fc-4d73-9bda-d477eded98e1 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:57.275607 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:57.282901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:57.291007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bcf79-7006-41dc-93d6-a1da974e4a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:57.291723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bcf79-7006-41dc-93d6-a1da974e4a9b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:57.292070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bcf79-7006-41dc-93d6-a1da974e4a9b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:57.292409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bcf79-7006-41dc-93d6-a1da974e4a9b None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:57.293116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bcf79-7006-41dc-93d6-a1da974e4a9b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:57.293464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bcf79-7006-41dc-93d6-a1da974e4a9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:57.295554 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bcf79-7006-41dc-93d6-a1da974e4a9b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:57.304862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 427/849] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:38:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:57.305505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a335-d8d2-4f9d-b16e-1e35db5d27c2 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:57.305796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a335-d8d2-4f9d-b16e-1e35db5d27c2 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:57.306075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a335-d8d2-4f9d-b16e-1e35db5d27c2 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:57.307542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 428/850] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:38:57.308307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145a335-d8d2-4f9d-b16e-1e35db5d27c2 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:57.321536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dc680-0147-4b6c-9aff-778de0e1ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:57.322157 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dc680-0147-4b6c-9aff-778de0e1ac8a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:57.322427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dc680-0147-4b6c-9aff-778de0e1ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:57.322704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dc680-0147-4b6c-9aff-778de0e1ac8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:57.390312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dc680-0147-4b6c-9aff-778de0e1ac8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:57.391770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dc680-0147-4b6c-9aff-778de0e1ac8a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:57.411351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145a335-d8d2-4f9d-b16e-1e35db5d27c2 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:57.444906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74183fac-6298-4dc8-a955-8d7c2f100781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:57.445503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74183fac-6298-4dc8-a955-8d7c2f100781 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:57.445781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74183fac-6298-4dc8-a955-8d7c2f100781 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:57.446049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74183fac-6298-4dc8-a955-8d7c2f100781 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:57.446668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74183fac-6298-4dc8-a955-8d7c2f100781 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:57.446994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74183fac-6298-4dc8-a955-8d7c2f100781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:57.448340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74183fac-6298-4dc8-a955-8d7c2f100781 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:57.452776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 429/851] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:38:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:57.453736 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dea51-1e4f-407d-bc33-97e82b9a2cee None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:57.454023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dea51-1e4f-407d-bc33-97e82b9a2cee None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:57.454291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dea51-1e4f-407d-bc33-97e82b9a2cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:57.467636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:57.474431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e38dea51-1e4f-407d-bc33-97e82b9a2cee None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:57.475714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e38dea51-1e4f-407d-bc33-97e82b9a2cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:57.499811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 423/852] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 23:38:57.499811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd506b7e-dd7b-49b0-b3e2-c56e1953c2f0 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:57.499811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd506b7e-dd7b-49b0-b3e2-c56e1953c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:57.499811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd506b7e-dd7b-49b0-b3e2-c56e1953c2f0 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:57.499811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 424/853] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:57.501636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd506b7e-dd7b-49b0-b3e2-c56e1953c2f0 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:57.541284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:57.560532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 430/854] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:57.561592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c7639-6a46-466f-8be9-7df5d9ca4348 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:57.561877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c7639-6a46-466f-8be9-7df5d9ca4348 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:57.562234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c7639-6a46-466f-8be9-7df5d9ca4348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:57.581372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a78c7639-6a46-466f-8be9-7df5d9ca4348 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:57.582598 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a78c7639-6a46-466f-8be9-7df5d9ca4348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:57.638307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd506b7e-dd7b-49b0-b3e2-c56e1953c2f0 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:57.663789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 431/855] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:57.675804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c809b-d2f8-4895-b77f-04356a03cf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:57.676700 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c809b-d2f8-4895-b77f-04356a03cf7d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:57.677186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c809b-d2f8-4895-b77f-04356a03cf7d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:57.677676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c809b-d2f8-4895-b77f-04356a03cf7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:57.688858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c809b-d2f8-4895-b77f-04356a03cf7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:57.690534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c809b-d2f8-4895-b77f-04356a03cf7d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-050c809b-d2f8-4895-b77f-04356a03cf7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:57.706540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:57.707642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:57.708776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:57.708776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:57.708776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:57.714820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 425/856] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:57.717528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c7639-6a46-466f-8be9-7df5d9ca4348 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:57.837323 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c7639-6a46-466f-8be9-7df5d9ca4348 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:57.854982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:57.872268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c809b-d2f8-4895-b77f-04356a03cf7d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:57.872477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b330f-1be0-4f5e-ac8b-e041cee78e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:57.873036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b330f-1be0-4f5e-ac8b-e041cee78e8c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:57.873326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b330f-1be0-4f5e-ac8b-e041cee78e8c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:57.873690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b330f-1be0-4f5e-ac8b-e041cee78e8c None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:57.874326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b330f-1be0-4f5e-ac8b-e041cee78e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:57.874628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b330f-1be0-4f5e-ac8b-e041cee78e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:57.876137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b330f-1be0-4f5e-ac8b-e041cee78e8c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:57.891896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 432/857] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:57.898752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b330f-1be0-4f5e-ac8b-e041cee78e8c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:57.902150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:58.002343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c809b-d2f8-4895-b77f-04356a03cf7d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:58.007319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b330f-1be0-4f5e-ac8b-e041cee78e8c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:58.038570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992c985-f08f-4d93-9cce-fd3c1f7352af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:58.039324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992c985-f08f-4d93-9cce-fd3c1f7352af None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:58.039613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992c985-f08f-4d93-9cce-fd3c1f7352af None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:58.039886 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992c985-f08f-4d93-9cce-fd3c1f7352af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:58.043511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ca82f-e5cc-4269-acdb-7edcbc10692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:58.044298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca82f-e5cc-4269-acdb-7edcbc10692f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:58.044750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca82f-e5cc-4269-acdb-7edcbc10692f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:58.045018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca82f-e5cc-4269-acdb-7edcbc10692f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:58.050067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992c985-f08f-4d93-9cce-fd3c1f7352af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:38:58.052193 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ca82f-e5cc-4269-acdb-7edcbc10692f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:58.053670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ca82f-e5cc-4269-acdb-7edcbc10692f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-d992c985-f08f-4d93-9cce-fd3c1f7352af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:38:58.054855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:58.055838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:58.056706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:58.056706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:58.056706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:58.056706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:58.056706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:38:58.056706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:38:58.056706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:38:58.056706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:38:58.056706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:38:58.056706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:38:58.056706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:38:58.056706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:58.061297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 426/858] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:58.062010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992c985-f08f-4d93-9cce-fd3c1f7352af None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-622ca82f-e5cc-4269-acdb-7edcbc10692f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:58.068657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:58.069560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:58.070468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:58.070468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:58.070468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:58.070468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:58.070468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:58.070468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:58.070468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:58.070468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:58.070468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 433/859] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:38:58.071006 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ca82f-e5cc-4269-acdb-7edcbc10692f None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:58.110558 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:58.151627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:58.172561 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992c985-f08f-4d93-9cce-fd3c1f7352af None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:58.179322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ca82f-e5cc-4269-acdb-7edcbc10692f None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:58.210025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e1a76-934c-4750-a1cc-79cb7140e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:58.210986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e1a76-934c-4750-a1cc-79cb7140e28a None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:58.211268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e1a76-934c-4750-a1cc-79cb7140e28a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:58.211539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e1a76-934c-4750-a1cc-79cb7140e28a None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:58.212180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e1a76-934c-4750-a1cc-79cb7140e28a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:58.213532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e1a76-934c-4750-a1cc-79cb7140e28a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:58.217965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4fbe7-24ce-4b28-83ae-6464488e1297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:58.218565 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4fbe7-24ce-4b28-83ae-6464488e1297 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:58.218945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4fbe7-24ce-4b28-83ae-6464488e1297 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:58.219215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4fbe7-24ce-4b28-83ae-6464488e1297 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:58.219894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4fbe7-24ce-4b28-83ae-6464488e1297 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:58.220189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4fbe7-24ce-4b28-83ae-6464488e1297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:58.221515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4fbe7-24ce-4b28-83ae-6464488e1297 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:58.229743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 434/860] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:38:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:58.230503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4fbe7-24ce-4b28-83ae-6464488e1297 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:58.305961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 427/861] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:38:58 2022] POST /identity/v3/services => generated 269 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:38:58.306871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e1a76-934c-4750-a1cc-79cb7140e28a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:58.333787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:58.337804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4fbe7-24ce-4b28-83ae-6464488e1297 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:58.402070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8bf3a-c519-4050-a52d-a5f24af6ce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:58.402801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8bf3a-c519-4050-a52d-a5f24af6ce46 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:58.403212 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8bf3a-c519-4050-a52d-a5f24af6ce46 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:58.403560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8bf3a-c519-4050-a52d-a5f24af6ce46 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:58.405071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8bf3a-c519-4050-a52d-a5f24af6ce46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:58.405489 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8bf3a-c519-4050-a52d-a5f24af6ce46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:58.407044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8bf3a-c519-4050-a52d-a5f24af6ce46 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:58.430917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 435/862] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:58.433194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8bf3a-c519-4050-a52d-a5f24af6ce46 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:58.441445 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e1a76-934c-4750-a1cc-79cb7140e28a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:58.495726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a19f5-027a-4b63-953b-e1f737a16caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:58.496426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a19f5-027a-4b63-953b-e1f737a16caa None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:58.497274 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a19f5-027a-4b63-953b-e1f737a16caa None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:58.497551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a19f5-027a-4b63-953b-e1f737a16caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:58.509198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:58.511550 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a19f5-027a-4b63-953b-e1f737a16caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:58.513028 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a19f5-027a-4b63-953b-e1f737a16caa None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-9a2a19f5-027a-4b63-953b-e1f737a16caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:58.527887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:58.529004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:58.529901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:58.529901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:58.529901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:58.529901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 428/863] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:58.534977 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a19f5-027a-4b63-953b-e1f737a16caa None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:58.571676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8bf3a-c519-4050-a52d-a5f24af6ce46 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:58.620124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668843bf-bc03-437c-96f3-314ae09bc1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:58.621594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668843bf-bc03-437c-96f3-314ae09bc1c4 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:58.622687 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668843bf-bc03-437c-96f3-314ae09bc1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:58.623563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668843bf-bc03-437c-96f3-314ae09bc1c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:58.624793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668843bf-bc03-437c-96f3-314ae09bc1c4 None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=ef922e08ae644f6a84034366f59d5591) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:58.625329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668843bf-bc03-437c-96f3-314ae09bc1c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:58.628098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668843bf-bc03-437c-96f3-314ae09bc1c4 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:58.637027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 436/864] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:38:58 2022] GET /identity/v3/role_assignments?user.id=ef922e08ae644f6a84034366f59d5591&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:38:58.651269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a19f5-027a-4b63-953b-e1f737a16caa None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:58.692493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c31d0-72ce-4984-927f-800ed2c95876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:58.693444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c31d0-72ce-4984-927f-800ed2c95876 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:58.693910 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c31d0-72ce-4984-927f-800ed2c95876 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:58.694399 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c31d0-72ce-4984-927f-800ed2c95876 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:58.695281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c31d0-72ce-4984-927f-800ed2c95876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:58.695770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c31d0-72ce-4984-927f-800ed2c95876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:58.697341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c31d0-72ce-4984-927f-800ed2c95876 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:58.711802 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 429/865] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:58.720016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668843bf-bc03-437c-96f3-314ae09bc1c4 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:58.743541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:58.835380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668843bf-bc03-437c-96f3-314ae09bc1c4 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:58.873039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bf791-b8a0-4a64-8454-2c4c3b9d81eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:58.873694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bf791-b8a0-4a64-8454-2c4c3b9d81eb None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:58.873942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bf791-b8a0-4a64-8454-2c4c3b9d81eb None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:58.874284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bf791-b8a0-4a64-8454-2c4c3b9d81eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:58.885738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bf791-b8a0-4a64-8454-2c4c3b9d81eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:58.887231 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bf791-b8a0-4a64-8454-2c4c3b9d81eb None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-712bf791-b8a0-4a64-8454-2c4c3b9d81eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:38:58.899226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:58.900410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:58.901590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:58.901590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:58.901590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:38:58.901590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:38:58.901590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:38:58.901590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:38:58.901590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:38:58.901590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:38:58.901590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:38:58.901590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:58.901590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 437/866] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:38:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:58.907828 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c31d0-72ce-4984-927f-800ed2c95876 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:58.966409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:59.019586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c31d0-72ce-4984-927f-800ed2c95876 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:59.056343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a3afa-eccf-41e4-9a07-347429e6073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:59.056956 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a3afa-eccf-41e4-9a07-347429e6073a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:59.057235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a3afa-eccf-41e4-9a07-347429e6073a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:59.057511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a3afa-eccf-41e4-9a07-347429e6073a None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:59.058241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a3afa-eccf-41e4-9a07-347429e6073a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:59.058546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a3afa-eccf-41e4-9a07-347429e6073a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:59.060037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a3afa-eccf-41e4-9a07-347429e6073a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:59.078439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 430/867] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Aug 29 23:38:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:59.083753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bf791-b8a0-4a64-8454-2c4c3b9d81eb None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:59.171536 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:59.193579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bf791-b8a0-4a64-8454-2c4c3b9d81eb None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:59.229740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb47ae-04a9-43bc-8059-754404716e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:59.230353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb47ae-04a9-43bc-8059-754404716e75 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:59.230629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb47ae-04a9-43bc-8059-754404716e75 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:59.230963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb47ae-04a9-43bc-8059-754404716e75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:59.301764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb47ae-04a9-43bc-8059-754404716e75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:59.303237 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb47ae-04a9-43bc-8059-754404716e75 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:59.388865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:59.412653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 438/868] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:38:59 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:38:59.418232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a3afa-eccf-41e4-9a07-347429e6073a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:59.521884 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c489-6ddf-43df-a091-6e55d4c1c516 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:59.522396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c489-6ddf-43df-a091-6e55d4c1c516 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:59.522665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c489-6ddf-43df-a091-6e55d4c1c516 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:59.525196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 439/869] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:38:59.531981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e69a4-0cc8-4459-8a34-7fd64e3417f9 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:59.532386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e69a4-0cc8-4459-8a34-7fd64e3417f9 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:59.532792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e69a4-0cc8-4459-8a34-7fd64e3417f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:59.541697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a3afa-eccf-41e4-9a07-347429e6073a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:59.553751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:59.561230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-0e9e69a4-0cc8-4459-8a34-7fd64e3417f9 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:38:59.563193 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0e9e69a4-0cc8-4459-8a34-7fd64e3417f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:38:59.579027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8cb3e-6a3d-49da-98f7-08bf8fe563df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:59.579998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8cb3e-6a3d-49da-98f7-08bf8fe563df None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:59.580287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8cb3e-6a3d-49da-98f7-08bf8fe563df None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:59.580669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8cb3e-6a3d-49da-98f7-08bf8fe563df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:59.594241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8cb3e-6a3d-49da-98f7-08bf8fe563df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:59.595739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8cb3e-6a3d-49da-98f7-08bf8fe563df None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-20d8cb3e-6a3d-49da-98f7-08bf8fe563df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:38:59.611280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:59.612229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:38:59.613106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:38:59.613106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:38:59.613106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:38:59.613106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 431/870] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:59.618107 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8cb3e-6a3d-49da-98f7-08bf8fe563df None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:59.659187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 440/871] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:38:59 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:38:59.721703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8cb3e-6a3d-49da-98f7-08bf8fe563df None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:59.757134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96074c01-ea26-4bae-8e6c-6d84114c6ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:59.757752 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96074c01-ea26-4bae-8e6c-6d84114c6ab3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:59.758033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96074c01-ea26-4bae-8e6c-6d84114c6ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:59.758310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96074c01-ea26-4bae-8e6c-6d84114c6ab3 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:59.758988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96074c01-ea26-4bae-8e6c-6d84114c6ab3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:38:59.759294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96074c01-ea26-4bae-8e6c-6d84114c6ab3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:59.760652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96074c01-ea26-4bae-8e6c-6d84114c6ab3 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:59.773674 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 432/872] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:38:59.779178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e69a4-0cc8-4459-8a34-7fd64e3417f9 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:38:59.904437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e69a4-0cc8-4459-8a34-7fd64e3417f9 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:38:59.914626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:38:59.941653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bfaf0-2133-4939-9287-fd078c24cd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:38:59.942293 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bfaf0-2133-4939-9287-fd078c24cd45 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:38:59.942644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bfaf0-2133-4939-9287-fd078c24cd45 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:38:59.942963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bfaf0-2133-4939-9287-fd078c24cd45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:38:59.951010 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bfaf0-2133-4939-9287-fd078c24cd45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:38:59.952514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bfaf0-2133-4939-9287-fd078c24cd45 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-730bfaf0-2133-4939-9287-fd078c24cd45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:38:59.964370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:38:59.965325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:38:59.968273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:38:59.968273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:38:59.968273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:38:59.968273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:38:59.968273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:38:59.968273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:38:59.968273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:38:59.968273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:38:59.968273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 441/873] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:38:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:38:59.975001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96074c01-ea26-4bae-8e6c-6d84114c6ab3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:00.002072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:00.003767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bfaf0-2133-4939-9287-fd078c24cd45 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:00.082288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96074c01-ea26-4bae-8e6c-6d84114c6ab3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:00.113040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bfaf0-2133-4939-9287-fd078c24cd45 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:00.118740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee51ab-d6e5-49f7-8b25-be79ad4c9188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:00.119498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee51ab-d6e5-49f7-8b25-be79ad4c9188 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:00.119883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee51ab-d6e5-49f7-8b25-be79ad4c9188 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:00.120252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee51ab-d6e5-49f7-8b25-be79ad4c9188 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:00.121048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee51ab-d6e5-49f7-8b25-be79ad4c9188 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:00.121461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee51ab-d6e5-49f7-8b25-be79ad4c9188 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:00.123795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee51ab-d6e5-49f7-8b25-be79ad4c9188 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:00.141230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 433/874] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:38:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:00.142292 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee51ab-d6e5-49f7-8b25-be79ad4c9188 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:00.151719 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d50161-7d16-4f2f-a767-f6f01aecc8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:00.152413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d50161-7d16-4f2f-a767-f6f01aecc8d1 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:00.152703 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d50161-7d16-4f2f-a767-f6f01aecc8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:00.153014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d50161-7d16-4f2f-a767-f6f01aecc8d1 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:00.153682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d50161-7d16-4f2f-a767-f6f01aecc8d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:00.155218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d50161-7d16-4f2f-a767-f6f01aecc8d1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:00.237223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:00.256072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee51ab-d6e5-49f7-8b25-be79ad4c9188 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:00.271439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 442/875] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:39:00 2022] POST /identity/v3/services => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:39:00.293114 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc37e30-4c77-4755-a7b9-fa84471edf5b None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:00.293448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc37e30-4c77-4755-a7b9-fa84471edf5b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:00.294217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc37e30-4c77-4755-a7b9-fa84471edf5b None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:00.295926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 443/876] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:39:00.301410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6db45-b555-496e-bdf5-07846c73258f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:00.301688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6db45-b555-496e-bdf5-07846c73258f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:00.302027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6db45-b555-496e-bdf5-07846c73258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:00.304055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b7416-7c08-4353-9638-40ce83bdb350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:00.304866 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b7416-7c08-4353-9638-40ce83bdb350 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:00.305340 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b7416-7c08-4353-9638-40ce83bdb350 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:00.305779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b7416-7c08-4353-9638-40ce83bdb350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:00.306674 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b7416-7c08-4353-9638-40ce83bdb350 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=a75fb249079b4831be08cc4c9f94d6df) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:00.307201 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b7416-7c08-4353-9638-40ce83bdb350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:00.308809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b7416-7c08-4353-9638-40ce83bdb350 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:00.321894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-95c6db45-b555-496e-bdf5-07846c73258f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:00.322291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 434/877] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:39:00 2022] GET /identity/v3/role_assignments?user.id=a75fb249079b4831be08cc4c9f94d6df&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:00.323533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-95c6db45-b555-496e-bdf5-07846c73258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:00.362268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:00.407615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 444/878] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:00.685522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b7416-7c08-4353-9638-40ce83bdb350 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:00.794336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b7416-7c08-4353-9638-40ce83bdb350 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:00.816290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afa379-1bc0-4987-9a15-ae58dc2583d0 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:00.816557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afa379-1bc0-4987-9a15-ae58dc2583d0 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:00.816839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afa379-1bc0-4987-9a15-ae58dc2583d0 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:00.818456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 445/879] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:39:00.823767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c0493-b72e-4bd8-bf71-cd6639d6b08e None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:00.824053 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c0493-b72e-4bd8-bf71-cd6639d6b08e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:00.824329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c0493-b72e-4bd8-bf71-cd6639d6b08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:00.830728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef9cc9-b361-45a4-9a47-4bdcf3ef4ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:00.831727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef9cc9-b361-45a4-9a47-4bdcf3ef4ae2 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:00.832231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef9cc9-b361-45a4-9a47-4bdcf3ef4ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:00.832717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef9cc9-b361-45a4-9a47-4bdcf3ef4ae2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:00.833521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef9cc9-b361-45a4-9a47-4bdcf3ef4ae2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:00.835131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef9cc9-b361-45a4-9a47-4bdcf3ef4ae2 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:00.844253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-497c0493-b72e-4bd8-bf71-cd6639d6b08e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-d5ef9cc9-b361-45a4-9a47-4bdcf3ef4ae2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:00.845385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:00.846597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:39:00.847841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:00.848776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-497c0493-b72e-4bd8-bf71-cd6639d6b08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:00.850374 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 435/880] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Aug 29 23:39:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:00.860434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef9cc9-b361-45a4-9a47-4bdcf3ef4ae2 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:00.872396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:00.931149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 446/881] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:00.977890 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef9cc9-b361-45a4-9a47-4bdcf3ef4ae2 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:01.012397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d4094-49e8-4bc7-a232-a74057509572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:01.013006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d4094-49e8-4bc7-a232-a74057509572 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:01.013336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d4094-49e8-4bc7-a232-a74057509572 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:01.013610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d4094-49e8-4bc7-a232-a74057509572 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:01.014289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d4094-49e8-4bc7-a232-a74057509572 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:01.014590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d4094-49e8-4bc7-a232-a74057509572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:01.016000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d4094-49e8-4bc7-a232-a74057509572 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:01.021041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 436/882] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Aug 29 23:39:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:01.026704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c0493-b72e-4bd8-bf71-cd6639d6b08e None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:01.117765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:01.130246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c0493-b72e-4bd8-bf71-cd6639d6b08e None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:01.165817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816949e0-016c-4d79-9298-6ae94e3627aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:01.166691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816949e0-016c-4d79-9298-6ae94e3627aa None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:01.167191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816949e0-016c-4d79-9298-6ae94e3627aa None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:01.167640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816949e0-016c-4d79-9298-6ae94e3627aa None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:01.169092 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816949e0-016c-4d79-9298-6ae94e3627aa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:01.169570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816949e0-016c-4d79-9298-6ae94e3627aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:01.171121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816949e0-016c-4d79-9298-6ae94e3627aa None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:01.176559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 447/883] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Aug 29 23:39:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:01.182524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d4094-49e8-4bc7-a232-a74057509572 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:01.220506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816949e0-016c-4d79-9298-6ae94e3627aa None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:01.262150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:01.305806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d4094-49e8-4bc7-a232-a74057509572 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:01.329611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816949e0-016c-4d79-9298-6ae94e3627aa None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:01.349890 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2160db-0d2c-4763-ace2-79285f97da67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:01.350826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2160db-0d2c-4763-ace2-79285f97da67 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:01.351312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2160db-0d2c-4763-ace2-79285f97da67 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:01.351819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2160db-0d2c-4763-ace2-79285f97da67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:01.352690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2160db-0d2c-4763-ace2-79285f97da67 None admin] RBAC: Adding query filter params (interface=public, service_id=ef5d5ed698ee48ca87ed54355be42274, region_id=RegionOne) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:01.353588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2160db-0d2c-4763-ace2-79285f97da67 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:01.355658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2160db-0d2c-4763-ace2-79285f97da67 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:01.369511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 437/884] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Aug 29 23:39:01 2022] GET /identity/v3/endpoints?service_id=ef5d5ed698ee48ca87ed54355be42274&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:01.370681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd10853-6706-4382-85ee-3ce799396847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:01.370839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2160db-0d2c-4763-ace2-79285f97da67 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:01.371569 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd10853-6706-4382-85ee-3ce799396847 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:01.371924 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd10853-6706-4382-85ee-3ce799396847 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:01.372583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd10853-6706-4382-85ee-3ce799396847 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:01.385555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd10853-6706-4382-85ee-3ce799396847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-5fd10853-6706-4382-85ee-3ce799396847 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:39:01.391561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:01.392478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:01.393321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:01.393321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:01.393321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:01.393321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:01.393321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:39:01.393321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:39:01.393321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:39:01.393321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:39:01.393321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:39:01.393321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:39:01.393321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:39:01.393321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:01.397845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 448/885] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Aug 29 23:39:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:01.398794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd10853-6706-4382-85ee-3ce799396847 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:01.424403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:01.481303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2160db-0d2c-4763-ace2-79285f97da67 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:01.511387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd10853-6706-4382-85ee-3ce799396847 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:01.519692 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313862e-38cc-4bce-9c7d-750db110b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:01.520621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313862e-38cc-4bce-9c7d-750db110b047 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:01.521080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313862e-38cc-4bce-9c7d-750db110b047 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:01.521545 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313862e-38cc-4bce-9c7d-750db110b047 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:01.522434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313862e-38cc-4bce-9c7d-750db110b047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:01.524074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313862e-38cc-4bce-9c7d-750db110b047 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:01.525588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:01.539230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 438/886] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Aug 29 23:39:01 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:39:01.554234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fcf8e-948f-410d-b325-fb7abbd9c224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:01.555050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fcf8e-948f-410d-b325-fb7abbd9c224 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:01.555272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fcf8e-948f-410d-b325-fb7abbd9c224 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:01.555549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fcf8e-948f-410d-b325-fb7abbd9c224 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:01.556229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fcf8e-948f-410d-b325-fb7abbd9c224 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:01.556534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fcf8e-948f-410d-b325-fb7abbd9c224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:01.557947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fcf8e-948f-410d-b325-fb7abbd9c224 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:01.567931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 449/887] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Aug 29 23:39:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:01.573742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313862e-38cc-4bce-9c7d-750db110b047 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:01.691618 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313862e-38cc-4bce-9c7d-750db110b047 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:01.732954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5262de3-e78d-452e-9dda-29720a82d240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:01.733644 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5262de3-e78d-452e-9dda-29720a82d240 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:01.733931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5262de3-e78d-452e-9dda-29720a82d240 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:01.734204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5262de3-e78d-452e-9dda-29720a82d240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:01.746352 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5262de3-e78d-452e-9dda-29720a82d240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:01.748517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5262de3-e78d-452e-9dda-29720a82d240 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-a5262de3-e78d-452e-9dda-29720a82d240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:01.764448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:01.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:01.766312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:01.766312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:01.766312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:01.766312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 439/888] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:01.772013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fcf8e-948f-410d-b325-fb7abbd9c224 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:01.855515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:01.882660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fcf8e-948f-410d-b325-fb7abbd9c224 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:01.920015 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27fc6a-f625-4ae7-8f82-2f3627a49a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:01.920639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27fc6a-f625-4ae7-8f82-2f3627a49a27 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:01.921003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27fc6a-f625-4ae7-8f82-2f3627a49a27 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:01.921277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27fc6a-f625-4ae7-8f82-2f3627a49a27 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:01.921973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27fc6a-f625-4ae7-8f82-2f3627a49a27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:01.922286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27fc6a-f625-4ae7-8f82-2f3627a49a27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:01.923682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27fc6a-f625-4ae7-8f82-2f3627a49a27 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:01.936611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 450/889] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:01.942680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5262de3-e78d-452e-9dda-29720a82d240 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:01.996960 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:02.051316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5262de3-e78d-452e-9dda-29720a82d240 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:02.086845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a4b3-ab3c-4115-aea3-85628ac20ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:02.087505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a4b3-ab3c-4115-aea3-85628ac20ac6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:02.087788 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a4b3-ab3c-4115-aea3-85628ac20ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:02.088064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a4b3-ab3c-4115-aea3-85628ac20ac6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:02.096818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0a4b3-ab3c-4115-aea3-85628ac20ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:02.098310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0a4b3-ab3c-4115-aea3-85628ac20ac6 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-a7e0a4b3-ab3c-4115-aea3-85628ac20ac6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:39:02.110586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:02.111622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:02.112570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:02.112570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:02.112570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:39:02.112570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:39:02.112570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:39:02.112570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:39:02.112570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:39:02.112570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:39:02.112570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:39:02.112570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:02.112570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 440/890] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Aug 29 23:39:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:02.117819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27fc6a-f625-4ae7-8f82-2f3627a49a27 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:02.224353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27fc6a-f625-4ae7-8f82-2f3627a49a27 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:02.260180 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c845ca1-5ce5-4609-b1d0-f97840dca735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:02.260796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c845ca1-5ce5-4609-b1d0-f97840dca735 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:02.261075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c845ca1-5ce5-4609-b1d0-f97840dca735 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:02.261344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c845ca1-5ce5-4609-b1d0-f97840dca735 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:02.262611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c845ca1-5ce5-4609-b1d0-f97840dca735 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:02.262951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c845ca1-5ce5-4609-b1d0-f97840dca735 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:02.264372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c845ca1-5ce5-4609-b1d0-f97840dca735 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:02.266212 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:02.283878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 451/891] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Aug 29 23:39:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:02.290308 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a4b3-ab3c-4115-aea3-85628ac20ac6 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:02.419224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a4b3-ab3c-4115-aea3-85628ac20ac6 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:02.431713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fc872-0859-4e64-9257-9ee246c39f56 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:02.432342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fc872-0859-4e64-9257-9ee246c39f56 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:02.432943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fc872-0859-4e64-9257-9ee246c39f56 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:02.435196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 452/892] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:39:02.435669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:02.441604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8a495-814a-49fa-a4fb-4950636e552c None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:02.442243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8a495-814a-49fa-a4fb-4950636e552c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:02.442738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8a495-814a-49fa-a4fb-4950636e552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:02.462509 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-69b8a495-814a-49fa-a4fb-4950636e552c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:02.464229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-69b8a495-814a-49fa-a4fb-4950636e552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:02.468992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7d691-0b3a-438d-9184-36c5bb719c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:02.469835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7d691-0b3a-438d-9184-36c5bb719c42 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:02.470228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7d691-0b3a-438d-9184-36c5bb719c42 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:02.470598 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7d691-0b3a-438d-9184-36c5bb719c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:02.544240 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 453/893] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:02.548453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1373e86-d125-4686-8c39-2a9b83eb72af None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:02.548967 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1373e86-d125-4686-8c39-2a9b83eb72af None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:02.549994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1373e86-d125-4686-8c39-2a9b83eb72af None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:02.551914 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 454/894] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:02.556104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7d691-0b3a-438d-9184-36c5bb719c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:02.556104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7d691-0b3a-438d-9184-36c5bb719c42 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:02.558730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ed4f7-d806-4049-bc39-56e8b3eeb8d9 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:02.559825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ed4f7-d806-4049-bc39-56e8b3eeb8d9 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:02.560300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ed4f7-d806-4049-bc39-56e8b3eeb8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:02.586834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-f74ed4f7-d806-4049-bc39-56e8b3eeb8d9 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:02.588911 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f74ed4f7-d806-4049-bc39-56e8b3eeb8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:02.665958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 441/895] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:39:02 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 23:39:02.671315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7d691-0b3a-438d-9184-36c5bb719c42 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:02.683295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 455/896] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:02.703252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:02.786870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7d691-0b3a-438d-9184-36c5bb719c42 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:02.820938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ed4f7-d806-4049-bc39-56e8b3eeb8d9 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:02.823198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ff00c-c6bf-472e-9c98-8d1359b40eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:02.824003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ff00c-c6bf-472e-9c98-8d1359b40eb4 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:02.824458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ff00c-c6bf-472e-9c98-8d1359b40eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:02.828431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ff00c-c6bf-472e-9c98-8d1359b40eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:02.839649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ff00c-c6bf-472e-9c98-8d1359b40eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:02.842484 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ff00c-c6bf-472e-9c98-8d1359b40eb4 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-4c4ff00c-c6bf-472e-9c98-8d1359b40eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:02.865911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:02.867278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:02.868164 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:02.868164 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:02.868164 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:02.868164 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 442/897] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:02.873393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ff00c-c6bf-472e-9c98-8d1359b40eb4 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:02.891452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:02.937643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:02.944542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ed4f7-d806-4049-bc39-56e8b3eeb8d9 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:02.979221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ff00c-c6bf-472e-9c98-8d1359b40eb4 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:02.984613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea48f3-4c4c-4ea6-98d0-86c8f1f34d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:02.985254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea48f3-4c4c-4ea6-98d0-86c8f1f34d9a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:02.985537 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea48f3-4c4c-4ea6-98d0-86c8f1f34d9a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:02.985812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea48f3-4c4c-4ea6-98d0-86c8f1f34d9a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:02.986404 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea48f3-4c4c-4ea6-98d0-86c8f1f34d9a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:02.987859 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea48f3-4c4c-4ea6-98d0-86c8f1f34d9a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-e7ea48f3-4c4c-4ea6-98d0-86c8f1f34d9a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:02.998163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:02.999410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:39:03.000284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:03.004259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 456/898] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:39:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:03.004923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea48f3-4c4c-4ea6-98d0-86c8f1f34d9a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:03.016419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763fc8d-de37-40de-84b0-e97c4c3630ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:03.017049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763fc8d-de37-40de-84b0-e97c4c3630ac None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:03.017316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763fc8d-de37-40de-84b0-e97c4c3630ac None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:03.017648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763fc8d-de37-40de-84b0-e97c4c3630ac None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:03.018290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763fc8d-de37-40de-84b0-e97c4c3630ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:03.018593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763fc8d-de37-40de-84b0-e97c4c3630ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:03.019986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763fc8d-de37-40de-84b0-e97c4c3630ac None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:03.032356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 443/899] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:03.033190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763fc8d-de37-40de-84b0-e97c4c3630ac None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:03.122632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea48f3-4c4c-4ea6-98d0-86c8f1f34d9a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:03.140065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:03.147014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763fc8d-de37-40de-84b0-e97c4c3630ac None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:03.162731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd7330-4cd3-40cc-a663-f303ca833aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:03.163410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7330-4cd3-40cc-a663-f303ca833aa7 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:03.163727 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7330-4cd3-40cc-a663-f303ca833aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:03.164008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7330-4cd3-40cc-a663-f303ca833aa7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:03.164669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd7330-4cd3-40cc-a663-f303ca833aa7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:03.166033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd7330-4cd3-40cc-a663-f303ca833aa7 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:03.175553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-87cd7330-4cd3-40cc-a663-f303ca833aa7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:03.176021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:03.182950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:03.183817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 457/900] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Aug 29 23:39:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:03.185181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd7330-4cd3-40cc-a663-f303ca833aa7 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:03.194900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc307e3-9931-42bb-977d-21b11959fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:03.195470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc307e3-9931-42bb-977d-21b11959fb15 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:03.195749 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc307e3-9931-42bb-977d-21b11959fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:03.196182 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc307e3-9931-42bb-977d-21b11959fb15 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:03.196635 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc307e3-9931-42bb-977d-21b11959fb15 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:03.196969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc307e3-9931-42bb-977d-21b11959fb15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:03.198303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc307e3-9931-42bb-977d-21b11959fb15 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:03.208740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 444/901] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:39:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:03.208740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc307e3-9931-42bb-977d-21b11959fb15 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:03.315890 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd7330-4cd3-40cc-a663-f303ca833aa7 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:03.332899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc307e3-9931-42bb-977d-21b11959fb15 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:03.353047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b4c90-84e1-4cb9-bd03-57669d14f170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:03.353935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b4c90-84e1-4cb9-bd03-57669d14f170 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:03.354224 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b4c90-84e1-4cb9-bd03-57669d14f170 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:03.354497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b4c90-84e1-4cb9-bd03-57669d14f170 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:03.362440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b4c90-84e1-4cb9-bd03-57669d14f170 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:03.363931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b4c90-84e1-4cb9-bd03-57669d14f170 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:03.369881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732f7ec-ca00-45ff-86e2-735c9627339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:03.370503 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732f7ec-ca00-45ff-86e2-735c9627339e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:03.370781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732f7ec-ca00-45ff-86e2-735c9627339e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:03.371079 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732f7ec-ca00-45ff-86e2-735c9627339e None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:03.371742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732f7ec-ca00-45ff-86e2-735c9627339e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:03.372047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732f7ec-ca00-45ff-86e2-735c9627339e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:03.373392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732f7ec-ca00-45ff-86e2-735c9627339e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-a00b4c90-84e1-4cb9-bd03-57669d14f170 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:39:03.377932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:03.378853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:03.379839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:39:03.379839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:39:03.379839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:39:03.379839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:39:03.379839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:39:03.379839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:39:03.379839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:03.379839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:03.380479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 445/902] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Aug 29 23:39:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:03.380479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732f7ec-ca00-45ff-86e2-735c9627339e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:03.382339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 458/903] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:39:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:03.392041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b4c90-84e1-4cb9-bd03-57669d14f170 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:03.441395 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:03.449276 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:03.500471 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732f7ec-ca00-45ff-86e2-735c9627339e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:03.511495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b4c90-84e1-4cb9-bd03-57669d14f170 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:03.548247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33a7c2-945f-4e6a-a8ec-ae152cf63136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:03.548898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33a7c2-945f-4e6a-a8ec-ae152cf63136 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:03.549152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33a7c2-945f-4e6a-a8ec-ae152cf63136 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:03.549425 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33a7c2-945f-4e6a-a8ec-ae152cf63136 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:03.550095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33a7c2-945f-4e6a-a8ec-ae152cf63136 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:03.550405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33a7c2-945f-4e6a-a8ec-ae152cf63136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:03.551940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33a7c2-945f-4e6a-a8ec-ae152cf63136 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:03.555191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309b3bd-195c-4e46-b66a-a7abb3925b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:03.556222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309b3bd-195c-4e46-b66a-a7abb3925b82 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:03.556709 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309b3bd-195c-4e46-b66a-a7abb3925b82 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:03.557183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309b3bd-195c-4e46-b66a-a7abb3925b82 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:03.557872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 446/904] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:39:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:03.558298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309b3bd-195c-4e46-b66a-a7abb3925b82 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:03.558892 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309b3bd-195c-4e46-b66a-a7abb3925b82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:03.559020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33a7c2-945f-4e6a-a8ec-ae152cf63136 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:03.560656 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309b3bd-195c-4e46-b66a-a7abb3925b82 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:03.567364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 459/905] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Aug 29 23:39:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:03.568899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309b3bd-195c-4e46-b66a-a7abb3925b82 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:03.687872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33a7c2-945f-4e6a-a8ec-ae152cf63136 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:03.694809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309b3bd-195c-4e46-b66a-a7abb3925b82 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:03.697854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:03.710097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:03.732490 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31293c-0050-4862-b8fa-f9af2c4e39c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:03.733110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31293c-0050-4862-b8fa-f9af2c4e39c1 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:03.733391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31293c-0050-4862-b8fa-f9af2c4e39c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:03.733670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31293c-0050-4862-b8fa-f9af2c4e39c1 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:03.734480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31293c-0050-4862-b8fa-f9af2c4e39c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:03.734783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31293c-0050-4862-b8fa-f9af2c4e39c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:03.736303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31293c-0050-4862-b8fa-f9af2c4e39c1 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:03.737084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ce4f4-5d3f-4595-8616-f4c4f25a2e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:03.738943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ce4f4-5d3f-4595-8616-f4c4f25a2e23 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:03.738943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ce4f4-5d3f-4595-8616-f4c4f25a2e23 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:03.738943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ce4f4-5d3f-4595-8616-f4c4f25a2e23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:03.739767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ce4f4-5d3f-4595-8616-f4c4f25a2e23 None admin] RBAC: Adding query filter params (interface=public, service_id=5e9e07b8fa19423286b5979da44edac4, region_id=RegionOne) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:03.740239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ce4f4-5d3f-4595-8616-f4c4f25a2e23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:03.741764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ce4f4-5d3f-4595-8616-f4c4f25a2e23 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:03.748203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 460/906] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Aug 29 23:39:03 2022] GET /identity/v3/endpoints?service_id=5e9e07b8fa19423286b5979da44edac4&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:03.749601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02728fe-0bea-4c7a-95f8-06f0efd05e4a None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:03.749890 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02728fe-0bea-4c7a-95f8-06f0efd05e4a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:03.750154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02728fe-0bea-4c7a-95f8-06f0efd05e4a None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:03.751683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 461/907] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:03.754263 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 447/908] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:39:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:03.756048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02728fe-0bea-4c7a-95f8-06f0efd05e4a None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:03.757247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee4845-6736-4edd-beb5-041350ea55f2 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:03.758116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee4845-6736-4edd-beb5-041350ea55f2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:03.759029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee4845-6736-4edd-beb5-041350ea55f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:03.782039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5cee4845-6736-4edd-beb5-041350ea55f2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:03.783264 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5cee4845-6736-4edd-beb5-041350ea55f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:03.855935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 448/909] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:03.855935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee4845-6736-4edd-beb5-041350ea55f2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:03.885564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02728fe-0bea-4c7a-95f8-06f0efd05e4a None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:03.927932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41825495-9371-48a7-ac17-7c1c65d37363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:03.929185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41825495-9371-48a7-ac17-7c1c65d37363 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:03.929624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41825495-9371-48a7-ac17-7c1c65d37363 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:03.930068 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41825495-9371-48a7-ac17-7c1c65d37363 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:03.931024 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41825495-9371-48a7-ac17-7c1c65d37363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:03.933177 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41825495-9371-48a7-ac17-7c1c65d37363 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:03.941735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 462/910] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Aug 29 23:39:03 2022] GET /identity/v3/services => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:39:03.988854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee4845-6736-4edd-beb5-041350ea55f2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:03.991827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:04.028853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dd4f4-f790-4dfc-8347-7b7f533516b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:04.029474 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd4f4-f790-4dfc-8347-7b7f533516b0 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:04.029746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd4f4-f790-4dfc-8347-7b7f533516b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:04.030012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd4f4-f790-4dfc-8347-7b7f533516b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:04.030749 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dd4f4-f790-4dfc-8347-7b7f533516b0 None admin] RBAC: Adding query filter params (role.id=d62272f04f1e4171b328b9b14b8eed03, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=ef922e08ae644f6a84034366f59d5591) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:04.031372 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dd4f4-f790-4dfc-8347-7b7f533516b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:04.033343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dd4f4-f790-4dfc-8347-7b7f533516b0 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:04.040090 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 449/911] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:39:03 2022] GET /identity/v3/role_assignments?user.id=ef922e08ae644f6a84034366f59d5591&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=d62272f04f1e4171b328b9b14b8eed03 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:04.135727 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41825495-9371-48a7-ac17-7c1c65d37363 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:04.172994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:04.254949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41825495-9371-48a7-ac17-7c1c65d37363 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:04.291201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975853-8d65-415f-9b22-f6eef8f22345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:04.291592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975853-8d65-415f-9b22-f6eef8f22345 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:04.291872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975853-8d65-415f-9b22-f6eef8f22345 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:04.292146 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975853-8d65-415f-9b22-f6eef8f22345 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:04.292727 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3975853-8d65-415f-9b22-f6eef8f22345 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:04.294644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3975853-8d65-415f-9b22-f6eef8f22345 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-b3975853-8d65-415f-9b22-f6eef8f22345 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:04.304382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:04.305372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:04.306257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 463/912] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Aug 29 23:39:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:04.311498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dd4f4-f790-4dfc-8347-7b7f533516b0 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:04.418703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dd4f4-f790-4dfc-8347-7b7f533516b0 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:04.460130 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3d18a-7768-4d8d-bd72-4ce2d5b8c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:04.460503 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3d18a-7768-4d8d-bd72-4ce2d5b8c230 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:04.460919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3d18a-7768-4d8d-bd72-4ce2d5b8c230 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:04.461278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3d18a-7768-4d8d-bd72-4ce2d5b8c230 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:04.462390 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3d18a-7768-4d8d-bd72-4ce2d5b8c230 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:04.462717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3d18a-7768-4d8d-bd72-4ce2d5b8c230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:04.464770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3d18a-7768-4d8d-bd72-4ce2d5b8c230 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:04.473271 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 450/913] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Aug 29 23:39:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:04.479477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975853-8d65-415f-9b22-f6eef8f22345 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:04.591726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:04.598171 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975853-8d65-415f-9b22-f6eef8f22345 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:04.634042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d2279-dab8-4d47-8b3a-e6de263ec339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:04.634652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d2279-dab8-4d47-8b3a-e6de263ec339 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:04.634976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d2279-dab8-4d47-8b3a-e6de263ec339 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:04.635253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d2279-dab8-4d47-8b3a-e6de263ec339 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:04.635883 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d2279-dab8-4d47-8b3a-e6de263ec339 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:04.636186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d2279-dab8-4d47-8b3a-e6de263ec339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:04.638621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d2279-dab8-4d47-8b3a-e6de263ec339 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:04.644217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 464/914] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Aug 29 23:39:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:04.649927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3d18a-7768-4d8d-bd72-4ce2d5b8c230 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:04.683699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:04.770620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3d18a-7768-4d8d-bd72-4ce2d5b8c230 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:04.807449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3db1-f2b6-4bfb-966f-74838f8516aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:04.808099 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3db1-f2b6-4bfb-966f-74838f8516aa None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:04.808378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3db1-f2b6-4bfb-966f-74838f8516aa None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:04.808647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3db1-f2b6-4bfb-966f-74838f8516aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:04.809345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a3db1-f2b6-4bfb-966f-74838f8516aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:04.810688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a3db1-f2b6-4bfb-966f-74838f8516aa None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:04.931122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 451/915] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:39:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:39:05.600773 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3e7db-bc36-4de8-a583-74d8de172b66 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:05.601295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3e7db-bc36-4de8-a583-74d8de172b66 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:05.601295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3e7db-bc36-4de8-a583-74d8de172b66 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:05.602971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 465/916] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:05.608684 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c0208-530d-4373-a06e-f377c8cc87fe None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:05.608975 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c0208-530d-4373-a06e-f377c8cc87fe None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:05.609256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c0208-530d-4373-a06e-f377c8cc87fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:05.628253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-558c0208-530d-4373-a06e-f377c8cc87fe None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:05.629455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-558c0208-530d-4373-a06e-f377c8cc87fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:05.705573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 452/917] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:05.977938 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c0208-530d-4373-a06e-f377c8cc87fe None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:05.979226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29036f-007b-485e-a6ed-e9f901faa718 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:05.979770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29036f-007b-485e-a6ed-e9f901faa718 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:05.980269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29036f-007b-485e-a6ed-e9f901faa718 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:05.982508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 466/918] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:05.991780 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbcb8d-029b-4c01-be9f-7715ad69ee14 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:05.992074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbcb8d-029b-4c01-be9f-7715ad69ee14 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:05.992336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbcb8d-029b-4c01-be9f-7715ad69ee14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:05.997856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:06.017782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-90dbcb8d-029b-4c01-be9f-7715ad69ee14 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:06.020021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-90dbcb8d-029b-4c01-be9f-7715ad69ee14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:06.101462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c0208-530d-4373-a06e-f377c8cc87fe None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:06.117100 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 467/919] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:06.118649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0e4ca-c496-4ff2-b252-46e3a3112fb1 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:06.119401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0e4ca-c496-4ff2-b252-46e3a3112fb1 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:06.119401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0e4ca-c496-4ff2-b252-46e3a3112fb1 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:06.125181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 468/920] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:06.126305 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501403db-2049-4130-b852-0c2a224c6388 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:06.126584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501403db-2049-4130-b852-0c2a224c6388 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:06.126854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501403db-2049-4130-b852-0c2a224c6388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:06.141867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa7b35-d2be-466b-9a50-0d409ddbadc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:06.142806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa7b35-d2be-466b-9a50-0d409ddbadc3 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:06.143344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa7b35-d2be-466b-9a50-0d409ddbadc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:06.143806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa7b35-d2be-466b-9a50-0d409ddbadc3 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:06.144774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa7b35-d2be-466b-9a50-0d409ddbadc3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:06.145479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-501403db-2049-4130-b852-0c2a224c6388 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:06.146530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa7b35-d2be-466b-9a50-0d409ddbadc3 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:06.146654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-501403db-2049-4130-b852-0c2a224c6388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:06.220254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 469/921] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:06.241452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 453/922] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:39:05 2022] POST /identity/v3/services => generated 241 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:39:06.400305 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501403db-2049-4130-b852-0c2a224c6388 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:06.425134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:06.498282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa7b35-d2be-466b-9a50-0d409ddbadc3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:06.511381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501403db-2049-4130-b852-0c2a224c6388 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:06.552950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de3fcd-6b0e-4b5c-a2d0-8bd57418ab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:06.553603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3fcd-6b0e-4b5c-a2d0-8bd57418ab9a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:06.553887 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3fcd-6b0e-4b5c-a2d0-8bd57418ab9a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:06.554163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3fcd-6b0e-4b5c-a2d0-8bd57418ab9a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:06.554746 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de3fcd-6b0e-4b5c-a2d0-8bd57418ab9a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:06.556158 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de3fcd-6b0e-4b5c-a2d0-8bd57418ab9a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-a8de3fcd-6b0e-4b5c-a2d0-8bd57418ab9a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:06.566084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:06.567346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:06.568358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 470/923] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:39:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:06.573342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de3fcd-6b0e-4b5c-a2d0-8bd57418ab9a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:06.587478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:06.615620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa7b35-d2be-466b-9a50-0d409ddbadc3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:06.662310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693b83a-0a38-42b0-991c-187f141f87ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:06.662955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:06.663770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693b83a-0a38-42b0-991c-187f141f87ad None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:06.664057 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693b83a-0a38-42b0-991c-187f141f87ad None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:06.664334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693b83a-0a38-42b0-991c-187f141f87ad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:06.675265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693b83a-0a38-42b0-991c-187f141f87ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-b693b83a-0a38-42b0-991c-187f141f87ad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:39:06.680688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:06.681623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:06.682457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 454/924] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Aug 29 23:39:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:06.683634 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de3fcd-6b0e-4b5c-a2d0-8bd57418ab9a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:06.689615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693b83a-0a38-42b0-991c-187f141f87ad None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:06.723070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8de44d-8f5a-4562-ace7-04425ab3d433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:06.724197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de44d-8f5a-4562-ace7-04425ab3d433 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:06.724705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de44d-8f5a-4562-ace7-04425ab3d433 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:06.725174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de44d-8f5a-4562-ace7-04425ab3d433 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:06.726092 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8de44d-8f5a-4562-ace7-04425ab3d433 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:06.726663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8de44d-8f5a-4562-ace7-04425ab3d433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:06.728269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8de44d-8f5a-4562-ace7-04425ab3d433 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:06.739701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 471/925] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:39:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:06.747035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8de44d-8f5a-4562-ace7-04425ab3d433 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:06.820710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693b83a-0a38-42b0-991c-187f141f87ad None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:06.864463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00009dcd-75f5-4b92-8060-9a42b957ba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:06.865533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00009dcd-75f5-4b92-8060-9a42b957ba42 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:06.866085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00009dcd-75f5-4b92-8060-9a42b957ba42 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:06.866593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00009dcd-75f5-4b92-8060-9a42b957ba42 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:06.867528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00009dcd-75f5-4b92-8060-9a42b957ba42 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:06.868036 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00009dcd-75f5-4b92-8060-9a42b957ba42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:06.869597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00009dcd-75f5-4b92-8060-9a42b957ba42 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:06.871481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:06.879885 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 455/926] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Aug 29 23:39:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:06.885956 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00009dcd-75f5-4b92-8060-9a42b957ba42 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:06.889034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8de44d-8f5a-4562-ace7-04425ab3d433 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:06.926738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7243465-cb83-4aa3-b7bc-4f30bbc46c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:06.927498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7243465-cb83-4aa3-b7bc-4f30bbc46c68 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:06.927867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7243465-cb83-4aa3-b7bc-4f30bbc46c68 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:06.928209 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7243465-cb83-4aa3-b7bc-4f30bbc46c68 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:06.928967 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7243465-cb83-4aa3-b7bc-4f30bbc46c68 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:06.929337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7243465-cb83-4aa3-b7bc-4f30bbc46c68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:06.931035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7243465-cb83-4aa3-b7bc-4f30bbc46c68 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:06.941610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 472/927] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Aug 29 23:39:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:06.942556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7243465-cb83-4aa3-b7bc-4f30bbc46c68 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:06.954924 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:06.998023 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00009dcd-75f5-4b92-8060-9a42b957ba42 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:07.032832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475937d2-ef5d-4df8-a03a-af4d4decf95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:07.033464 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475937d2-ef5d-4df8-a03a-af4d4decf95d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:07.033748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475937d2-ef5d-4df8-a03a-af4d4decf95d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:07.034021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475937d2-ef5d-4df8-a03a-af4d4decf95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:07.044495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475937d2-ef5d-4df8-a03a-af4d4decf95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:07.045937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475937d2-ef5d-4df8-a03a-af4d4decf95d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:07.051697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7243465-cb83-4aa3-b7bc-4f30bbc46c68 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-475937d2-ef5d-4df8-a03a-af4d4decf95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:07.061383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:07.062326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:07.067930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:07.067930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:07.067930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:07.067930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 456/928] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:07.067930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e44f8-9627-41b4-bfd1-e29d1354e8a1 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:07.067930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e44f8-9627-41b4-bfd1-e29d1354e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:07.067930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e44f8-9627-41b4-bfd1-e29d1354e8a1 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:07.067930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 457/929] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:07.070592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4c2ec-5209-4367-b76e-52466cb21efc None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:07.070962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4c2ec-5209-4367-b76e-52466cb21efc None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:07.071188 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4c2ec-5209-4367-b76e-52466cb21efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:07.089539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-dfe4c2ec-5209-4367-b76e-52466cb21efc None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:07.090776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-dfe4c2ec-5209-4367-b76e-52466cb21efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:07.095433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea4592-c6d9-431b-9551-d59dd6aded3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:07.096046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea4592-c6d9-431b-9551-d59dd6aded3c None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:07.096325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea4592-c6d9-431b-9551-d59dd6aded3c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:07.096593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea4592-c6d9-431b-9551-d59dd6aded3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:07.097255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea4592-c6d9-431b-9551-d59dd6aded3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:07.098640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea4592-c6d9-431b-9551-d59dd6aded3c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:07.134991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:07.158402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 458/930] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:07.159273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4c2ec-5209-4367-b76e-52466cb21efc None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:07.215601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 473/931] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:39:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:39:07.282154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4c2ec-5209-4367-b76e-52466cb21efc None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:07.329337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4137bee-e71c-4894-b762-3b4faa690e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:07.329933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4137bee-e71c-4894-b762-3b4faa690e39 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:07.330272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4137bee-e71c-4894-b762-3b4faa690e39 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:07.330551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4137bee-e71c-4894-b762-3b4faa690e39 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:07.331228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4137bee-e71c-4894-b762-3b4faa690e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:07.331529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4137bee-e71c-4894-b762-3b4faa690e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:07.332950 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4137bee-e71c-4894-b762-3b4faa690e39 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:07.346082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 459/932] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:07.351517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea4592-c6d9-431b-9551-d59dd6aded3c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:07.421733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:07.437116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4137bee-e71c-4894-b762-3b4faa690e39 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:07.468718 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea4592-c6d9-431b-9551-d59dd6aded3c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:07.475890 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:07.510649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80210a6d-ecd7-4986-a589-ec2276f4f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:07.511307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80210a6d-ecd7-4986-a589-ec2276f4f679 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:07.511590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80210a6d-ecd7-4986-a589-ec2276f4f679 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:07.511863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80210a6d-ecd7-4986-a589-ec2276f4f679 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:07.520681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80210a6d-ecd7-4986-a589-ec2276f4f679 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:07.522137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80210a6d-ecd7-4986-a589-ec2276f4f679 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-80210a6d-ecd7-4986-a589-ec2276f4f679 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:39:07.534566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:07.535601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:07.536551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:07.536551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:07.536551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:39:07.536551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:39:07.536551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:39:07.536551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:39:07.536551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:39:07.536551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:39:07.536551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:39:07.536551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:07.536551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 474/933] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Aug 29 23:39:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:07.541923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80210a6d-ecd7-4986-a589-ec2276f4f679 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:07.559140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4137bee-e71c-4894-b762-3b4faa690e39 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:07.602478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4ef38-4fbe-48aa-9458-1ceb6b7aa631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:07.603540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4ef38-4fbe-48aa-9458-1ceb6b7aa631 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:07.604142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4ef38-4fbe-48aa-9458-1ceb6b7aa631 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:07.604758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4ef38-4fbe-48aa-9458-1ceb6b7aa631 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:07.605421 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4ef38-4fbe-48aa-9458-1ceb6b7aa631 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:07.607559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4ef38-4fbe-48aa-9458-1ceb6b7aa631 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-89d4ef38-4fbe-48aa-9458-1ceb6b7aa631 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:07.619364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:07.621212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:39:07.622522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:07.630912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 460/934] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:39:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:07.630912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4ef38-4fbe-48aa-9458-1ceb6b7aa631 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:07.679313 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80210a6d-ecd7-4986-a589-ec2276f4f679 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:07.710373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:07.724605 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae9cb3-ca59-4944-ae87-75d1c9ccd5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:07.725222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae9cb3-ca59-4944-ae87-75d1c9ccd5c3 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:07.725500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae9cb3-ca59-4944-ae87-75d1c9ccd5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:07.730195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae9cb3-ca59-4944-ae87-75d1c9ccd5c3 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:07.730195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae9cb3-ca59-4944-ae87-75d1c9ccd5c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:07.730195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae9cb3-ca59-4944-ae87-75d1c9ccd5c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:07.730195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae9cb3-ca59-4944-ae87-75d1c9ccd5c3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:07.763541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 475/935] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Aug 29 23:39:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:07.764406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae9cb3-ca59-4944-ae87-75d1c9ccd5c3 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:07.766333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:07.773092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4ef38-4fbe-48aa-9458-1ceb6b7aa631 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:07.817809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942026d9-cb61-435e-a2c9-8368fa709e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:07.818458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942026d9-cb61-435e-a2c9-8368fa709e73 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:07.818741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942026d9-cb61-435e-a2c9-8368fa709e73 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:07.819531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942026d9-cb61-435e-a2c9-8368fa709e73 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:07.820177 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942026d9-cb61-435e-a2c9-8368fa709e73 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:07.820483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942026d9-cb61-435e-a2c9-8368fa709e73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:07.822215 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942026d9-cb61-435e-a2c9-8368fa709e73 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:07.829518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 461/936] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:39:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:07.835239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942026d9-cb61-435e-a2c9-8368fa709e73 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:07.892636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae9cb3-ca59-4944-ae87-75d1c9ccd5c3 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:07.935063 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf73f0c-9ce9-4c11-a5f9-ccb2ba168c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:07.936024 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf73f0c-9ce9-4c11-a5f9-ccb2ba168c7a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:07.936311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf73f0c-9ce9-4c11-a5f9-ccb2ba168c7a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:07.936591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf73f0c-9ce9-4c11-a5f9-ccb2ba168c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:07.950484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf73f0c-9ce9-4c11-a5f9-ccb2ba168c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:07.952646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf73f0c-9ce9-4c11-a5f9-ccb2ba168c7a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:07.963146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942026d9-cb61-435e-a2c9-8368fa709e73 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-2bf73f0c-9ce9-4c11-a5f9-ccb2ba168c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:07.972319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:07.973285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:07.974281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:07.974281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:07.974281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:07.974281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 476/937] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:07.983867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf73f0c-9ce9-4c11-a5f9-ccb2ba168c7a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:08.003924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbeb87e-7252-4d86-ae93-366498010149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:08.004608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeb87e-7252-4d86-ae93-366498010149 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:08.004804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeb87e-7252-4d86-ae93-366498010149 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:08.005120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeb87e-7252-4d86-ae93-366498010149 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:08.005887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeb87e-7252-4d86-ae93-366498010149 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:08.006177 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeb87e-7252-4d86-ae93-366498010149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:08.007670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeb87e-7252-4d86-ae93-366498010149 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:08.019143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 462/938] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:39:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:08.047344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:08.110740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf73f0c-9ce9-4c11-a5f9-ccb2ba168c7a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:08.149521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fdd97-0f61-47b9-9c5a-8da6fd810f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:08.150059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fdd97-0f61-47b9-9c5a-8da6fd810f5c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:08.150431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fdd97-0f61-47b9-9c5a-8da6fd810f5c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:08.150707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fdd97-0f61-47b9-9c5a-8da6fd810f5c None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:08.151399 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fdd97-0f61-47b9-9c5a-8da6fd810f5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:08.151708 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fdd97-0f61-47b9-9c5a-8da6fd810f5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:08.153300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fdd97-0f61-47b9-9c5a-8da6fd810f5c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:08.166419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 477/939] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:08.172515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbeb87e-7252-4d86-ae93-366498010149 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:08.205909 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:08.242335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaad625-7a02-49a2-90f6-a75d8f21a6b4 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:08.242676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaad625-7a02-49a2-90f6-a75d8f21a6b4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:08.242969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaad625-7a02-49a2-90f6-a75d8f21a6b4 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:08.244428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 478/940] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:39:08.250195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f9636-9b40-419f-90e0-a81943ad2f07 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:08.250700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f9636-9b40-419f-90e0-a81943ad2f07 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:08.251220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f9636-9b40-419f-90e0-a81943ad2f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:08.272846 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-af6f9636-9b40-419f-90e0-a81943ad2f07 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:08.275264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-af6f9636-9b40-419f-90e0-a81943ad2f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:08.311714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbeb87e-7252-4d86-ae93-366498010149 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:08.361166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf53ebb-a6db-4d01-88ba-f5ec468422fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:08.361804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf53ebb-a6db-4d01-88ba-f5ec468422fb None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:08.362084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf53ebb-a6db-4d01-88ba-f5ec468422fb None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:08.362382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 479/941] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:08.362500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf53ebb-a6db-4d01-88ba-f5ec468422fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:08.369589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf53ebb-a6db-4d01-88ba-f5ec468422fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:08.371222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf53ebb-a6db-4d01-88ba-f5ec468422fb None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-eaf53ebb-a6db-4d01-88ba-f5ec468422fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:39:08.385558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:08.386462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:08.387436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:39:08.387436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:39:08.387436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:39:08.387436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:39:08.387436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:39:08.387436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:39:08.387436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:08.387436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:08.387436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 463/942] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:08.392524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f9636-9b40-419f-90e0-a81943ad2f07 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:08.423362 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:08.497639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f9636-9b40-419f-90e0-a81943ad2f07 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:08.533006 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15260596-5258-4d25-8d24-8e15c4571875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:08.533619 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15260596-5258-4d25-8d24-8e15c4571875 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:08.533897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15260596-5258-4d25-8d24-8e15c4571875 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:08.534170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15260596-5258-4d25-8d24-8e15c4571875 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:08.534860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15260596-5258-4d25-8d24-8e15c4571875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:08.535191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15260596-5258-4d25-8d24-8e15c4571875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:08.536621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15260596-5258-4d25-8d24-8e15c4571875 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:08.549387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 480/943] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:39:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:08.555213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf53ebb-a6db-4d01-88ba-f5ec468422fb None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:08.635429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15260596-5258-4d25-8d24-8e15c4571875 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:08.646471 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:08.659311 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf53ebb-a6db-4d01-88ba-f5ec468422fb None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:08.697287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee07c4-f7ba-45f2-a1ae-ab1b5bbfe753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:08.699101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee07c4-f7ba-45f2-a1ae-ab1b5bbfe753 None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:08.699611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee07c4-f7ba-45f2-a1ae-ab1b5bbfe753 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:08.700105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee07c4-f7ba-45f2-a1ae-ab1b5bbfe753 None admin] PATH_INFO: `/v3/projects/da13e1cbae664d5a92198052526ee459/users/ef922e08ae644f6a84034366f59d5591/roles/d62272f04f1e4171b328b9b14b8eed03` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:08.702558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee07c4-f7ba-45f2-a1ae-ab1b5bbfe753 None admin] RBAC: Authorizing `identity:create_grant(project_id=da13e1cbae664d5a92198052526ee459, user_id=ef922e08ae644f6a84034366f59d5591, role_id=d62272f04f1e4171b328b9b14b8eed03)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:08.704213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee07c4-f7ba-45f2-a1ae-ab1b5bbfe753 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:08.736289 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:08.752925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15260596-5258-4d25-8d24-8e15c4571875 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:08.783853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 464/944] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:39:08 2022] PUT /identity/v3/projects/da13e1cbae664d5a92198052526ee459/users/ef922e08ae644f6a84034366f59d5591/roles/d62272f04f1e4171b328b9b14b8eed03 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:39:08.787007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47466e0-ee51-4207-8077-d61ba96ac4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:08.787601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47466e0-ee51-4207-8077-d61ba96ac4a9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:08.787874 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47466e0-ee51-4207-8077-d61ba96ac4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:08.788146 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47466e0-ee51-4207-8077-d61ba96ac4a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:08.790108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47466e0-ee51-4207-8077-d61ba96ac4a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:08.790421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47466e0-ee51-4207-8077-d61ba96ac4a9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-f47466e0-ee51-4207-8077-d61ba96ac4a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:08.805432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:08.806503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:08.807353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 481/945] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Aug 29 23:39:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:08.816315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee07c4-f7ba-45f2-a1ae-ab1b5bbfe753 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:08.930421 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee07c4-f7ba-45f2-a1ae-ab1b5bbfe753 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:08.968985 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db44fd-72e7-4f9a-ad12-f639435605db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:08.969966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db44fd-72e7-4f9a-ad12-f639435605db None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:08.970242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db44fd-72e7-4f9a-ad12-f639435605db None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:08.970505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db44fd-72e7-4f9a-ad12-f639435605db None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:08.971171 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db44fd-72e7-4f9a-ad12-f639435605db None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:08.971472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db44fd-72e7-4f9a-ad12-f639435605db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:08.972807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db44fd-72e7-4f9a-ad12-f639435605db None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:08.977779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 465/946] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Aug 29 23:39:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:08.984162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47466e0-ee51-4207-8077-d61ba96ac4a9 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:09.091603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47466e0-ee51-4207-8077-d61ba96ac4a9 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:09.128240 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d16821-fab1-48ef-a723-489022f20cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:09.129169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d16821-fab1-48ef-a723-489022f20cde None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:09.129650 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d16821-fab1-48ef-a723-489022f20cde None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:09.130091 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d16821-fab1-48ef-a723-489022f20cde None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:09.130916 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d16821-fab1-48ef-a723-489022f20cde None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:09.131389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d16821-fab1-48ef-a723-489022f20cde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:09.132932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d16821-fab1-48ef-a723-489022f20cde None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:09.138904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 482/947] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Aug 29 23:39:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:09.144959 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db44fd-72e7-4f9a-ad12-f639435605db None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:09.158451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:09.252260 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db44fd-72e7-4f9a-ad12-f639435605db None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:09.287710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebceb3-9791-4898-9405-1e50e7517d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:09.288377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebceb3-9791-4898-9405-1e50e7517d9f None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:09.288654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebceb3-9791-4898-9405-1e50e7517d9f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:09.288921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebceb3-9791-4898-9405-1e50e7517d9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:09.289623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebceb3-9791-4898-9405-1e50e7517d9f None admin] RBAC: Adding query filter params (interface=public, service_id=2530dd8f8c85451a8656c56b8cc2b678, region_id=RegionOne) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:09.289926 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebceb3-9791-4898-9405-1e50e7517d9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:09.291300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebceb3-9791-4898-9405-1e50e7517d9f None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:09.297374 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 466/948] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Aug 29 23:39:09 2022] GET /identity/v3/endpoints?service_id=2530dd8f8c85451a8656c56b8cc2b678&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:09.303030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d16821-fab1-48ef-a723-489022f20cde None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:09.318417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:09.341173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab47c6-244c-4e11-91ac-2f4a0373b127 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:09.341508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab47c6-244c-4e11-91ac-2f4a0373b127 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:09.341728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab47c6-244c-4e11-91ac-2f4a0373b127 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:09.343393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 467/949] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:39:09.348443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067383-26c0-43c9-ac76-b84ede76647e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:09.348726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067383-26c0-43c9-ac76-b84ede76647e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:09.349001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067383-26c0-43c9-ac76-b84ede76647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:09.368551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8a067383-26c0-43c9-ac76-b84ede76647e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:09.369760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8a067383-26c0-43c9-ac76-b84ede76647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:09.410590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d16821-fab1-48ef-a723-489022f20cde None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:09.443331 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 468/950] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:09.446302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8992a2e-f8e2-4968-a322-c16f44582a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:09.446930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8992a2e-f8e2-4968-a322-c16f44582a8d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:09.447212 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8992a2e-f8e2-4968-a322-c16f44582a8d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:09.447482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8992a2e-f8e2-4968-a322-c16f44582a8d None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:09.448083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8992a2e-f8e2-4968-a322-c16f44582a8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:09.449541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8992a2e-f8e2-4968-a322-c16f44582a8d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:09.456049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 483/951] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Aug 29 23:39:09 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:39:09.719371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067383-26c0-43c9-ac76-b84ede76647e None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:09.723512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:09.828588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067383-26c0-43c9-ac76-b84ede76647e None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:09.869232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ec24c-e949-41ba-a52b-fd7ed18d8fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:09.869853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ec24c-e949-41ba-a52b-fd7ed18d8fb7 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:09.870136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ec24c-e949-41ba-a52b-fd7ed18d8fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:09.870410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ec24c-e949-41ba-a52b-fd7ed18d8fb7 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:09.871118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ec24c-e949-41ba-a52b-fd7ed18d8fb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:09.872548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ec24c-e949-41ba-a52b-fd7ed18d8fb7 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:09.875317 dv-cinder-854273-4-smb devstack@keystone.service[93263]: WARNING keystone.server.flask.common [None req-5d5ec24c-e949-41ba-a52b-fd7ed18d8fb7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 23:39:09.923876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.sql.core [None req-5d5ec24c-e949-41ba-a52b-fd7ed18d8fb7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 23:39:09.923876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 23:39:09.923876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [parameters: {'id': '338a12ea0ea14b659feae2b21303244c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 23:39:09.923876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93263) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-5d5ec24c-e949-41ba-a52b-fd7ed18d8fb7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 338a12ea0ea14b659feae2b21303244c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 338a12ea0ea14b659feae2b21303244c. Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:39:09.932522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application result.read() Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 23:39:09.934731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application yield resource Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise self.value Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application session.commit() Aug 29 23:39:09.935719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self.session.flush() Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application compat.raise_( Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 23:39:09.936633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 23:39:09.937541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application result.read() Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:39:09.938350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [parameters: {'id': '338a12ea0ea14b659feae2b21303244c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:09.939389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:09.940233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:09.941361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:09.941361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 23:39:09.941361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 23:39:09.941361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:09.941361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:09.941361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 23:39:09.941361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 23:39:09.941361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 338a12ea0ea14b659feae2b21303244c. Aug 29 23:39:09.941361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:09.943153 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 469/952] 10.222.0.73 () {60 vars in 1140 bytes} [Mon Aug 29 23:39:09 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:09.949022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8992a2e-f8e2-4968-a322-c16f44582a8d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:10.042775 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:10.067218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8992a2e-f8e2-4968-a322-c16f44582a8d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:10.104302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbdfaa-6f79-4653-a0b6-02ed7fe88bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:10.105043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbdfaa-6f79-4653-a0b6-02ed7fe88bcf None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:10.105301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbdfaa-6f79-4653-a0b6-02ed7fe88bcf None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:10.106129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbdfaa-6f79-4653-a0b6-02ed7fe88bcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:10.107617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b114a7-63ca-4c2a-9586-72a9b98db30f None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:10.107906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b114a7-63ca-4c2a-9586-72a9b98db30f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:10.108188 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b114a7-63ca-4c2a-9586-72a9b98db30f None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:10.113481 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbdfaa-6f79-4653-a0b6-02ed7fe88bcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:10.114975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbdfaa-6f79-4653-a0b6-02ed7fe88bcf None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:10.116414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 470/953] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:39:10.117672 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a9d11-54d1-4593-9db2-1cea7725a58e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:10.117958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a9d11-54d1-4593-9db2-1cea7725a58e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:10.118241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a9d11-54d1-4593-9db2-1cea7725a58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-39fbdfaa-6f79-4653-a0b6-02ed7fe88bcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:39:10.129340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:10.130306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:10.131282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:39:10.131282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:39:10.131282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:39:10.131282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:39:10.131282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:39:10.131282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:39:10.131282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:10.131282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:10.131282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 484/954] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:39:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:10.138066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbdfaa-6f79-4653-a0b6-02ed7fe88bcf None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:10.139928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d73a9d11-54d1-4593-9db2-1cea7725a58e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:10.141535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d73a9d11-54d1-4593-9db2-1cea7725a58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:10.217736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:10.237406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 471/955] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:10.259318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbdfaa-6f79-4653-a0b6-02ed7fe88bcf None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:10.297099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bee17c-4e5d-4aa2-a098-f682611fb912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:10.297998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bee17c-4e5d-4aa2-a098-f682611fb912 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:10.298463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bee17c-4e5d-4aa2-a098-f682611fb912 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:10.298960 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bee17c-4e5d-4aa2-a098-f682611fb912 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:10.299819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bee17c-4e5d-4aa2-a098-f682611fb912 None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:10.300304 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bee17c-4e5d-4aa2-a098-f682611fb912 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:10.301919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bee17c-4e5d-4aa2-a098-f682611fb912 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:10.305679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:10.320549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 485/956] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:39:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:10.511203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a9d11-54d1-4593-9db2-1cea7725a58e None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:10.619235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a9d11-54d1-4593-9db2-1cea7725a58e None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:10.661229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57759608-ea21-4b6a-bfaf-54d855660a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:10.662255 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57759608-ea21-4b6a-bfaf-54d855660a86 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:10.662754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57759608-ea21-4b6a-bfaf-54d855660a86 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:10.663252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57759608-ea21-4b6a-bfaf-54d855660a86 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:10.664306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57759608-ea21-4b6a-bfaf-54d855660a86 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:10.665994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57759608-ea21-4b6a-bfaf-54d855660a86 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:10.752087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 472/957] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:39:10 2022] POST /identity/v3/services => generated 242 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:39:10.793493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a76a2-3fc7-45ff-b571-fcd87fda2890 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:10.793855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a76a2-3fc7-45ff-b571-fcd87fda2890 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:10.794061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a76a2-3fc7-45ff-b571-fcd87fda2890 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:10.795826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 486/958] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:10.801776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032002eb-bf51-480f-8345-26ee21e57c2f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:10.802093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032002eb-bf51-480f-8345-26ee21e57c2f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:10.802335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032002eb-bf51-480f-8345-26ee21e57c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:10.823189 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-032002eb-bf51-480f-8345-26ee21e57c2f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:10.824961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-032002eb-bf51-480f-8345-26ee21e57c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:10.880881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:10.910279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 473/959] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:11.180299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a76a2-3fc7-45ff-b571-fcd87fda2890 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:11.287862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a76a2-3fc7-45ff-b571-fcd87fda2890 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:11.327815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43231b38-ebf9-45f8-ba16-5e622bac3ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:11.329007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43231b38-ebf9-45f8-ba16-5e622bac3ac6 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:11.329492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43231b38-ebf9-45f8-ba16-5e622bac3ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:11.329963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43231b38-ebf9-45f8-ba16-5e622bac3ac6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:11.340963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43231b38-ebf9-45f8-ba16-5e622bac3ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-43231b38-ebf9-45f8-ba16-5e622bac3ac6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:39:11.346127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:11.347088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:11.347963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:11.347963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:11.347963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:11.347963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:11.347963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:39:11.347963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:39:11.347963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:39:11.347963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:39:11.347963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:39:11.347963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:39:11.347963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:39:11.347963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:11.350609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 487/960] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Aug 29 23:39:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:11.356962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032002eb-bf51-480f-8345-26ee21e57c2f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:11.432423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58221e-1d8f-4911-b9a9-bf1fb230a7ad None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:11.433057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58221e-1d8f-4911-b9a9-bf1fb230a7ad None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:11.434118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58221e-1d8f-4911-b9a9-bf1fb230a7ad None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:11.436144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 488/961] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:11.440982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60765a7-9e0b-4760-b62e-ce64e85c0351 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:11.441259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60765a7-9e0b-4760-b62e-ce64e85c0351 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:11.441530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60765a7-9e0b-4760-b62e-ce64e85c0351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:11.460732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-b60765a7-9e0b-4760-b62e-ce64e85c0351 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:11.461922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b60765a7-9e0b-4760-b62e-ce64e85c0351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:11.464114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032002eb-bf51-480f-8345-26ee21e57c2f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:11.508664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376c21d-f347-48b9-a144-e250c796f28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:11.509299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376c21d-f347-48b9-a144-e250c796f28c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:11.509575 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376c21d-f347-48b9-a144-e250c796f28c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:11.509843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376c21d-f347-48b9-a144-e250c796f28c None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:11.510868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376c21d-f347-48b9-a144-e250c796f28c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:11.510868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376c21d-f347-48b9-a144-e250c796f28c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:11.512216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376c21d-f347-48b9-a144-e250c796f28c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:11.525800 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 474/962] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Aug 29 23:39:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:11.528432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376c21d-f347-48b9-a144-e250c796f28c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:11.539952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:11.560892 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 489/963] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:11.577191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:11.641750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376c21d-f347-48b9-a144-e250c796f28c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:11.679582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da9a60-fd05-4127-9792-db19ac602801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:11.680681 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da9a60-fd05-4127-9792-db19ac602801 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:11.681183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da9a60-fd05-4127-9792-db19ac602801 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:11.681723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da9a60-fd05-4127-9792-db19ac602801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:11.705969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da9a60-fd05-4127-9792-db19ac602801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:11.705969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da9a60-fd05-4127-9792-db19ac602801 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-b7da9a60-fd05-4127-9792-db19ac602801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:11.716285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:11.717647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:11.718996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:11.718996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:11.718996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:11.721271 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 475/964] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:11.727745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60765a7-9e0b-4760-b62e-ce64e85c0351 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:11.836631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60765a7-9e0b-4760-b62e-ce64e85c0351 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:11.846277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da9a60-fd05-4127-9792-db19ac602801 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:11.886202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f94a5-ee1f-4340-b271-650e165f4d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:11.888573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f94a5-ee1f-4340-b271-650e165f4d3b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:11.889059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f94a5-ee1f-4340-b271-650e165f4d3b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:11.889524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f94a5-ee1f-4340-b271-650e165f4d3b None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:11.890382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f94a5-ee1f-4340-b271-650e165f4d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:11.890909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f94a5-ee1f-4340-b271-650e165f4d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:11.893213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f94a5-ee1f-4340-b271-650e165f4d3b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:11.916389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 490/965] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:11.918229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f94a5-ee1f-4340-b271-650e165f4d3b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:11.953231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:11.969643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da9a60-fd05-4127-9792-db19ac602801 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:11.984827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:12.006337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654ec3c-f9eb-4b73-b230-0b3b56fda1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:12.007423 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654ec3c-f9eb-4b73-b230-0b3b56fda1b1 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.008172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654ec3c-f9eb-4b73-b230-0b3b56fda1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.008873 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654ec3c-f9eb-4b73-b230-0b3b56fda1b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.009665 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654ec3c-f9eb-4b73-b230-0b3b56fda1b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:12.011469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654ec3c-f9eb-4b73-b230-0b3b56fda1b1 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-8654ec3c-f9eb-4b73-b230-0b3b56fda1b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:12.023810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:12.025142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:12.026204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:12.030917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 476/966] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Aug 29 23:39:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:12.035505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654ec3c-f9eb-4b73-b230-0b3b56fda1b1 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:12.056679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f94a5-ee1f-4340-b271-650e165f4d3b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:12.093926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc79bd-1ab5-4d7a-b64b-464effb8f437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:12.094955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc79bd-1ab5-4d7a-b64b-464effb8f437 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.095534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc79bd-1ab5-4d7a-b64b-464effb8f437 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.096022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc79bd-1ab5-4d7a-b64b-464effb8f437 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.104651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc79bd-1ab5-4d7a-b64b-464effb8f437 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:12.106433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc79bd-1ab5-4d7a-b64b-464effb8f437 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-91cc79bd-1ab5-4d7a-b64b-464effb8f437 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:39:12.118813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:12.119800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:12.120749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:12.120749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:12.120749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:39:12.120749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:39:12.120749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:39:12.120749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:39:12.120749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:39:12.120749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:39:12.120749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:39:12.120749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:12.123454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 491/967] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Aug 29 23:39:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:12.132148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc79bd-1ab5-4d7a-b64b-464effb8f437 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:12.159609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654ec3c-f9eb-4b73-b230-0b3b56fda1b1 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:12.196921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054c8fd-eb2a-4327-a3a4-330d0636e2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:12.197997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054c8fd-eb2a-4327-a3a4-330d0636e2c4 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.198482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054c8fd-eb2a-4327-a3a4-330d0636e2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.199006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054c8fd-eb2a-4327-a3a4-330d0636e2c4 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.200610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054c8fd-eb2a-4327-a3a4-330d0636e2c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:12.201252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054c8fd-eb2a-4327-a3a4-330d0636e2c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:12.202964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054c8fd-eb2a-4327-a3a4-330d0636e2c4 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:12.209223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 477/968] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Aug 29 23:39:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:12.216805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054c8fd-eb2a-4327-a3a4-330d0636e2c4 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:12.241822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:12.265803 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc79bd-1ab5-4d7a-b64b-464effb8f437 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:12.273783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:12.303470 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a503a-bf8b-4f44-bb70-0b919e6bac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:12.304348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a503a-bf8b-4f44-bb70-0b919e6bac38 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.304724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a503a-bf8b-4f44-bb70-0b919e6bac38 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.305093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a503a-bf8b-4f44-bb70-0b919e6bac38 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.306028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a503a-bf8b-4f44-bb70-0b919e6bac38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:12.306434 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a503a-bf8b-4f44-bb70-0b919e6bac38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:12.309843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a503a-bf8b-4f44-bb70-0b919e6bac38 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:12.334904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 492/969] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Aug 29 23:39:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:12.336366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a503a-bf8b-4f44-bb70-0b919e6bac38 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:12.348300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054c8fd-eb2a-4327-a3a4-330d0636e2c4 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:12.398003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7ea53-d907-4ce4-89e8-fb8ee6b59e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:12.398658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7ea53-d907-4ce4-89e8-fb8ee6b59e2c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.398973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7ea53-d907-4ce4-89e8-fb8ee6b59e2c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.399168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7ea53-d907-4ce4-89e8-fb8ee6b59e2c None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.399802 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7ea53-d907-4ce4-89e8-fb8ee6b59e2c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:12.400101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7ea53-d907-4ce4-89e8-fb8ee6b59e2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:12.401441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7ea53-d907-4ce4-89e8-fb8ee6b59e2c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:12.411286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 478/970] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Aug 29 23:39:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:12.411286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c24f0e-da4e-4400-b9cc-3e2906c4e617 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.411286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c24f0e-da4e-4400-b9cc-3e2906c4e617 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.411286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c24f0e-da4e-4400-b9cc-3e2906c4e617 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.411286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 479/971] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:12.414077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c24f0e-da4e-4400-b9cc-3e2906c4e617 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:12.452489 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a503a-bf8b-4f44-bb70-0b919e6bac38 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:12.488366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5e2a0-4d0e-4bf0-803f-a4b77526434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:12.488968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5e2a0-4d0e-4bf0-803f-a4b77526434a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.489244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5e2a0-4d0e-4bf0-803f-a4b77526434a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.489513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5e2a0-4d0e-4bf0-803f-a4b77526434a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.505460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:12.523477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:12.525411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c24f0e-da4e-4400-b9cc-3e2906c4e617 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:12.561094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5e2a0-4d0e-4bf0-803f-a4b77526434a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:12.562119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312119-a8a7-48b2-87ca-4121e9913912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:12.562534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5e2a0-4d0e-4bf0-803f-a4b77526434a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:12.562815 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312119-a8a7-48b2-87ca-4121e9913912 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.563150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312119-a8a7-48b2-87ca-4121e9913912 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.563425 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312119-a8a7-48b2-87ca-4121e9913912 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.564086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67312119-a8a7-48b2-87ca-4121e9913912 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:12.565452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67312119-a8a7-48b2-87ca-4121e9913912 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:12.634863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 480/972] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:39:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:39:12.636158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f923-a244-48aa-8b10-fadfd58d78d9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.636446 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f923-a244-48aa-8b10-fadfd58d78d9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.636750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f923-a244-48aa-8b10-fadfd58d78d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.656375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-0709f923-a244-48aa-8b10-fadfd58d78d9 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:12.657630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0709f923-a244-48aa-8b10-fadfd58d78d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:12.684359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 493/973] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:39:12 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 23:39:12.686373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5e2a0-4d0e-4bf0-803f-a4b77526434a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:12.767049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 481/974] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:12.768262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a5fb-71af-4e0e-a1d2-343d5fedd3e2 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.768551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a5fb-71af-4e0e-a1d2-343d5fedd3e2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.768826 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a5fb-71af-4e0e-a1d2-343d5fedd3e2 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.770313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 482/975] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:12.775683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766d2a8-19b0-4f21-8af0-485d854fd797 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.776149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766d2a8-19b0-4f21-8af0-485d854fd797 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.776436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766d2a8-19b0-4f21-8af0-485d854fd797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.781847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:12.797354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-7766d2a8-19b0-4f21-8af0-485d854fd797 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:12.798046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7766d2a8-19b0-4f21-8af0-485d854fd797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:12.841964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5e2a0-4d0e-4bf0-803f-a4b77526434a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:12.877495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:12.885776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c6978-adfa-4a5e-ab10-6536afc72a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:12.888319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c6978-adfa-4a5e-ab10-6536afc72a3e None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.888319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c6978-adfa-4a5e-ab10-6536afc72a3e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.888319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c6978-adfa-4a5e-ab10-6536afc72a3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.888546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 483/976] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:12.904143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c6978-adfa-4a5e-ab10-6536afc72a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:12.906007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c6978-adfa-4a5e-ab10-6536afc72a3e None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-1f3c6978-adfa-4a5e-ab10-6536afc72a3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:12.922213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:12.923239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:12.924148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:12.924148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:12.924148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:12.930103 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 494/977] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:12.932277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766d2a8-19b0-4f21-8af0-485d854fd797 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:13.042450 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766d2a8-19b0-4f21-8af0-485d854fd797 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:13.048141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c6978-adfa-4a5e-ab10-6536afc72a3e None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:13.087284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8771a67-e272-4f01-b5b3-11e8736c1db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:13.088451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8771a67-e272-4f01-b5b3-11e8736c1db7 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:13.088733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8771a67-e272-4f01-b5b3-11e8736c1db7 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:13.089003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8771a67-e272-4f01-b5b3-11e8736c1db7 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:13.090182 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8771a67-e272-4f01-b5b3-11e8736c1db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:13.090972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8771a67-e272-4f01-b5b3-11e8736c1db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:13.092785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8771a67-e272-4f01-b5b3-11e8736c1db7 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:13.110460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 484/978] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:13.115502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8771a67-e272-4f01-b5b3-11e8736c1db7 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:13.161017 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c6978-adfa-4a5e-ab10-6536afc72a3e None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:13.182553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:13.187328 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:13.202064 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8990c63-08cc-473d-be53-2d1ed5b9e78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:13.205438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8990c63-08cc-473d-be53-2d1ed5b9e78f None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:13.205438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8990c63-08cc-473d-be53-2d1ed5b9e78f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:13.205438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8990c63-08cc-473d-be53-2d1ed5b9e78f None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:13.205438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8990c63-08cc-473d-be53-2d1ed5b9e78f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:13.205438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8990c63-08cc-473d-be53-2d1ed5b9e78f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:13.208878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: WARNING keystone.server.flask.common [None req-a8990c63-08cc-473d-be53-2d1ed5b9e78f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 23:39:13.232949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8771a67-e272-4f01-b5b3-11e8736c1db7 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:13.239618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.sql.core [None req-a8990c63-08cc-473d-be53-2d1ed5b9e78f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 23:39:13.239618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 23:39:13.239618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [parameters: {'user_id': 'ec4db970cd784f979f04d2c7781a23ab', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 23:39:13.239618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93262) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-a8990c63-08cc-473d-be53-2d1ed5b9e78f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application result.read() Aug 29 23:39:13.256815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:39:13.257975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application yield resource Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise self.value Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application session.commit() Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 23:39:13.259626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self.session.flush() Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application compat.raise_( Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 23:39:13.260800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:39:13.264806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application result.read() Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:39:13.268152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ec4db970cd784f979f04d2c7781a23ab', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:13.271641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 23:39:13.274324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 23:39:13.276745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 23:39:13.276745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 23:39:13.276745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 23:39:13.276745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 23:39:13.276745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 23:39:13.276745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:13.276745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 495/979] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Aug 29 23:39:13 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:13.276745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8990c63-08cc-473d-be53-2d1ed5b9e78f None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:13.278227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c716e09-b11f-478f-a90d-d27e7e9e0d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:13.278227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c716e09-b11f-478f-a90d-d27e7e9e0d66 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:13.278227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c716e09-b11f-478f-a90d-d27e7e9e0d66 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:13.278639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c716e09-b11f-478f-a90d-d27e7e9e0d66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:13.286592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c716e09-b11f-478f-a90d-d27e7e9e0d66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:13.288673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c716e09-b11f-478f-a90d-d27e7e9e0d66 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-3c716e09-b11f-478f-a90d-d27e7e9e0d66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:39:13.303535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:13.304941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:13.314408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:39:13.314408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:39:13.314408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:39:13.314408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:39:13.314408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:39:13.314408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:39:13.314408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:13.314408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:13.314408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 485/980] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:13.314408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c716e09-b11f-478f-a90d-d27e7e9e0d66 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:13.365455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8990c63-08cc-473d-be53-2d1ed5b9e78f None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:13.400790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66414e3-10c8-45d4-846b-71657b6c340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:13.401425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66414e3-10c8-45d4-846b-71657b6c340c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:13.401707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66414e3-10c8-45d4-846b-71657b6c340c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:13.401982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66414e3-10c8-45d4-846b-71657b6c340c None admin] PATH_INFO: `/v3/services/compute` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:13.402649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66414e3-10c8-45d4-846b-71657b6c340c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:13.404257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66414e3-10c8-45d4-846b-71657b6c340c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-c66414e3-10c8-45d4-846b-71657b6c340c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:13.413620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:13.414627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:13.415731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 496/981] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:39:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:13.416584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66414e3-10c8-45d4-846b-71657b6c340c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:13.434835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c716e09-b11f-478f-a90d-d27e7e9e0d66 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:13.453055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:13.466104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:13.473327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e3de6-eb9a-4bfc-abe2-cee351dfdcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:13.473992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e3de6-eb9a-4bfc-abe2-cee351dfdcbd None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:13.474276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e3de6-eb9a-4bfc-abe2-cee351dfdcbd None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:13.474549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e3de6-eb9a-4bfc-abe2-cee351dfdcbd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:13.483895 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e3de6-eb9a-4bfc-abe2-cee351dfdcbd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:13.486072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e3de6-eb9a-4bfc-abe2-cee351dfdcbd None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-3f9e3de6-eb9a-4bfc-abe2-cee351dfdcbd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:39:13.499488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:13.500457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:13.501493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:13.501493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:13.501493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:39:13.501493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:39:13.501493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:39:13.501493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:39:13.501493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:39:13.501493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:39:13.501493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:39:13.501493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:13.503460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 486/982] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:39:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:13.508811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e3de6-eb9a-4bfc-abe2-cee351dfdcbd None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:13.526734 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66414e3-10c8-45d4-846b-71657b6c340c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:13.562665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a52eb-a22d-4070-a0fa-ebbcf2dce6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:13.563379 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a52eb-a22d-4070-a0fa-ebbcf2dce6b8 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:13.563791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a52eb-a22d-4070-a0fa-ebbcf2dce6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:13.564162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a52eb-a22d-4070-a0fa-ebbcf2dce6b8 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:13.564956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a52eb-a22d-4070-a0fa-ebbcf2dce6b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:13.565387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a52eb-a22d-4070-a0fa-ebbcf2dce6b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:13.566983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a52eb-a22d-4070-a0fa-ebbcf2dce6b8 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:13.587321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 497/983] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:13.587321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a52eb-a22d-4070-a0fa-ebbcf2dce6b8 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:13.620603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e3de6-eb9a-4bfc-abe2-cee351dfdcbd None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:13.657795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ebe1e-6c50-4851-ac9f-27bfe11858e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:13.659367 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ebe1e-6c50-4851-ac9f-27bfe11858e9 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:13.660140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ebe1e-6c50-4851-ac9f-27bfe11858e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:13.660656 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ebe1e-6c50-4851-ac9f-27bfe11858e9 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:13.661764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ebe1e-6c50-4851-ac9f-27bfe11858e9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:13.663200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ebe1e-6c50-4851-ac9f-27bfe11858e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:13.664794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ebe1e-6c50-4851-ac9f-27bfe11858e9 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:13.671402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 487/984] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:39:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:13.672678 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ebe1e-6c50-4851-ac9f-27bfe11858e9 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:13.694235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a52eb-a22d-4070-a0fa-ebbcf2dce6b8 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:13.695959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:13.719330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:13.733300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b066ae4-5c22-4fad-a4f8-4f3d334100e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:13.734437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b066ae4-5c22-4fad-a4f8-4f3d334100e4 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:13.734900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b066ae4-5c22-4fad-a4f8-4f3d334100e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:13.735180 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b066ae4-5c22-4fad-a4f8-4f3d334100e4 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:13.735897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b066ae4-5c22-4fad-a4f8-4f3d334100e4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:13.736201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b066ae4-5c22-4fad-a4f8-4f3d334100e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:13.739979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b066ae4-5c22-4fad-a4f8-4f3d334100e4 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:13.786935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 498/985] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Aug 29 23:39:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:13.786935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b066ae4-5c22-4fad-a4f8-4f3d334100e4 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:13.796449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ebe1e-6c50-4851-ac9f-27bfe11858e9 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:13.837744 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebfaed-1792-490d-8690-567f9a0c2bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:13.838322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebfaed-1792-490d-8690-567f9a0c2bbc None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:13.838605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebfaed-1792-490d-8690-567f9a0c2bbc None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:13.838904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebfaed-1792-490d-8690-567f9a0c2bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:13.839726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebfaed-1792-490d-8690-567f9a0c2bbc None admin] RBAC: Adding query filter params (role.id=d62272f04f1e4171b328b9b14b8eed03, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=ef922e08ae644f6a84034366f59d5591) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:13.840045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebfaed-1792-490d-8690-567f9a0c2bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:13.841542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebfaed-1792-490d-8690-567f9a0c2bbc None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:13.859500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 488/986] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:39:13 2022] GET /identity/v3/role_assignments?user.id=ef922e08ae644f6a84034366f59d5591&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=d62272f04f1e4171b328b9b14b8eed03 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:13.919850 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b066ae4-5c22-4fad-a4f8-4f3d334100e4 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:13.965756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda62d08-94eb-42ca-99f9-5c1697bd35d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:13.966779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda62d08-94eb-42ca-99f9-5c1697bd35d0 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:13.967374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda62d08-94eb-42ca-99f9-5c1697bd35d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:13.967907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda62d08-94eb-42ca-99f9-5c1697bd35d0 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:13.968788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda62d08-94eb-42ca-99f9-5c1697bd35d0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:13.969299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda62d08-94eb-42ca-99f9-5c1697bd35d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:13.970995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda62d08-94eb-42ca-99f9-5c1697bd35d0 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:13.977533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 499/987] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:39:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:13.983808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebfaed-1792-490d-8690-567f9a0c2bbc None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:14.092847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebfaed-1792-490d-8690-567f9a0c2bbc None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:14.094496 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:14.129385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2b74b-ea03-4ce3-8eb3-6fba2a3c39ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:14.130015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2b74b-ea03-4ce3-8eb3-6fba2a3c39ef None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:14.130508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2b74b-ea03-4ce3-8eb3-6fba2a3c39ef None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:14.131133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2b74b-ea03-4ce3-8eb3-6fba2a3c39ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:14.131891 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2b74b-ea03-4ce3-8eb3-6fba2a3c39ef None admin] RBAC: Adding query filter params (interface=public, service_id=1ec4cc9e39f04c67bebc127c22cef76d, region_id=RegionOne) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:14.132199 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2b74b-ea03-4ce3-8eb3-6fba2a3c39ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:14.133696 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2b74b-ea03-4ce3-8eb3-6fba2a3c39ef None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:14.139035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 489/988] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Aug 29 23:39:13 2022] GET /identity/v3/endpoints?service_id=1ec4cc9e39f04c67bebc127c22cef76d&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:14.144741 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda62d08-94eb-42ca-99f9-5c1697bd35d0 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:14.170161 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:14.246474 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda62d08-94eb-42ca-99f9-5c1697bd35d0 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:14.280091 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e1ac-d73e-4b4b-919c-83d847783df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:14.280747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e1ac-d73e-4b4b-919c-83d847783df7 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:14.281001 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e1ac-d73e-4b4b-919c-83d847783df7 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:14.281216 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e1ac-d73e-4b4b-919c-83d847783df7 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:14.281813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899e1ac-d73e-4b4b-919c-83d847783df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:14.283202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899e1ac-d73e-4b4b-919c-83d847783df7 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:14.289747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 500/989] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Aug 29 23:39:14 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:39:14.630727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a8c9d-0924-4ad1-b1b8-1bbe51d877f0 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:14.631275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a8c9d-0924-4ad1-b1b8-1bbe51d877f0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:14.631352 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a8c9d-0924-4ad1-b1b8-1bbe51d877f0 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:14.632779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 490/990] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:14.637832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae919358-e0d0-4d88-8aae-cb430127d264 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:14.638123 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae919358-e0d0-4d88-8aae-cb430127d264 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:14.638400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae919358-e0d0-4d88-8aae-cb430127d264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:14.657055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-ae919358-e0d0-4d88-8aae-cb430127d264 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:14.658650 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ae919358-e0d0-4d88-8aae-cb430127d264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:14.728089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 501/991] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:15.001185 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a8c9d-0924-4ad1-b1b8-1bbe51d877f0 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:15.103988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a8c9d-0924-4ad1-b1b8-1bbe51d877f0 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:15.137916 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112b46b-835f-4606-aab2-326a90d06a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:15.150576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112b46b-835f-4606-aab2-326a90d06a16 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:15.150576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112b46b-835f-4606-aab2-326a90d06a16 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:15.150576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112b46b-835f-4606-aab2-326a90d06a16 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:15.150576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112b46b-835f-4606-aab2-326a90d06a16 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:15.150576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112b46b-835f-4606-aab2-326a90d06a16 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:15.150576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-f112b46b-835f-4606-aab2-326a90d06a16 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:15.150576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:15.151269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:15.152475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:15.153388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:15.153388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:15.153388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:15.153388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:15.153388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:15.153388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:15.153388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:15.153388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:15.153388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:15.153388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:15.153388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:15.155226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 491/992] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Aug 29 23:39:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:15.156917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae919358-e0d0-4d88-8aae-cb430127d264 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:15.176709 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:15.261597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae919358-e0d0-4d88-8aae-cb430127d264 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:15.296926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0ee89-20a6-44a7-be5d-11331f634c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:15.297545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0ee89-20a6-44a7-be5d-11331f634c4a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:15.297813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0ee89-20a6-44a7-be5d-11331f634c4a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:15.298183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0ee89-20a6-44a7-be5d-11331f634c4a None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:15.298720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0ee89-20a6-44a7-be5d-11331f634c4a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:15.299049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0ee89-20a6-44a7-be5d-11331f634c4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:15.300414 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0ee89-20a6-44a7-be5d-11331f634c4a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:15.309741 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 502/993] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Aug 29 23:39:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:15.310918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112b46b-835f-4606-aab2-326a90d06a16 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:15.345256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:15.423523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112b46b-835f-4606-aab2-326a90d06a16 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:15.459039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f3323-d2fd-47d2-ae7c-18c4c1ebc2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:15.459651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f3323-d2fd-47d2-ae7c-18c4c1ebc2de None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:15.459933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f3323-d2fd-47d2-ae7c-18c4c1ebc2de None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:15.460205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f3323-d2fd-47d2-ae7c-18c4c1ebc2de None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:15.460830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f3323-d2fd-47d2-ae7c-18c4c1ebc2de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:15.461133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f3323-d2fd-47d2-ae7c-18c4c1ebc2de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:15.462483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f3323-d2fd-47d2-ae7c-18c4c1ebc2de None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:15.472684 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 492/994] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Aug 29 23:39:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:15.473970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0ee89-20a6-44a7-be5d-11331f634c4a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:15.558102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:15.576717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0ee89-20a6-44a7-be5d-11331f634c4a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:15.611042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875f829-71ef-4778-8437-2f980d583acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:15.611655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875f829-71ef-4778-8437-2f980d583acc None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:15.611927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875f829-71ef-4778-8437-2f980d583acc None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:15.612198 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875f829-71ef-4778-8437-2f980d583acc None admin] PATH_INFO: `/v3/endpoints` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:15.612897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875f829-71ef-4778-8437-2f980d583acc None admin] RBAC: Adding query filter params (interface=admin, service_id=2530dd8f8c85451a8656c56b8cc2b678, region_id=RegionOne) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:15.613199 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875f829-71ef-4778-8437-2f980d583acc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:15.614552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875f829-71ef-4778-8437-2f980d583acc None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:15.619992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 503/995] 10.222.0.73 () {56 vars in 1249 bytes} [Mon Aug 29 23:39:15 2022] GET /identity/v3/endpoints?service_id=2530dd8f8c85451a8656c56b8cc2b678&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:15.625378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f3323-d2fd-47d2-ae7c-18c4c1ebc2de None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:15.724772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:15.737830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f3323-d2fd-47d2-ae7c-18c4c1ebc2de None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:15.775703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33badc5c-5c58-4749-aa39-2b8c6b43b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:15.776318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33badc5c-5c58-4749-aa39-2b8c6b43b013 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:15.776601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33badc5c-5c58-4749-aa39-2b8c6b43b013 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:15.776876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33badc5c-5c58-4749-aa39-2b8c6b43b013 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:15.778082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33badc5c-5c58-4749-aa39-2b8c6b43b013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:15.779468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33badc5c-5c58-4749-aa39-2b8c6b43b013 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:15.785944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 493/996] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Aug 29 23:39:15 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:39:15.861153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3036b-f0fd-4579-be17-25fc3c8a1eb6 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:15.861448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3036b-f0fd-4579-be17-25fc3c8a1eb6 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:15.861627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3036b-f0fd-4579-be17-25fc3c8a1eb6 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:15.863227 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 504/997] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:15.868730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe25e0a-2441-46cf-9452-321aa9c2c122 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:15.869021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe25e0a-2441-46cf-9452-321aa9c2c122 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:15.869293 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe25e0a-2441-46cf-9452-321aa9c2c122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:15.888950 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-cfe25e0a-2441-46cf-9452-321aa9c2c122 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:15.890190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-cfe25e0a-2441-46cf-9452-321aa9c2c122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:15.966657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 494/998] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:16.207550 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493eefd-f1f3-4797-b20b-497281270f30 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:16.207894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493eefd-f1f3-4797-b20b-497281270f30 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:16.207998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493eefd-f1f3-4797-b20b-497281270f30 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:16.209400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 505/999] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:16.214507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f822bb7-7282-4e2a-8c6a-5077440ed4e9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:16.214797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f822bb7-7282-4e2a-8c6a-5077440ed4e9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:16.215118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f822bb7-7282-4e2a-8c6a-5077440ed4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:16.232693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493eefd-f1f3-4797-b20b-497281270f30 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:16.233988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-6f822bb7-7282-4e2a-8c6a-5077440ed4e9 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:16.235205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6f822bb7-7282-4e2a-8c6a-5077440ed4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:16.307183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 495/1000] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:16.350779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493eefd-f1f3-4797-b20b-497281270f30 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:16.386609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d17c2-22e5-47c5-9f8b-617a1ef80ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:16.387269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d17c2-22e5-47c5-9f8b-617a1ef80ac7 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:16.387551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d17c2-22e5-47c5-9f8b-617a1ef80ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:16.387825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d17c2-22e5-47c5-9f8b-617a1ef80ac7 None admin] PATH_INFO: `/v3/services/image` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:16.388511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d17c2-22e5-47c5-9f8b-617a1ef80ac7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:16.389879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d17c2-22e5-47c5-9f8b-617a1ef80ac7 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-747d17c2-22e5-47c5-9f8b-617a1ef80ac7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:16.398844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:16.399839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:16.403929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 506/1001] 10.222.0.73 () {56 vars in 1105 bytes} [Mon Aug 29 23:39:16 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:16.406009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f822bb7-7282-4e2a-8c6a-5077440ed4e9 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:16.426433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:16.508574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f822bb7-7282-4e2a-8c6a-5077440ed4e9 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:16.541401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8d61d-24db-435d-b1d1-182f91e435b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:16.542005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8d61d-24db-435d-b1d1-182f91e435b5 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:16.542286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8d61d-24db-435d-b1d1-182f91e435b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:16.543114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8d61d-24db-435d-b1d1-182f91e435b5 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:16.543759 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8d61d-24db-435d-b1d1-182f91e435b5 None admin] RBAC: Adding query filter params (name=image) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:16.544064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8d61d-24db-435d-b1d1-182f91e435b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:16.545407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8d61d-24db-435d-b1d1-182f91e435b5 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:16.550320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 496/1002] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:16.555769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d17c2-22e5-47c5-9f8b-617a1ef80ac7 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:16.568541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:16.575630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8d61d-24db-435d-b1d1-182f91e435b5 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:16.662616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d17c2-22e5-47c5-9f8b-617a1ef80ac7 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:16.662839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:16.682162 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8d61d-24db-435d-b1d1-182f91e435b5 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:16.698381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fde07-e53f-4856-a4c9-45761876af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:16.699569 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fde07-e53f-4856-a4c9-45761876af0b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:16.699850 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fde07-e53f-4856-a4c9-45761876af0b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:16.700124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fde07-e53f-4856-a4c9-45761876af0b None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:16.700872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fde07-e53f-4856-a4c9-45761876af0b None admin] RBAC: Adding query filter params (type=image) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:16.701293 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fde07-e53f-4856-a4c9-45761876af0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:16.702664 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fde07-e53f-4856-a4c9-45761876af0b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:16.717940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4037b63-9214-4306-944f-c513854e354e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:16.718601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037b63-9214-4306-944f-c513854e354e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:16.718907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037b63-9214-4306-944f-c513854e354e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:16.719097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 507/1003] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:16.719425 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037b63-9214-4306-944f-c513854e354e None admin] PATH_INFO: `/v3/services/compute` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:16.720132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4037b63-9214-4306-944f-c513854e354e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:16.721541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4037b63-9214-4306-944f-c513854e354e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-d4037b63-9214-4306-944f-c513854e354e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:16.732008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:16.735316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:16.736230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 497/1004] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:39:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:16.744686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fde07-e53f-4856-a4c9-45761876af0b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:16.831552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:16.857918 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fde07-e53f-4856-a4c9-45761876af0b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:16.897986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46db7c2-0fb4-4ce4-ae63-e6f367421a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:16.898590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46db7c2-0fb4-4ce4-ae63-e6f367421a6a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:16.898865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46db7c2-0fb4-4ce4-ae63-e6f367421a6a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:16.899176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46db7c2-0fb4-4ce4-ae63-e6f367421a6a None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:16.899800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46db7c2-0fb4-4ce4-ae63-e6f367421a6a None admin] RBAC: Adding query filter params (name=compute) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:16.900098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46db7c2-0fb4-4ce4-ae63-e6f367421a6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:16.901453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46db7c2-0fb4-4ce4-ae63-e6f367421a6a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:16.910661 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 508/1005] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:39:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:16.912570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4037b63-9214-4306-944f-c513854e354e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:17.015741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4037b63-9214-4306-944f-c513854e354e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:17.049835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07206-ff5f-4d52-b5f9-91ffd68c8b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:17.050436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07206-ff5f-4d52-b5f9-91ffd68c8b94 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:17.050711 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07206-ff5f-4d52-b5f9-91ffd68c8b94 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:17.051022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07206-ff5f-4d52-b5f9-91ffd68c8b94 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:17.051644 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07206-ff5f-4d52-b5f9-91ffd68c8b94 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:17.051939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07206-ff5f-4d52-b5f9-91ffd68c8b94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:17.053347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07206-ff5f-4d52-b5f9-91ffd68c8b94 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:17.062921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 498/1006] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Aug 29 23:39:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:17.064854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46db7c2-0fb4-4ce4-ae63-e6f367421a6a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:17.170717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46db7c2-0fb4-4ce4-ae63-e6f367421a6a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:17.205141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe39b56-da0f-4158-8bb9-38aa23a64016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:17.205749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe39b56-da0f-4158-8bb9-38aa23a64016 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:17.206027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe39b56-da0f-4158-8bb9-38aa23a64016 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:17.206298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe39b56-da0f-4158-8bb9-38aa23a64016 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:17.206988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe39b56-da0f-4158-8bb9-38aa23a64016 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:17.208356 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe39b56-da0f-4158-8bb9-38aa23a64016 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:17.216968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:17.280731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 509/1007] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:39:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:39:17.726074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c5a4d-464c-4b14-80dd-d1db5f9b87e8 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:17.726400 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c5a4d-464c-4b14-80dd-d1db5f9b87e8 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:17.726630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c5a4d-464c-4b14-80dd-d1db5f9b87e8 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:17.728169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 499/1008] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:17.735836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5492c1d-9683-4ed1-8190-1fcf22f24feb None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:17.736294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5492c1d-9683-4ed1-8190-1fcf22f24feb None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:17.736372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5492c1d-9683-4ed1-8190-1fcf22f24feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:17.755370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-f5492c1d-9683-4ed1-8190-1fcf22f24feb None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:17.756568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f5492c1d-9683-4ed1-8190-1fcf22f24feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:17.834617 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 510/1009] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:17 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:18.103217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c5a4d-464c-4b14-80dd-d1db5f9b87e8 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:18.117079 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:18.206632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c5a4d-464c-4b14-80dd-d1db5f9b87e8 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:18.241509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dd7aa-4cac-44da-97a8-b8b2ba8e6b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:18.242138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dd7aa-4cac-44da-97a8-b8b2ba8e6b4d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:18.242418 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dd7aa-4cac-44da-97a8-b8b2ba8e6b4d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:18.242688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dd7aa-4cac-44da-97a8-b8b2ba8e6b4d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:18.243297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dd7aa-4cac-44da-97a8-b8b2ba8e6b4d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:18.244653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dd7aa-4cac-44da-97a8-b8b2ba8e6b4d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-562dd7aa-4cac-44da-97a8-b8b2ba8e6b4d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:18.253506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:18.254507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:39:18.255401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:18.259281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 500/1010] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Aug 29 23:39:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:18.260522 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5492c1d-9683-4ed1-8190-1fcf22f24feb None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:18.366141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5492c1d-9683-4ed1-8190-1fcf22f24feb None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:18.387304 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:18.401465 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c5707-daaf-4432-8433-669353589cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:18.402972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c5707-daaf-4432-8433-669353589cde None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:18.403463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c5707-daaf-4432-8433-669353589cde None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:18.403934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c5707-daaf-4432-8433-669353589cde None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:18.404835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c5707-daaf-4432-8433-669353589cde None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:18.405355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c5707-daaf-4432-8433-669353589cde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:18.406990 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c5707-daaf-4432-8433-669353589cde None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:18.416638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 511/1011] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Aug 29 23:39:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:18.418867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dd7aa-4cac-44da-97a8-b8b2ba8e6b4d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:18.500278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:18.525133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dd7aa-4cac-44da-97a8-b8b2ba8e6b4d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:18.560427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94f62-1b6f-4706-be01-1586b75c0eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:18.561032 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94f62-1b6f-4706-be01-1586b75c0eef None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:18.561311 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94f62-1b6f-4706-be01-1586b75c0eef None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:18.561584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94f62-1b6f-4706-be01-1586b75c0eef None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:18.562207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c94f62-1b6f-4706-be01-1586b75c0eef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:18.562514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c94f62-1b6f-4706-be01-1586b75c0eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:18.563999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c94f62-1b6f-4706-be01-1586b75c0eef None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:18.573361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 501/1012] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Aug 29 23:39:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:18.575149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c5707-daaf-4432-8433-669353589cde None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:18.638266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cc87a-3bd3-481c-8cde-e35752766d28 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:18.638844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cc87a-3bd3-481c-8cde-e35752766d28 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:18.639314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cc87a-3bd3-481c-8cde-e35752766d28 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:18.640905 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 502/1013] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:18.646036 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f946841-e80e-493e-8a1d-e7762786112d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:18.646320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f946841-e80e-493e-8a1d-e7762786112d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:18.646621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f946841-e80e-493e-8a1d-e7762786112d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:18.665590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5f946841-e80e-493e-8a1d-e7762786112d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:18.666775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5f946841-e80e-493e-8a1d-e7762786112d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:18.679079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c5707-daaf-4432-8433-669353589cde None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:18.715803 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41318ac4-fc74-456e-931f-604188c679cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:18.719936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41318ac4-fc74-456e-931f-604188c679cf None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:18.719936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41318ac4-fc74-456e-931f-604188c679cf None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:18.719936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41318ac4-fc74-456e-931f-604188c679cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:18.719936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41318ac4-fc74-456e-931f-604188c679cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:18.719936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41318ac4-fc74-456e-931f-604188c679cf None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:18.740621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 503/1014] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:18 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:18.795750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 512/1015] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:39:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:39:19.012623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f946841-e80e-493e-8a1d-e7762786112d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:19.080326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:19.115624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f946841-e80e-493e-8a1d-e7762786112d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:19.156295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c032717-362f-4ff9-8056-fb234aa5d39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:19.156912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c032717-362f-4ff9-8056-fb234aa5d39b None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:19.157191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c032717-362f-4ff9-8056-fb234aa5d39b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:19.157462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c032717-362f-4ff9-8056-fb234aa5d39b None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:19.158119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c032717-362f-4ff9-8056-fb234aa5d39b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:19.159528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c032717-362f-4ff9-8056-fb234aa5d39b None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:19.281026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 504/1016] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:39:19 2022] POST /identity/v3/services => generated 242 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:39:19.303099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098c4ef-34f6-48aa-9d1c-a18970d93265 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:19.303426 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098c4ef-34f6-48aa-9d1c-a18970d93265 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:19.303664 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098c4ef-34f6-48aa-9d1c-a18970d93265 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:19.305087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 513/1017] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:19.311314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e660-40ba-4ce7-abec-0fec462cb610 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:19.311641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e660-40ba-4ce7-abec-0fec462cb610 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:19.311913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e660-40ba-4ce7-abec-0fec462cb610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:19.331866 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-3c78e660-40ba-4ce7-abec-0fec462cb610 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:19.333121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3c78e660-40ba-4ce7-abec-0fec462cb610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:19.415004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 505/1018] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:19.679337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098c4ef-34f6-48aa-9d1c-a18970d93265 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:19.727189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:19.795213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098c4ef-34f6-48aa-9d1c-a18970d93265 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:19.830159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991a1e8-387c-4127-94de-bc04c6c79fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:19.830787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991a1e8-387c-4127-94de-bc04c6c79fd0 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:19.831084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991a1e8-387c-4127-94de-bc04c6c79fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:19.831359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991a1e8-387c-4127-94de-bc04c6c79fd0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:19.842282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991a1e8-387c-4127-94de-bc04c6c79fd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-0991a1e8-387c-4127-94de-bc04c6c79fd0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:39:19.847112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:19.848061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:19.848906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:19.848906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:19.848906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:19.848906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:19.848906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:39:19.848906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:39:19.848906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:39:19.848906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:39:19.848906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:39:19.848906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:39:19.848906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:39:19.848906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:19.850251 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 514/1019] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Aug 29 23:39:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:19.854312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e660-40ba-4ce7-abec-0fec462cb610 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:19.905948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:19.956965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e660-40ba-4ce7-abec-0fec462cb610 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:19.992210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025289e-0b6e-4667-8224-ddbc9bf0f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:19.992820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025289e-0b6e-4667-8224-ddbc9bf0f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:19.993096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025289e-0b6e-4667-8224-ddbc9bf0f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:19.993364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025289e-0b6e-4667-8224-ddbc9bf0f7b6 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:19.994161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025289e-0b6e-4667-8224-ddbc9bf0f7b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:19.994462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025289e-0b6e-4667-8224-ddbc9bf0f7b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:19.996320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025289e-0b6e-4667-8224-ddbc9bf0f7b6 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:20.008962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 506/1020] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Aug 29 23:39:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:20.010725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991a1e8-387c-4127-94de-bc04c6c79fd0 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:20.112012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991a1e8-387c-4127-94de-bc04c6c79fd0 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:20.114315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:20.146665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049926c-c5c4-453c-accc-6ef0edfc3ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:20.147322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049926c-c5c4-453c-accc-6ef0edfc3ba7 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:20.147595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049926c-c5c4-453c-accc-6ef0edfc3ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:20.147863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049926c-c5c4-453c-accc-6ef0edfc3ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:20.159669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049926c-c5c4-453c-accc-6ef0edfc3ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:20.161122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049926c-c5c4-453c-accc-6ef0edfc3ba7 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-6049926c-c5c4-453c-accc-6ef0edfc3ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:20.175933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:20.195417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:20.196528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:20.196528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:20.196528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:20.196528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 515/1021] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:20.196813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025289e-0b6e-4667-8224-ddbc9bf0f7b6 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:20.326133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025289e-0b6e-4667-8224-ddbc9bf0f7b6 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:20.338993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:20.360846 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cc079-575d-466f-87b4-10c4c7ebb305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:20.361455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cc079-575d-466f-87b4-10c4c7ebb305 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:20.361728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cc079-575d-466f-87b4-10c4c7ebb305 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:20.362000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cc079-575d-466f-87b4-10c4c7ebb305 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:20.362663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cc079-575d-466f-87b4-10c4c7ebb305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:20.362997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cc079-575d-466f-87b4-10c4c7ebb305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:20.364392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cc079-575d-466f-87b4-10c4c7ebb305 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:20.379033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 507/1022] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:20.382039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049926c-c5c4-453c-accc-6ef0edfc3ba7 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:20.484754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049926c-c5c4-453c-accc-6ef0edfc3ba7 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:20.517013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d818b-7bcd-4f69-b69a-80503903cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:20.517629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d818b-7bcd-4f69-b69a-80503903cc86 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:20.517901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d818b-7bcd-4f69-b69a-80503903cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:20.518166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d818b-7bcd-4f69-b69a-80503903cc86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:20.525321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d818b-7bcd-4f69-b69a-80503903cc86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:20.527263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d818b-7bcd-4f69-b69a-80503903cc86 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-b34d818b-7bcd-4f69-b69a-80503903cc86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:39:20.538079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:20.539037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:20.540095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:20.540095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:20.540095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:39:20.540095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:39:20.540095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:39:20.540095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:39:20.540095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:39:20.540095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:39:20.540095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:39:20.540095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:20.540095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 516/1023] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Aug 29 23:39:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:20.547955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cc079-575d-466f-87b4-10c4c7ebb305 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:20.650984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cc079-575d-466f-87b4-10c4c7ebb305 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:20.687722 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89141c1-8ac9-413d-a984-14b240812c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:20.688335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89141c1-8ac9-413d-a984-14b240812c6b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:20.688617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89141c1-8ac9-413d-a984-14b240812c6b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:20.688889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89141c1-8ac9-413d-a984-14b240812c6b None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:20.689629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89141c1-8ac9-413d-a984-14b240812c6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:20.689961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89141c1-8ac9-413d-a984-14b240812c6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:20.691427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89141c1-8ac9-413d-a984-14b240812c6b None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:20.715438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 508/1024] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Aug 29 23:39:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:20.716617 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d818b-7bcd-4f69-b69a-80503903cc86 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:20.725044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957816cb-0a4d-40c1-abcb-bd06910de90a None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:20.725333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957816cb-0a4d-40c1-abcb-bd06910de90a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:20.725665 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957816cb-0a4d-40c1-abcb-bd06910de90a None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:20.727250 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 509/1025] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:39:20.732972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdc362-9347-4f9e-8a90-0c1b4053f880 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:20.733252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdc362-9347-4f9e-8a90-0c1b4053f880 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:20.733525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdc362-9347-4f9e-8a90-0c1b4053f880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:20.741013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:20.756987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-45bdc362-9347-4f9e-8a90-0c1b4053f880 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:20.758173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-45bdc362-9347-4f9e-8a90-0c1b4053f880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:20.783795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:20.825226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d818b-7bcd-4f69-b69a-80503903cc86 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:20.831020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 510/1026] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:20.860840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9689d14-d1c6-4bb7-8725-a417b50359bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:20.861466 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9689d14-d1c6-4bb7-8725-a417b50359bb None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:20.861713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9689d14-d1c6-4bb7-8725-a417b50359bb None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:20.861979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9689d14-d1c6-4bb7-8725-a417b50359bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:20.930711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9689d14-d1c6-4bb7-8725-a417b50359bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:20.932099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9689d14-d1c6-4bb7-8725-a417b50359bb None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:20.950551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:21.034095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 517/1027] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:39:20 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:39:21.039626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdc362-9347-4f9e-8a90-0c1b4053f880 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:21.096183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9689d14-d1c6-4bb7-8725-a417b50359bb None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:21.141431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdc362-9347-4f9e-8a90-0c1b4053f880 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:21.178987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ac255-b8d3-420f-9270-bc6b83917f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:21.179625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ac255-b8d3-420f-9270-bc6b83917f77 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:21.179906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ac255-b8d3-420f-9270-bc6b83917f77 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:21.180184 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ac255-b8d3-420f-9270-bc6b83917f77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:21.191311 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ac255-b8d3-420f-9270-bc6b83917f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:21.193176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ac255-b8d3-420f-9270-bc6b83917f77 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:21.205342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9689d14-d1c6-4bb7-8725-a417b50359bb None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-232ac255-b8d3-420f-9270-bc6b83917f77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:21.212477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:21.213897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:21.215144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:21.215144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:21.215144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:21.221285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 511/1028] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:21.222296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ac255-b8d3-420f-9270-bc6b83917f77 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:21.223034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:21.239226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:21.241574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abac800-cce5-4341-8314-385e93305e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:21.242211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abac800-cce5-4341-8314-385e93305e6d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:21.242494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abac800-cce5-4341-8314-385e93305e6d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:21.242769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abac800-cce5-4341-8314-385e93305e6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:21.246699 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abac800-cce5-4341-8314-385e93305e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:21.246699 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abac800-cce5-4341-8314-385e93305e6d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:21.247861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 518/1029] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:21.253823 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abac800-cce5-4341-8314-385e93305e6d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:21.340176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ac255-b8d3-420f-9270-bc6b83917f77 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:21.359000 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abac800-cce5-4341-8314-385e93305e6d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:21.379032 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b852b-ad8d-41ed-9b6c-61d309ff1cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:21.379637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b852b-ad8d-41ed-9b6c-61d309ff1cf2 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:21.379916 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b852b-ad8d-41ed-9b6c-61d309ff1cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:21.380189 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b852b-ad8d-41ed-9b6c-61d309ff1cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:21.380831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b852b-ad8d-41ed-9b6c-61d309ff1cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:21.381198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b852b-ad8d-41ed-9b6c-61d309ff1cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:21.382549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b852b-ad8d-41ed-9b6c-61d309ff1cf2 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:21.394274 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 512/1030] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:21.395494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9d5eb-9504-425f-8a24-fffa7f00fc4c None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:21.395727 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f1b59-fb54-4a20-a0dd-d6019608c69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:21.395873 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9d5eb-9504-425f-8a24-fffa7f00fc4c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:21.396039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9d5eb-9504-425f-8a24-fffa7f00fc4c None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:21.396328 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1b59-fb54-4a20-a0dd-d6019608c69b None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:21.396602 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1b59-fb54-4a20-a0dd-d6019608c69b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:21.396872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1b59-fb54-4a20-a0dd-d6019608c69b None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:21.397235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 513/1031] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:21.397785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f1b59-fb54-4a20-a0dd-d6019608c69b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:21.399370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f1b59-fb54-4a20-a0dd-d6019608c69b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:21.402059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9d5eb-9504-425f-8a24-fffa7f00fc4c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:21.472390 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:21.502066 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9d5eb-9504-425f-8a24-fffa7f00fc4c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:21.515421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 519/1032] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:39:21 2022] POST /identity/v3/projects => generated 311 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:39:21.516718 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d22e1-6774-45aa-a993-8fd843029386 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:21.516994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d22e1-6774-45aa-a993-8fd843029386 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:21.517250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d22e1-6774-45aa-a993-8fd843029386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:21.538567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cca53-2f50-4a48-a70f-70cf0f0bd655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:21.539255 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cca53-2f50-4a48-a70f-70cf0f0bd655 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:21.539536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cca53-2f50-4a48-a70f-70cf0f0bd655 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:21.539805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cca53-2f50-4a48-a70f-70cf0f0bd655 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:21.544257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e17d22e1-6774-45aa-a993-8fd843029386 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:21.545491 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e17d22e1-6774-45aa-a993-8fd843029386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:21.548159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cca53-2f50-4a48-a70f-70cf0f0bd655 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:21.549638 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cca53-2f50-4a48-a70f-70cf0f0bd655 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-bb0cca53-2f50-4a48-a70f-70cf0f0bd655 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:39:21.564134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:21.565138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:21.566068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:39:21.566068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:39:21.566068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:39:21.566068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:39:21.566068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:39:21.566068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:39:21.566068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:21.566068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:21.566068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 514/1033] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:21.571423 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cca53-2f50-4a48-a70f-70cf0f0bd655 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:21.582263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:21.626312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 520/1034] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:21.682389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cca53-2f50-4a48-a70f-70cf0f0bd655 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:21.718695 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:21.725351 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a463a-0489-4203-a85e-c8efa5259da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:21.726047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a463a-0489-4203-a85e-c8efa5259da3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:21.726304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a463a-0489-4203-a85e-c8efa5259da3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:21.726706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a463a-0489-4203-a85e-c8efa5259da3 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:21.727443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a463a-0489-4203-a85e-c8efa5259da3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:21.727851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a463a-0489-4203-a85e-c8efa5259da3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:21.732061 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a463a-0489-4203-a85e-c8efa5259da3 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:21.747019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 515/1035] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:21.750264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d22e1-6774-45aa-a993-8fd843029386 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:21.853952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d22e1-6774-45aa-a993-8fd843029386 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:21.888075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb014b9-3956-4b62-b673-54505d895a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:21.888729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb014b9-3956-4b62-b673-54505d895a14 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:21.888968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb014b9-3956-4b62-b673-54505d895a14 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:21.889214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb014b9-3956-4b62-b673-54505d895a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:21.889933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb014b9-3956-4b62-b673-54505d895a14 None admin] RBAC: Adding query filter params (role.id=d62272f04f1e4171b328b9b14b8eed03, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=59a1b0b274294a288dbf07cd99f95407) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:21.890238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb014b9-3956-4b62-b673-54505d895a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:21.891688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb014b9-3956-4b62-b673-54505d895a14 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:21.902971 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a463a-0489-4203-a85e-c8efa5259da3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:21.903192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 521/1036] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:39:21 2022] GET /identity/v3/role_assignments?user.id=59a1b0b274294a288dbf07cd99f95407&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=d62272f04f1e4171b328b9b14b8eed03 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:22.014174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a463a-0489-4203-a85e-c8efa5259da3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:22.054624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275ccc9-c379-4523-a6d1-562abfe05bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:22.055298 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ccc9-c379-4523-a6d1-562abfe05bc8 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:22.055578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ccc9-c379-4523-a6d1-562abfe05bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:22.055849 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ccc9-c379-4523-a6d1-562abfe05bc8 None admin] PATH_INFO: `/v3/services/image` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:22.056433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275ccc9-c379-4523-a6d1-562abfe05bc8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:22.057790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275ccc9-c379-4523-a6d1-562abfe05bc8 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-4275ccc9-c379-4523-a6d1-562abfe05bc8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:22.067431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:22.068621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:22.069643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 516/1037] 10.222.0.73 () {56 vars in 1105 bytes} [Mon Aug 29 23:39:21 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:22.077547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb014b9-3956-4b62-b673-54505d895a14 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:22.109327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:22.181090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb014b9-3956-4b62-b673-54505d895a14 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:22.216615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6b044-9f9e-49cb-afd8-cf5a461fd4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:22.217493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6b044-9f9e-49cb-afd8-cf5a461fd4d9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:22.217917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6b044-9f9e-49cb-afd8-cf5a461fd4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:22.218343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6b044-9f9e-49cb-afd8-cf5a461fd4d9 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:22.219154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6b044-9f9e-49cb-afd8-cf5a461fd4d9 None admin] RBAC: Adding query filter params (name=image) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:22.219597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6b044-9f9e-49cb-afd8-cf5a461fd4d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:22.221094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6b044-9f9e-49cb-afd8-cf5a461fd4d9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:22.226098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 522/1038] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:22.232707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275ccc9-c379-4523-a6d1-562abfe05bc8 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:22.291825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:22.337568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275ccc9-c379-4523-a6d1-562abfe05bc8 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:22.372907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c46af-cf35-44fd-9d84-255fc282bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:22.373519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c46af-cf35-44fd-9d84-255fc282bde3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:22.373803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c46af-cf35-44fd-9d84-255fc282bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:22.374080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c46af-cf35-44fd-9d84-255fc282bde3 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:22.374709 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c46af-cf35-44fd-9d84-255fc282bde3 None admin] RBAC: Adding query filter params (type=image) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:22.375042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c46af-cf35-44fd-9d84-255fc282bde3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:22.376400 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c46af-cf35-44fd-9d84-255fc282bde3 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:22.381438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 517/1039] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:22.387256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6b044-9f9e-49cb-afd8-cf5a461fd4d9 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:22.481846 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:22.489234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6b044-9f9e-49cb-afd8-cf5a461fd4d9 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:22.522692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b808ff-849d-4d19-a662-519d507a4e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:22.523329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b808ff-849d-4d19-a662-519d507a4e3f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:22.523641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b808ff-849d-4d19-a662-519d507a4e3f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:22.523919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b808ff-849d-4d19-a662-519d507a4e3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:22.524620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b808ff-849d-4d19-a662-519d507a4e3f None admin] RBAC: Adding query filter params (interface=public, service_id=ed26c2523bc54add8ae19b8004e0d164, region_id=RegionOne) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:22.524928 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b808ff-849d-4d19-a662-519d507a4e3f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:22.526296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b808ff-849d-4d19-a662-519d507a4e3f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:22.534942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 523/1040] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Aug 29 23:39:22 2022] GET /identity/v3/endpoints?service_id=ed26c2523bc54add8ae19b8004e0d164&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:22.538163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c46af-cf35-44fd-9d84-255fc282bde3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:22.643420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c46af-cf35-44fd-9d84-255fc282bde3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:22.666001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:22.680758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512da887-8b4f-4bd9-a5ec-0bafee271c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:22.681400 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512da887-8b4f-4bd9-a5ec-0bafee271c18 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:22.681682 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512da887-8b4f-4bd9-a5ec-0bafee271c18 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:22.681957 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512da887-8b4f-4bd9-a5ec-0bafee271c18 None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:22.682558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512da887-8b4f-4bd9-a5ec-0bafee271c18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:22.684542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512da887-8b4f-4bd9-a5ec-0bafee271c18 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:22.699166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 518/1041] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Aug 29 23:39:22 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:39:23.498266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db3099-f38d-49c3-a22c-e027e4dc0d71 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:23.498817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db3099-f38d-49c3-a22c-e027e4dc0d71 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:23.498817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db3099-f38d-49c3-a22c-e027e4dc0d71 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:23.500235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 524/1042] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:23.505332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f3a9-5818-454e-a98b-9a72930bc394 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:23.505701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f3a9-5818-454e-a98b-9a72930bc394 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:23.505888 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f3a9-5818-454e-a98b-9a72930bc394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:23.524214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-1a81f3a9-5818-454e-a98b-9a72930bc394 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:23.525415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1a81f3a9-5818-454e-a98b-9a72930bc394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:23.594406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 519/1043] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:23.801720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29029ff4-e548-4606-8b1b-c60c191782ff None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:23.802016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29029ff4-e548-4606-8b1b-c60c191782ff None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:23.802193 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29029ff4-e548-4606-8b1b-c60c191782ff None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:23.803693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 525/1044] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:23.808632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ebd9b-9277-425b-b512-7359c6708e0a None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:23.808925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ebd9b-9277-425b-b512-7359c6708e0a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:23.809203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ebd9b-9277-425b-b512-7359c6708e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:23.828435 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4d4ebd9b-9277-425b-b512-7359c6708e0a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:23.829615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4d4ebd9b-9277-425b-b512-7359c6708e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:23.861381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29029ff4-e548-4606-8b1b-c60c191782ff None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:23.902242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 520/1045] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:23.968102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29029ff4-e548-4606-8b1b-c60c191782ff None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:24.002196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586312e-5451-4c5f-aec0-e4148502aaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:24.002826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586312e-5451-4c5f-aec0-e4148502aaf9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:24.003133 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586312e-5451-4c5f-aec0-e4148502aaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:24.003408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586312e-5451-4c5f-aec0-e4148502aaf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:24.004525 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586312e-5451-4c5f-aec0-e4148502aaf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:24.005957 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586312e-5451-4c5f-aec0-e4148502aaf9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:24.007728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 526/1046] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:24.013723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ebd9b-9277-425b-b512-7359c6708e0a None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:24.064318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:24.118442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ebd9b-9277-425b-b512-7359c6708e0a None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:24.154075 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10615120-c5fe-4634-8bac-b0d97aeb083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:24.154687 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10615120-c5fe-4634-8bac-b0d97aeb083e None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:24.155008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10615120-c5fe-4634-8bac-b0d97aeb083e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:24.155285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10615120-c5fe-4634-8bac-b0d97aeb083e None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:24.155940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10615120-c5fe-4634-8bac-b0d97aeb083e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:24.157393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10615120-c5fe-4634-8bac-b0d97aeb083e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:24.171762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586312e-5451-4c5f-aec0-e4148502aaf9 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:24.201120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:24.272470 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586312e-5451-4c5f-aec0-e4148502aaf9 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:24.274939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 521/1047] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:39:24 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:39:24.316519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f0008-b240-4dea-a351-29ad5f617c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:24.317409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f0008-b240-4dea-a351-29ad5f617c33 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:24.317856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f0008-b240-4dea-a351-29ad5f617c33 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:24.318274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f0008-b240-4dea-a351-29ad5f617c33 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:24.331690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f0008-b240-4dea-a351-29ad5f617c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-769f0008-b240-4dea-a351-29ad5f617c33 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:39:24.337504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:24.338745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:24.339955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:24.339955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:24.339955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:24.339955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:24.339955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:39:24.339955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:39:24.339955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:39:24.339955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:39:24.339955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:39:24.339955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:39:24.339955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:39:24.339955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:24.342415 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 527/1048] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Aug 29 23:39:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:24.348647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10615120-c5fe-4634-8bac-b0d97aeb083e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:24.452420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:24.455667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10615120-c5fe-4634-8bac-b0d97aeb083e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:24.491536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfdc7e-85ef-48a1-b350-37e00a86134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:24.492150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfdc7e-85ef-48a1-b350-37e00a86134d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:24.492423 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfdc7e-85ef-48a1-b350-37e00a86134d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:24.492711 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfdc7e-85ef-48a1-b350-37e00a86134d None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:24.493349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfdc7e-85ef-48a1-b350-37e00a86134d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:24.493646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfdc7e-85ef-48a1-b350-37e00a86134d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:24.495059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfdc7e-85ef-48a1-b350-37e00a86134d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:24.503960 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 522/1049] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Aug 29 23:39:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:24.509577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f0008-b240-4dea-a351-29ad5f617c33 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:24.598810 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:24.614558 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f0008-b240-4dea-a351-29ad5f617c33 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:24.618125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705743a-31a0-4bf6-9a27-4cc0bc481fea None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:24.618603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705743a-31a0-4bf6-9a27-4cc0bc481fea None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:24.618800 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705743a-31a0-4bf6-9a27-4cc0bc481fea None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:24.620178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 523/1050] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:24.625845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb551834-05c8-45a0-88ca-00cf79cdd29b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:24.626133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb551834-05c8-45a0-88ca-00cf79cdd29b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:24.626408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb551834-05c8-45a0-88ca-00cf79cdd29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:24.644577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-fb551834-05c8-45a0-88ca-00cf79cdd29b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:24.645900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fb551834-05c8-45a0-88ca-00cf79cdd29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:24.654802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0666e7-fea6-4560-9d92-79ef900cfc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:24.655471 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0666e7-fea6-4560-9d92-79ef900cfc2d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:24.656108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0666e7-fea6-4560-9d92-79ef900cfc2d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:24.656385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0666e7-fea6-4560-9d92-79ef900cfc2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:24.671000 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0666e7-fea6-4560-9d92-79ef900cfc2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:24.673039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0666e7-fea6-4560-9d92-79ef900cfc2d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-3a0666e7-fea6-4560-9d92-79ef900cfc2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:24.691380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:24.692420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:24.693342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:24.693342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:24.693342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:24.693342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 528/1051] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:24.698409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0666e7-fea6-4560-9d92-79ef900cfc2d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:24.723017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 524/1052] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:24.814241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0666e7-fea6-4560-9d92-79ef900cfc2d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:24.847104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e04c6-2844-478a-9f86-4e671aac8613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:24.847705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e04c6-2844-478a-9f86-4e671aac8613 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:24.847983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e04c6-2844-478a-9f86-4e671aac8613 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:24.848250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e04c6-2844-478a-9f86-4e671aac8613 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:24.848931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e04c6-2844-478a-9f86-4e671aac8613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:24.849176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e04c6-2844-478a-9f86-4e671aac8613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:24.850530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e04c6-2844-478a-9f86-4e671aac8613 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:24.858241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:24.863945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 529/1053] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:24.869631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb551834-05c8-45a0-88ca-00cf79cdd29b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:24.962804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:24.973311 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb551834-05c8-45a0-88ca-00cf79cdd29b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:24.992336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e04c6-2844-478a-9f86-4e671aac8613 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:25.009614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf03b08-ee2f-4bbc-900b-29de0c62d710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:25.010261 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf03b08-ee2f-4bbc-900b-29de0c62d710 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.010985 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf03b08-ee2f-4bbc-900b-29de0c62d710 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.011257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf03b08-ee2f-4bbc-900b-29de0c62d710 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.018194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf03b08-ee2f-4bbc-900b-29de0c62d710 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:25.019640 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf03b08-ee2f-4bbc-900b-29de0c62d710 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-6cf03b08-ee2f-4bbc-900b-29de0c62d710 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:39:25.031522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:25.032455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:25.033415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:25.033415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:25.033415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:39:25.033415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:39:25.033415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:39:25.033415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:39:25.033415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:39:25.033415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:39:25.033415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:39:25.033415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:25.033415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 525/1054] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Aug 29 23:39:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:25.038091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf03b08-ee2f-4bbc-900b-29de0c62d710 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:25.111544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e04c6-2844-478a-9f86-4e671aac8613 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:25.139852 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf03b08-ee2f-4bbc-900b-29de0c62d710 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:25.147877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0862-b490-4948-bae3-b8f188e5e9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:25.158737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0862-b490-4948-bae3-b8f188e5e9ba None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.158737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0862-b490-4948-bae3-b8f188e5e9ba None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.158737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0862-b490-4948-bae3-b8f188e5e9ba None admin] PATH_INFO: `/v3/services/image` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.158737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0862-b490-4948-bae3-b8f188e5e9ba None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:25.158737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0862-b490-4948-bae3-b8f188e5e9ba None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-828e0862-b490-4948-bae3-b8f188e5e9ba None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:25.162065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:25.163203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:39:25.164041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:25.164791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 530/1055] 10.222.0.73 () {56 vars in 1105 bytes} [Mon Aug 29 23:39:24 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:25.173440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0862-b490-4948-bae3-b8f188e5e9ba None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:25.179553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cf2a2-cbd2-4762-a40f-9f4757c9f658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:25.180225 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cf2a2-cbd2-4762-a40f-9f4757c9f658 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.180504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cf2a2-cbd2-4762-a40f-9f4757c9f658 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.180772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cf2a2-cbd2-4762-a40f-9f4757c9f658 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.181549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cf2a2-cbd2-4762-a40f-9f4757c9f658 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:25.181856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cf2a2-cbd2-4762-a40f-9f4757c9f658 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:25.183765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cf2a2-cbd2-4762-a40f-9f4757c9f658 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:25.203988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 526/1056] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Aug 29 23:39:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:25.209441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cf2a2-cbd2-4762-a40f-9f4757c9f658 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:25.224024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:25.241819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:25.282784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0862-b490-4948-bae3-b8f188e5e9ba None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:25.322636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a172fc-eee0-4a7c-8530-cb8959b9c580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:25.324352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a172fc-eee0-4a7c-8530-cb8959b9c580 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.325070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a172fc-eee0-4a7c-8530-cb8959b9c580 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.325608 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a172fc-eee0-4a7c-8530-cb8959b9c580 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.325981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a172fc-eee0-4a7c-8530-cb8959b9c580 None admin] RBAC: Adding query filter params (name=image) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:25.326435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a172fc-eee0-4a7c-8530-cb8959b9c580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:25.327830 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a172fc-eee0-4a7c-8530-cb8959b9c580 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:25.328312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cf2a2-cbd2-4762-a40f-9f4757c9f658 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:25.334083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 531/1057] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:25.340145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a172fc-eee0-4a7c-8530-cb8959b9c580 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:25.371696 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3601f-685f-4088-a164-c9a3d3217033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:25.372277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3601f-685f-4088-a164-c9a3d3217033 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.372563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3601f-685f-4088-a164-c9a3d3217033 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.372838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3601f-685f-4088-a164-c9a3d3217033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.383257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3601f-685f-4088-a164-c9a3d3217033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:25.384689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3601f-685f-4088-a164-c9a3d3217033 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-73b3601f-685f-4088-a164-c9a3d3217033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:25.401015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:25.402597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:25.404035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:25.404035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:25.404035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:25.407857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 527/1058] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:25.408484 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3601f-685f-4088-a164-c9a3d3217033 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:25.450594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a172fc-eee0-4a7c-8530-cb8959b9c580 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:25.476905 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:25.477573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:25.486190 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f973066-82e5-4b2c-9d0e-e931045777f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:25.486816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f973066-82e5-4b2c-9d0e-e931045777f1 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.487127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f973066-82e5-4b2c-9d0e-e931045777f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.487395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f973066-82e5-4b2c-9d0e-e931045777f1 None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.488022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f973066-82e5-4b2c-9d0e-e931045777f1 None admin] RBAC: Adding query filter params (type=image) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:25.488317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f973066-82e5-4b2c-9d0e-e931045777f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:25.489667 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f973066-82e5-4b2c-9d0e-e931045777f1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:25.494608 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 532/1059] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:25.499953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f973066-82e5-4b2c-9d0e-e931045777f1 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:25.519225 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3601f-685f-4088-a164-c9a3d3217033 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:25.561599 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c2fbe-2c1a-428e-bd05-cbeebdf5f807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:25.562360 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c2fbe-2c1a-428e-bd05-cbeebdf5f807 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.562637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c2fbe-2c1a-428e-bd05-cbeebdf5f807 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.563249 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c2fbe-2c1a-428e-bd05-cbeebdf5f807 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.563884 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c2fbe-2c1a-428e-bd05-cbeebdf5f807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:25.564179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c2fbe-2c1a-428e-bd05-cbeebdf5f807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:25.565527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c2fbe-2c1a-428e-bd05-cbeebdf5f807 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:25.578322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 528/1060] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:25.583650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c2fbe-2c1a-428e-bd05-cbeebdf5f807 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:25.606283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f973066-82e5-4b2c-9d0e-e931045777f1 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:25.642499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb36df-bff8-4b1c-a560-0b8a1a8bbb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:25.643084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb36df-bff8-4b1c-a560-0b8a1a8bbb79 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.643340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb36df-bff8-4b1c-a560-0b8a1a8bbb79 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.643603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb36df-bff8-4b1c-a560-0b8a1a8bbb79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.644255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb36df-bff8-4b1c-a560-0b8a1a8bbb79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:25.645606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb36df-bff8-4b1c-a560-0b8a1a8bbb79 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:25.687988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c2fbe-2c1a-428e-bd05-cbeebdf5f807 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:25.710393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:25.721150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0faf76-e99d-4592-9291-bb4c65369bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:25.721774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0faf76-e99d-4592-9291-bb4c65369bae None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.722047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0faf76-e99d-4592-9291-bb4c65369bae None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.722313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0faf76-e99d-4592-9291-bb4c65369bae None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.729124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0faf76-e99d-4592-9291-bb4c65369bae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:25.730606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0faf76-e99d-4592-9291-bb4c65369bae None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-ec0faf76-e99d-4592-9291-bb4c65369bae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:39:25.741987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:25.752755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:25.754219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:39:25.754219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:39:25.754219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:39:25.754219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:39:25.754219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:39:25.754219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:39:25.754219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:25.754219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:25.754219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 529/1061] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:25.754721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 533/1062] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:39:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:39:25.754795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0faf76-e99d-4592-9291-bb4c65369bae None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:25.861188 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0faf76-e99d-4592-9291-bb4c65369bae None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:25.905221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf6e86-2367-4566-8c0a-ec658b2f8684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:25.906072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf6e86-2367-4566-8c0a-ec658b2f8684 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.906352 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf6e86-2367-4566-8c0a-ec658b2f8684 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.906627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf6e86-2367-4566-8c0a-ec658b2f8684 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.907355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf6e86-2367-4566-8c0a-ec658b2f8684 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:25.907667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf6e86-2367-4566-8c0a-ec658b2f8684 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:25.909076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf6e86-2367-4566-8c0a-ec658b2f8684 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:25.921578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 530/1063] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:25.928027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb36df-bff8-4b1c-a560-0b8a1a8bbb79 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:25.978185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:26.035630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb36df-bff8-4b1c-a560-0b8a1a8bbb79 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:26.072089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ed525-fcf7-49a4-9b70-3010c377b1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:26.072755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ed525-fcf7-49a4-9b70-3010c377b1b9 None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:26.073037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ed525-fcf7-49a4-9b70-3010c377b1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:26.073334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ed525-fcf7-49a4-9b70-3010c377b1b9 None admin] PATH_INFO: `/v3/projects/da13e1cbae664d5a92198052526ee459/users/59a1b0b274294a288dbf07cd99f95407/roles/d62272f04f1e4171b328b9b14b8eed03` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:26.075487 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ed525-fcf7-49a4-9b70-3010c377b1b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=da13e1cbae664d5a92198052526ee459, user_id=59a1b0b274294a288dbf07cd99f95407, role_id=d62272f04f1e4171b328b9b14b8eed03)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:26.076927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ed525-fcf7-49a4-9b70-3010c377b1b9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:26.131321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 534/1064] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:39:25 2022] PUT /identity/v3/projects/da13e1cbae664d5a92198052526ee459/users/59a1b0b274294a288dbf07cd99f95407/roles/d62272f04f1e4171b328b9b14b8eed03 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:39:26.258968 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f191b7-d113-4bdd-802c-f626a29771ac None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:26.259343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f191b7-d113-4bdd-802c-f626a29771ac None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:26.259561 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f191b7-d113-4bdd-802c-f626a29771ac None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:26.264685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 531/1065] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:26.266765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03e85-6a77-4fbf-9998-f9b6cf847851 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:26.267090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03e85-6a77-4fbf-9998-f9b6cf847851 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:26.267372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03e85-6a77-4fbf-9998-f9b6cf847851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:26.288169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-c7b03e85-6a77-4fbf-9998-f9b6cf847851 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:26.289381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c7b03e85-6a77-4fbf-9998-f9b6cf847851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:26.362918 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 535/1066] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:26.624553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f191b7-d113-4bdd-802c-f626a29771ac None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:26.666788 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:26.727481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f191b7-d113-4bdd-802c-f626a29771ac None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:26.769065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b16efc-4cba-4a47-abef-38d7601d8eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:26.770006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16efc-4cba-4a47-abef-38d7601d8eb5 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:26.770346 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16efc-4cba-4a47-abef-38d7601d8eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:26.770615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16efc-4cba-4a47-abef-38d7601d8eb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:26.780756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b16efc-4cba-4a47-abef-38d7601d8eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-a3b16efc-4cba-4a47-abef-38d7601d8eb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:39:26.785489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:26.786429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:26.787306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 532/1067] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:39:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:26.796136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b03e85-6a77-4fbf-9998-f9b6cf847851 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:26.832055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:26.899560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b03e85-6a77-4fbf-9998-f9b6cf847851 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:26.933374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0f9c-f459-47bc-97ea-698bc71960a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:26.933969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0f9c-f459-47bc-97ea-698bc71960a5 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:26.934244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0f9c-f459-47bc-97ea-698bc71960a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:26.934511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0f9c-f459-47bc-97ea-698bc71960a5 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:26.935184 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b0f9c-f459-47bc-97ea-698bc71960a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:26.935483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b0f9c-f459-47bc-97ea-698bc71960a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:26.936831 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b0f9c-f459-47bc-97ea-698bc71960a5 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:26.949581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 536/1068] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:39:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:26.951180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b16efc-4cba-4a47-abef-38d7601d8eb5 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:27.048081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:27.052361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b16efc-4cba-4a47-abef-38d7601d8eb5 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:27.086578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb314e3e-af7c-4089-8ff1-b947d6976b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:27.087247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb314e3e-af7c-4089-8ff1-b947d6976b0d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:27.087526 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb314e3e-af7c-4089-8ff1-b947d6976b0d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:27.087796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb314e3e-af7c-4089-8ff1-b947d6976b0d None admin] PATH_INFO: `/v3/users/1c508bc0fd704292829b313d08362464` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:27.101994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb314e3e-af7c-4089-8ff1-b947d6976b0d None admin] RBAC: Authorizing `identity:get_user(user_id=1c508bc0fd704292829b313d08362464)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:27.103701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb314e3e-af7c-4089-8ff1-b947d6976b0d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:27.110528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 533/1069] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:39:26 2022] GET /identity/v3/users/1c508bc0fd704292829b313d08362464 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:27.111915 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0f9c-f459-47bc-97ea-698bc71960a5 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:27.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:27.219976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0f9c-f459-47bc-97ea-698bc71960a5 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:27.254049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf9ead-8ee0-4143-a050-d2243f4af32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:27.254658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf9ead-8ee0-4143-a050-d2243f4af32b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:27.255291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf9ead-8ee0-4143-a050-d2243f4af32b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:27.255593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf9ead-8ee0-4143-a050-d2243f4af32b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:27.323740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf9ead-8ee0-4143-a050-d2243f4af32b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:27.325184 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf9ead-8ee0-4143-a050-d2243f4af32b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:27.422631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:27.427613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 537/1070] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:39:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:39:27.433864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb314e3e-af7c-4089-8ff1-b947d6976b0d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:27.535189 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb314e3e-af7c-4089-8ff1-b947d6976b0d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:27.569380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c17fc3-b817-40bc-ae4d-7cf463f3a54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:27.570008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c17fc3-b817-40bc-ae4d-7cf463f3a54d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:27.570285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c17fc3-b817-40bc-ae4d-7cf463f3a54d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:27.570556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c17fc3-b817-40bc-ae4d-7cf463f3a54d None admin] PATH_INFO: `/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:27.571693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c17fc3-b817-40bc-ae4d-7cf463f3a54d None admin] RBAC: Authorizing `identity:get_project(project_id=6d8124f1961047e5b1e1428b3f2e1cd4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:27.573106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c17fc3-b817-40bc-ae4d-7cf463f3a54d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:27.580338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 534/1071] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:39:27 2022] GET /identity/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:27.581558 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf9ead-8ee0-4143-a050-d2243f4af32b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:27.683216 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf9ead-8ee0-4143-a050-d2243f4af32b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:27.684965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a067f63-855f-4639-a0a1-c34f5b584ab4 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:27.685252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a067f63-855f-4639-a0a1-c34f5b584ab4 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:27.685524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a067f63-855f-4639-a0a1-c34f5b584ab4 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:27.687142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 535/1072] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:27.691563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edab94-e25c-44ae-8cc7-f1874b1574c8 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:27.691918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edab94-e25c-44ae-8cc7-f1874b1574c8 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:27.692265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edab94-e25c-44ae-8cc7-f1874b1574c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:27.711708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-64edab94-e25c-44ae-8cc7-f1874b1574c8 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:27.712910 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-64edab94-e25c-44ae-8cc7-f1874b1574c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:27.723486 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547277eb-cdea-43f6-89cc-f7f62c58532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:27.724099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547277eb-cdea-43f6-89cc-f7f62c58532e None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:27.724375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547277eb-cdea-43f6-89cc-f7f62c58532e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:27.724646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547277eb-cdea-43f6-89cc-f7f62c58532e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:27.725433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547277eb-cdea-43f6-89cc-f7f62c58532e None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=6d8124f1961047e5b1e1428b3f2e1cd4, user.id=1c508bc0fd704292829b313d08362464) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:27.725675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547277eb-cdea-43f6-89cc-f7f62c58532e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:27.727123 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547277eb-cdea-43f6-89cc-f7f62c58532e None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:27.738930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 538/1073] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:39:27 2022] GET /identity/v3/role_assignments?user.id=1c508bc0fd704292829b313d08362464&scope.project.id=6d8124f1961047e5b1e1428b3f2e1cd4&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:27.739934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:27.797782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 536/1074] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:28.041532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9a5de-1a69-4e16-addc-7ad2d77a3bd9 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:28.042044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9a5de-1a69-4e16-addc-7ad2d77a3bd9 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:28.042122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9a5de-1a69-4e16-addc-7ad2d77a3bd9 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:28.043531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 539/1075] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:28.048718 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0731be-b42a-4e8d-b861-e0979f060e89 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:28.048947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0731be-b42a-4e8d-b861-e0979f060e89 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:28.049219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0731be-b42a-4e8d-b861-e0979f060e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:28.063498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9a5de-1a69-4e16-addc-7ad2d77a3bd9 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:28.068040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4c0731be-b42a-4e8d-b861-e0979f060e89 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:28.069417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4c0731be-b42a-4e8d-b861-e0979f060e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:28.129085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:28.142911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 537/1076] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:28.173431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9a5de-1a69-4e16-addc-7ad2d77a3bd9 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:28.248287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3c2bc-5c3c-4939-956e-26c4f17d0476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:28.248884 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3c2bc-5c3c-4939-956e-26c4f17d0476 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:28.249158 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3c2bc-5c3c-4939-956e-26c4f17d0476 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:28.249427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3c2bc-5c3c-4939-956e-26c4f17d0476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:28.315894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3c2bc-5c3c-4939-956e-26c4f17d0476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:28.317254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3c2bc-5c3c-4939-956e-26c4f17d0476 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:28.375910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:28.412132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0731be-b42a-4e8d-b861-e0979f060e89 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:28.418910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 540/1077] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:39:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:39:28.421501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3c2bc-5c3c-4939-956e-26c4f17d0476 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:28.497402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:28.513948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0731be-b42a-4e8d-b861-e0979f060e89 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:28.519707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3c2bc-5c3c-4939-956e-26c4f17d0476 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:28.549599 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d57735-e943-468f-beca-bd21e57ed9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:28.550236 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d57735-e943-468f-beca-bd21e57ed9f3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:28.550515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d57735-e943-468f-beca-bd21e57ed9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:28.550791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d57735-e943-468f-beca-bd21e57ed9f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:28.555472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61b315-0128-4078-98f8-6c736a4a6113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:28.556089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61b315-0128-4078-98f8-6c736a4a6113 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:28.556365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61b315-0128-4078-98f8-6c736a4a6113 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:28.556632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61b315-0128-4078-98f8-6c736a4a6113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:28.561260 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d57735-e943-468f-beca-bd21e57ed9f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-96d57735-e943-468f-beca-bd21e57ed9f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:39:28.566110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:28.567178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:28.568051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:28.568051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:28.568051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:28.568051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:28.568051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:39:28.568051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:39:28.568051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:39:28.568051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:39:28.568051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:39:28.568051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:39:28.568051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:39:28.568051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:28.570165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61b315-0128-4078-98f8-6c736a4a6113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:28.571627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61b315-0128-4078-98f8-6c736a4a6113 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:28.572608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 538/1078] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Aug 29 23:39:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:28.574318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d57735-e943-468f-beca-bd21e57ed9f3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-af61b315-0128-4078-98f8-6c736a4a6113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:28.587311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:28.588269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:28.589835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:28.589835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:28.589835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:28.589835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 541/1079] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:28.594750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61b315-0128-4078-98f8-6c736a4a6113 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:28.610506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:28.687686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d57735-e943-468f-beca-bd21e57ed9f3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:28.702011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61b315-0128-4078-98f8-6c736a4a6113 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:28.725089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1225ed8-0648-4d73-bd45-5482db66d765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:28.725996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1225ed8-0648-4d73-bd45-5482db66d765 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:28.726482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1225ed8-0648-4d73-bd45-5482db66d765 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:28.726758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1225ed8-0648-4d73-bd45-5482db66d765 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:28.727460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1225ed8-0648-4d73-bd45-5482db66d765 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:28.727766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1225ed8-0648-4d73-bd45-5482db66d765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:28.729860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1225ed8-0648-4d73-bd45-5482db66d765 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:28.744392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 539/1080] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Aug 29 23:39:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:28.744392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1225ed8-0648-4d73-bd45-5482db66d765 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:28.746745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9936e-8408-4c30-af07-8f68c8bf3666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:28.747411 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9936e-8408-4c30-af07-8f68c8bf3666 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:28.747687 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9936e-8408-4c30-af07-8f68c8bf3666 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:28.748150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9936e-8408-4c30-af07-8f68c8bf3666 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:28.749643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9936e-8408-4c30-af07-8f68c8bf3666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:28.749961 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9936e-8408-4c30-af07-8f68c8bf3666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:28.751422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9936e-8408-4c30-af07-8f68c8bf3666 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:28.754357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:28.765832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 542/1081] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:28.856472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1225ed8-0648-4d73-bd45-5482db66d765 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:28.892024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcc5d0-520d-4653-a8ef-6905f67929d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:28.892677 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcc5d0-520d-4653-a8ef-6905f67929d9 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:28.892956 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcc5d0-520d-4653-a8ef-6905f67929d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:28.893230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcc5d0-520d-4653-a8ef-6905f67929d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:28.905190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcc5d0-520d-4653-a8ef-6905f67929d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:28.906620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcc5d0-520d-4653-a8ef-6905f67929d9 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-05fcc5d0-520d-4653-a8ef-6905f67929d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:28.921794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:28.923096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:28.924198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:28.924198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:28.924198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:28.925586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 540/1082] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:28.931713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9936e-8408-4c30-af07-8f68c8bf3666 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:29.015000 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:29.040263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9936e-8408-4c30-af07-8f68c8bf3666 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:29.075778 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ad31-e842-4bfb-b225-6ea7dba9789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:29.076423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ad31-e842-4bfb-b225-6ea7dba9789d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:29.076644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ad31-e842-4bfb-b225-6ea7dba9789d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:29.076910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ad31-e842-4bfb-b225-6ea7dba9789d None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:29.077541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ad31-e842-4bfb-b225-6ea7dba9789d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:29.077837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ad31-e842-4bfb-b225-6ea7dba9789d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:29.079246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ad31-e842-4bfb-b225-6ea7dba9789d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:29.090873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 543/1083] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:29.096623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcc5d0-520d-4653-a8ef-6905f67929d9 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:29.154632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:29.195168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcc5d0-520d-4653-a8ef-6905f67929d9 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:29.228614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2d4c6-dc60-4275-8faa-a795db142088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:29.229239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2d4c6-dc60-4275-8faa-a795db142088 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:29.230044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2d4c6-dc60-4275-8faa-a795db142088 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:29.230310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2d4c6-dc60-4275-8faa-a795db142088 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:29.238264 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2d4c6-dc60-4275-8faa-a795db142088 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:29.239715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2d4c6-dc60-4275-8faa-a795db142088 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-bea2d4c6-dc60-4275-8faa-a795db142088 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:39:29.251122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:29.252136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:29.253086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:29.253086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:29.253086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:39:29.253086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:39:29.253086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:39:29.253086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:39:29.253086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:39:29.253086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:39:29.253086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:39:29.253086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:29.253086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 541/1084] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Aug 29 23:39:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:29.257858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ad31-e842-4bfb-b225-6ea7dba9789d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:29.355094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ad31-e842-4bfb-b225-6ea7dba9789d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:29.387832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1429f5-d480-4e64-b25f-e7534407d65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:29.388427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1429f5-d480-4e64-b25f-e7534407d65d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:29.388701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1429f5-d480-4e64-b25f-e7534407d65d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:29.388970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1429f5-d480-4e64-b25f-e7534407d65d None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:29.389677 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1429f5-d480-4e64-b25f-e7534407d65d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:29.389977 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1429f5-d480-4e64-b25f-e7534407d65d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:29.391430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1429f5-d480-4e64-b25f-e7534407d65d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:29.393025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:29.408638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 544/1085] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Aug 29 23:39:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:29.414283 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2d4c6-dc60-4275-8faa-a795db142088 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:29.511014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2d4c6-dc60-4275-8faa-a795db142088 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:29.527763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:29.544341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee4731-8f2f-474a-ac14-dc10a04b3d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:29.544927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4731-8f2f-474a-ac14-dc10a04b3d17 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:29.545201 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4731-8f2f-474a-ac14-dc10a04b3d17 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:29.545467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4731-8f2f-474a-ac14-dc10a04b3d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:29.611009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee4731-8f2f-474a-ac14-dc10a04b3d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:29.612450 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee4731-8f2f-474a-ac14-dc10a04b3d17 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:29.644109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef72e7-17a1-4952-80c5-61542257d2f4 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:29.644426 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef72e7-17a1-4952-80c5-61542257d2f4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:29.644702 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef72e7-17a1-4952-80c5-61542257d2f4 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:29.646083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 545/1086] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:39:29.651005 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e7e0e-a4b6-49fd-9357-a930bcd258ff None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:29.651290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e7e0e-a4b6-49fd-9357-a930bcd258ff None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:29.651561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e7e0e-a4b6-49fd-9357-a930bcd258ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:29.669204 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-435e7e0e-a4b6-49fd-9357-a930bcd258ff None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:29.670330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-435e7e0e-a4b6-49fd-9357-a930bcd258ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:29.709591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 542/1087] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:39:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:39:29.715279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee4731-8f2f-474a-ac14-dc10a04b3d17 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:29.735851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:29.746623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 546/1088] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:39:29.812166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee4731-8f2f-474a-ac14-dc10a04b3d17 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:29.846398 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df240d0-a4aa-49d3-bd72-cdb28e930a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:29.847268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df240d0-a4aa-49d3-bd72-cdb28e930a47 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:29.847683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df240d0-a4aa-49d3-bd72-cdb28e930a47 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:29.848058 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df240d0-a4aa-49d3-bd72-cdb28e930a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:29.859112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df240d0-a4aa-49d3-bd72-cdb28e930a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:29.860531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df240d0-a4aa-49d3-bd72-cdb28e930a47 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-6df240d0-a4aa-49d3-bd72-cdb28e930a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:39:29.874610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:29.875690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:39:29.876554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:39:29.876554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:39:29.876554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:29.879058 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 543/1089] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:29.881311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e7e0e-a4b6-49fd-9357-a930bcd258ff None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:29.979189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e7e0e-a4b6-49fd-9357-a930bcd258ff None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:30.000981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:30.012646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cf2a9-82e6-48b4-9fa1-a2ea901db1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:30.013515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cf2a9-82e6-48b4-9fa1-a2ea901db1ed None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:30.013515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cf2a9-82e6-48b4-9fa1-a2ea901db1ed None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:30.013788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cf2a9-82e6-48b4-9fa1-a2ea901db1ed None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:30.014495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cf2a9-82e6-48b4-9fa1-a2ea901db1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:30.014750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cf2a9-82e6-48b4-9fa1-a2ea901db1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:30.015656 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df240d0-a4aa-49d3-bd72-cdb28e930a47 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:30.016492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cf2a9-82e6-48b4-9fa1-a2ea901db1ed None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:30.030110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 547/1090] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:30.035346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cf2a9-82e6-48b4-9fa1-a2ea901db1ed None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:30.088444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:30.119020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df240d0-a4aa-49d3-bd72-cdb28e930a47 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:30.134085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cf2a9-82e6-48b4-9fa1-a2ea901db1ed None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:30.154187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c1287-c331-45c3-8c98-4a24b1419414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:30.154814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c1287-c331-45c3-8c98-4a24b1419414 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:30.155123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c1287-c331-45c3-8c98-4a24b1419414 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:30.155395 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c1287-c331-45c3-8c98-4a24b1419414 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:30.165658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c1287-c331-45c3-8c98-4a24b1419414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:39:30.168331 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7836ed-a685-42fc-9a41-a3405d105953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:30.169062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7836ed-a685-42fc-9a41-a3405d105953 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:30.169340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7836ed-a685-42fc-9a41-a3405d105953 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:30.169611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7836ed-a685-42fc-9a41-a3405d105953 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-4e0c1287-c331-45c3-8c98-4a24b1419414 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:39:30.170897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:30.171824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:30.172651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 544/1091] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:30.178208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c1287-c331-45c3-8c98-4a24b1419414 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:30.179918 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7836ed-a685-42fc-9a41-a3405d105953 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:30.181358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7836ed-a685-42fc-9a41-a3405d105953 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-8e7836ed-a685-42fc-9a41-a3405d105953 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:39:30.193048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:30.194102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:30.199913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:39:30.199913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:39:30.199913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:39:30.199913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:39:30.199913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:39:30.199913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:39:30.199913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:39:30.199913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:39:30.199913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 548/1092] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:39:30.200425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7836ed-a685-42fc-9a41-a3405d105953 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:30.244145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:30.294176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c1287-c331-45c3-8c98-4a24b1419414 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:30.299428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7836ed-a685-42fc-9a41-a3405d105953 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:30.321174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:30.327412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695427c-ef1d-47cb-b43e-2d96fa37c0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:30.328013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695427c-ef1d-47cb-b43e-2d96fa37c0aa None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:30.328288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695427c-ef1d-47cb-b43e-2d96fa37c0aa None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:30.340515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695427c-ef1d-47cb-b43e-2d96fa37c0aa None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:30.340515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695427c-ef1d-47cb-b43e-2d96fa37c0aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:30.340515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695427c-ef1d-47cb-b43e-2d96fa37c0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:30.340515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695427c-ef1d-47cb-b43e-2d96fa37c0aa None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:30.340834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c737e-ecf5-41b6-915e-2ac72a3f9861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:30.340834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c737e-ecf5-41b6-915e-2ac72a3f9861 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:30.340834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c737e-ecf5-41b6-915e-2ac72a3f9861 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:30.340834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c737e-ecf5-41b6-915e-2ac72a3f9861 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:30.341128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c737e-ecf5-41b6-915e-2ac72a3f9861 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:30.341128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c737e-ecf5-41b6-915e-2ac72a3f9861 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:30.341128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c737e-ecf5-41b6-915e-2ac72a3f9861 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:30.341329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 545/1093] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:39:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:30.345309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695427c-ef1d-47cb-b43e-2d96fa37c0aa None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:30.349153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 549/1094] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:30.356022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c737e-ecf5-41b6-915e-2ac72a3f9861 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:30.444563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695427c-ef1d-47cb-b43e-2d96fa37c0aa None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:30.451952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c737e-ecf5-41b6-915e-2ac72a3f9861 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:30.453463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:30.478696 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252136ed-b644-4bd9-8f47-47905a2374bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:30.479371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252136ed-b644-4bd9-8f47-47905a2374bb None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:30.483594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252136ed-b644-4bd9-8f47-47905a2374bb None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:30.483594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252136ed-b644-4bd9-8f47-47905a2374bb None admin] PATH_INFO: `/v3/users/1c508bc0fd704292829b313d08362464` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:30.483594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252136ed-b644-4bd9-8f47-47905a2374bb None admin] RBAC: Authorizing `identity:get_user(user_id=1c508bc0fd704292829b313d08362464)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:30.483594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252136ed-b644-4bd9-8f47-47905a2374bb None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:30.484142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 546/1095] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:39:30 2022] GET /identity/v3/users/1c508bc0fd704292829b313d08362464 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:30.485218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b14a6e-8e5e-4c69-a53b-47bffaacd363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:30.485877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b14a6e-8e5e-4c69-a53b-47bffaacd363 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:30.486219 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b14a6e-8e5e-4c69-a53b-47bffaacd363 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:30.486567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b14a6e-8e5e-4c69-a53b-47bffaacd363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:30.487386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b14a6e-8e5e-4c69-a53b-47bffaacd363 None admin] RBAC: Adding query filter params (role.id=d62272f04f1e4171b328b9b14b8eed03, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=59a1b0b274294a288dbf07cd99f95407) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:30.487757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b14a6e-8e5e-4c69-a53b-47bffaacd363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:30.489222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b14a6e-8e5e-4c69-a53b-47bffaacd363 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:30.489812 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252136ed-b644-4bd9-8f47-47905a2374bb None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:30.506776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 550/1096] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:39:30 2022] GET /identity/v3/role_assignments?user.id=59a1b0b274294a288dbf07cd99f95407&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=d62272f04f1e4171b328b9b14b8eed03 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:30.563094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:30.605612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252136ed-b644-4bd9-8f47-47905a2374bb None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:30.642252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1f2db-d65a-4d22-9d0a-068c56d8351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:30.642970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1f2db-d65a-4d22-9d0a-068c56d8351d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:30.643192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1f2db-d65a-4d22-9d0a-068c56d8351d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:30.643463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1f2db-d65a-4d22-9d0a-068c56d8351d None admin] PATH_INFO: `/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:30.644581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1f2db-d65a-4d22-9d0a-068c56d8351d None admin] RBAC: Authorizing `identity:get_project(project_id=6d8124f1961047e5b1e1428b3f2e1cd4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:30.645993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1f2db-d65a-4d22-9d0a-068c56d8351d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:30.647688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 547/1097] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:39:30 2022] GET /identity/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:30.653987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b14a6e-8e5e-4c69-a53b-47bffaacd363 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:30.759939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b14a6e-8e5e-4c69-a53b-47bffaacd363 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:30.796854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53317507-e951-4580-a117-ee8316c6bff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:30.797513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53317507-e951-4580-a117-ee8316c6bff5 None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:30.797792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53317507-e951-4580-a117-ee8316c6bff5 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:30.798064 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53317507-e951-4580-a117-ee8316c6bff5 None admin] PATH_INFO: `/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4/users/1c508bc0fd704292829b313d08362464/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:30.800024 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53317507-e951-4580-a117-ee8316c6bff5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d8124f1961047e5b1e1428b3f2e1cd4, user_id=1c508bc0fd704292829b313d08362464, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:30.801448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53317507-e951-4580-a117-ee8316c6bff5 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:30.905304 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 551/1098] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:39:30 2022] PUT /identity/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4/users/1c508bc0fd704292829b313d08362464/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:39:32.784184 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11abb8-ba6d-4b0e-b39e-19b9d5d2da73 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:32.784652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11abb8-ba6d-4b0e-b39e-19b9d5d2da73 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:32.784765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11abb8-ba6d-4b0e-b39e-19b9d5d2da73 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:32.786063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 548/1099] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:32.791265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37f0ff-c6e1-464f-975c-c1f1dbd18076 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:32.791688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37f0ff-c6e1-464f-975c-c1f1dbd18076 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:32.791907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37f0ff-c6e1-464f-975c-c1f1dbd18076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:32.810896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-2d37f0ff-c6e1-464f-975c-c1f1dbd18076 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:32.812097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2d37f0ff-c6e1-464f-975c-c1f1dbd18076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:32.832166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:32.877177 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 552/1100] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:33.142092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11abb8-ba6d-4b0e-b39e-19b9d5d2da73 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:33.243978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11abb8-ba6d-4b0e-b39e-19b9d5d2da73 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:33.270170 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:33.277628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dc970-88d5-4dab-bcff-19c904ce121c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:33.278246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dc970-88d5-4dab-bcff-19c904ce121c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:33.278524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dc970-88d5-4dab-bcff-19c904ce121c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:33.278793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dc970-88d5-4dab-bcff-19c904ce121c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:33.288451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dc970-88d5-4dab-bcff-19c904ce121c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-c57dc970-88d5-4dab-bcff-19c904ce121c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:39:33.293256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:33.294359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:33.295765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 549/1101] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:33.300324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37f0ff-c6e1-464f-975c-c1f1dbd18076 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:33.397179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37f0ff-c6e1-464f-975c-c1f1dbd18076 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:33.430542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730803a5-0dda-4d57-ab02-e53fcf3f22b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:33.431155 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730803a5-0dda-4d57-ab02-e53fcf3f22b5 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:33.431429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730803a5-0dda-4d57-ab02-e53fcf3f22b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:33.431696 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730803a5-0dda-4d57-ab02-e53fcf3f22b5 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:33.432343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730803a5-0dda-4d57-ab02-e53fcf3f22b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:33.432639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730803a5-0dda-4d57-ab02-e53fcf3f22b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:33.433985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730803a5-0dda-4d57-ab02-e53fcf3f22b5 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:33.441686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 553/1102] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:33.447422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dc970-88d5-4dab-bcff-19c904ce121c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:33.554258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dc970-88d5-4dab-bcff-19c904ce121c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:33.586853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aee23-a99f-4a59-8028-b5b74f2e13fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:33.587496 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aee23-a99f-4a59-8028-b5b74f2e13fb None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:33.587776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aee23-a99f-4a59-8028-b5b74f2e13fb None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:33.588048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aee23-a99f-4a59-8028-b5b74f2e13fb None admin] PATH_INFO: `/v3/users/1c508bc0fd704292829b313d08362464` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:33.589769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6aee23-a99f-4a59-8028-b5b74f2e13fb None admin] RBAC: Authorizing `identity:get_user(user_id=1c508bc0fd704292829b313d08362464)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:33.591195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6aee23-a99f-4a59-8028-b5b74f2e13fb None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:33.592755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 550/1103] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:39:33 2022] GET /identity/v3/users/1c508bc0fd704292829b313d08362464 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:33.598716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730803a5-0dda-4d57-ab02-e53fcf3f22b5 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:33.618001 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:33.696712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730803a5-0dda-4d57-ab02-e53fcf3f22b5 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:33.730132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f534dd-c4b9-47ae-9778-7a18133d096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:33.730756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f534dd-c4b9-47ae-9778-7a18133d096a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:33.731069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f534dd-c4b9-47ae-9778-7a18133d096a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:33.731346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f534dd-c4b9-47ae-9778-7a18133d096a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:33.797061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f534dd-c4b9-47ae-9778-7a18133d096a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:33.798488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f534dd-c4b9-47ae-9778-7a18133d096a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:33.815639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:33.894229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 554/1104] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:39:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:39:33.900158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aee23-a99f-4a59-8028-b5b74f2e13fb None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:33.956543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:33.998235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aee23-a99f-4a59-8028-b5b74f2e13fb None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:34.030357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f018f-261b-4761-b58e-2ff504bc6739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:34.031002 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f018f-261b-4761-b58e-2ff504bc6739 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:34.031278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f018f-261b-4761-b58e-2ff504bc6739 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:34.031858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f018f-261b-4761-b58e-2ff504bc6739 None admin] PATH_INFO: `/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:34.034806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f018f-261b-4761-b58e-2ff504bc6739 None admin] RBAC: Authorizing `identity:get_project(project_id=6d8124f1961047e5b1e1428b3f2e1cd4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:34.036245 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f018f-261b-4761-b58e-2ff504bc6739 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:34.037839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 551/1105] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:39:33 2022] GET /identity/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:34.043817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f534dd-c4b9-47ae-9778-7a18133d096a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:34.139251 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f534dd-c4b9-47ae-9778-7a18133d096a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:34.156828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:34.173842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30260-cde8-4696-a085-4fb797fcec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:34.174433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30260-cde8-4696-a085-4fb797fcec8c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:34.174708 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30260-cde8-4696-a085-4fb797fcec8c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:34.175009 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30260-cde8-4696-a085-4fb797fcec8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:34.175723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f30260-cde8-4696-a085-4fb797fcec8c None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=6d8124f1961047e5b1e1428b3f2e1cd4, user.id=1c508bc0fd704292829b313d08362464) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:34.176030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f30260-cde8-4696-a085-4fb797fcec8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:34.177441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f30260-cde8-4696-a085-4fb797fcec8c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:34.183021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 555/1106] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:39:34 2022] GET /identity/v3/role_assignments?user.id=1c508bc0fd704292829b313d08362464&scope.project.id=6d8124f1961047e5b1e1428b3f2e1cd4&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:36.086736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e63c30-dd81-4ef8-9891-ccc207029585 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:36.087289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e63c30-dd81-4ef8-9891-ccc207029585 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:36.087289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e63c30-dd81-4ef8-9891-ccc207029585 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:36.089212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 552/1107] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:36.094295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30edb00-1b1b-49a5-a9df-126f3476e8e7 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:36.094712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30edb00-1b1b-49a5-a9df-126f3476e8e7 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:36.094846 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30edb00-1b1b-49a5-a9df-126f3476e8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:36.113084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-f30edb00-1b1b-49a5-a9df-126f3476e8e7 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:36.114274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f30edb00-1b1b-49a5-a9df-126f3476e8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:36.180659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 556/1108] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:36.451643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e63c30-dd81-4ef8-9891-ccc207029585 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:36.550276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e63c30-dd81-4ef8-9891-ccc207029585 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:36.573684 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:36.583970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976435ee-5d0b-48d6-8c79-49607182570c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:36.584633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976435ee-5d0b-48d6-8c79-49607182570c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:36.584941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976435ee-5d0b-48d6-8c79-49607182570c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:36.585213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976435ee-5d0b-48d6-8c79-49607182570c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:36.586362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976435ee-5d0b-48d6-8c79-49607182570c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:36.592149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976435ee-5d0b-48d6-8c79-49607182570c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:36.592149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 553/1109] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:36.595242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30edb00-1b1b-49a5-a9df-126f3476e8e7 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:36.690115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30edb00-1b1b-49a5-a9df-126f3476e8e7 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:36.702598 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:36.722030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0f5ff-2818-4c90-8819-3c961809e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:36.722621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0f5ff-2818-4c90-8819-3c961809e4b8 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:36.722918 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0f5ff-2818-4c90-8819-3c961809e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:36.723191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0f5ff-2818-4c90-8819-3c961809e4b8 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:36.723818 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0f5ff-2818-4c90-8819-3c961809e4b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:36.725231 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0f5ff-2818-4c90-8819-3c961809e4b8 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:36.827567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 557/1110] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:39:36 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:39:38.774160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e49e-d0a3-4a64-93d2-e9069e0f3abe None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:38.774638 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e49e-d0a3-4a64-93d2-e9069e0f3abe None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:38.774732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e49e-d0a3-4a64-93d2-e9069e0f3abe None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:38.776585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 554/1111] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:38.781641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8adfc3-e2a3-4bbd-9685-9c2ed8cc9608 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:38.782025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8adfc3-e2a3-4bbd-9685-9c2ed8cc9608 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:38.782189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8adfc3-e2a3-4bbd-9685-9c2ed8cc9608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:38.800635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-6d8adfc3-e2a3-4bbd-9685-9c2ed8cc9608 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:38.801829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6d8adfc3-e2a3-4bbd-9685-9c2ed8cc9608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:38.867058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 558/1112] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:39.142813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169e49e-d0a3-4a64-93d2-e9069e0f3abe None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:39.241653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169e49e-d0a3-4a64-93d2-e9069e0f3abe None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:39.273639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34a92a-69b7-4f6a-a7bb-c59c21786f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:39.274250 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a92a-69b7-4f6a-a7bb-c59c21786f58 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:39.274528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a92a-69b7-4f6a-a7bb-c59c21786f58 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:39.274798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a92a-69b7-4f6a-a7bb-c59c21786f58 None admin] PATH_INFO: `/v3/roles/06cbbfa32c9549ffa2d1fd68736820a1` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:39.276733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34a92a-69b7-4f6a-a7bb-c59c21786f58 None admin] RBAC: Authorizing `identity:get_role(role_id=06cbbfa32c9549ffa2d1fd68736820a1)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:39.278070 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34a92a-69b7-4f6a-a7bb-c59c21786f58 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:39.279408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 555/1113] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:39:39 2022] GET /identity/v3/roles/06cbbfa32c9549ffa2d1fd68736820a1 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:39.285485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8adfc3-e2a3-4bbd-9685-9c2ed8cc9608 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:39.383544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:39.387242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8adfc3-e2a3-4bbd-9685-9c2ed8cc9608 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:39.422025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752698b-86ef-4052-ad4a-a2785ff8c566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:39.422592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752698b-86ef-4052-ad4a-a2785ff8c566 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:39.422894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752698b-86ef-4052-ad4a-a2785ff8c566 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:39.423186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752698b-86ef-4052-ad4a-a2785ff8c566 None admin] PATH_INFO: `/v3/users/ebc0ac0a26b94a8d832c65431cf40351` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:39.436349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752698b-86ef-4052-ad4a-a2785ff8c566 None admin] RBAC: Authorizing `identity:get_user(user_id=ebc0ac0a26b94a8d832c65431cf40351)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:39.437904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752698b-86ef-4052-ad4a-a2785ff8c566 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:39.439849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 559/1114] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:39:39 2022] GET /identity/v3/users/ebc0ac0a26b94a8d832c65431cf40351 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:39.446343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34a92a-69b7-4f6a-a7bb-c59c21786f58 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:39.504912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:39.544919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34a92a-69b7-4f6a-a7bb-c59c21786f58 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:39.577705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594cee7-2e3d-4cb0-989d-5792f73aca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:39.578299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594cee7-2e3d-4cb0-989d-5792f73aca6a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:39.578577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594cee7-2e3d-4cb0-989d-5792f73aca6a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:39.578851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594cee7-2e3d-4cb0-989d-5792f73aca6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:39.644086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594cee7-2e3d-4cb0-989d-5792f73aca6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:39.645517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594cee7-2e3d-4cb0-989d-5792f73aca6a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:39.703085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:39.743998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 556/1115] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:39:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:39:39.749854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752698b-86ef-4052-ad4a-a2785ff8c566 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:39.847103 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752698b-86ef-4052-ad4a-a2785ff8c566 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:39.879682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64afeb0-1080-4115-9f44-f508d9f47001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:39.880296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64afeb0-1080-4115-9f44-f508d9f47001 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:39.880573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64afeb0-1080-4115-9f44-f508d9f47001 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:39.880845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64afeb0-1080-4115-9f44-f508d9f47001 None admin] PATH_INFO: `/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:39.881948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64afeb0-1080-4115-9f44-f508d9f47001 None admin] RBAC: Authorizing `identity:get_project(project_id=6d8124f1961047e5b1e1428b3f2e1cd4)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:39.883417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64afeb0-1080-4115-9f44-f508d9f47001 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:39.885702 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 560/1116] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:39:39 2022] GET /identity/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:39.891533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594cee7-2e3d-4cb0-989d-5792f73aca6a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:39.995266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594cee7-2e3d-4cb0-989d-5792f73aca6a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:40.025709 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafae19b-5912-4681-a5a8-57da31ac9ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:40.026328 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae19b-5912-4681-a5a8-57da31ac9ecf None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:40.026610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae19b-5912-4681-a5a8-57da31ac9ecf None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:40.026906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae19b-5912-4681-a5a8-57da31ac9ecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:40.027636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafae19b-5912-4681-a5a8-57da31ac9ecf None admin] RBAC: Adding query filter params (role.id=06cbbfa32c9549ffa2d1fd68736820a1, scope.project.id=6d8124f1961047e5b1e1428b3f2e1cd4, user.id=ebc0ac0a26b94a8d832c65431cf40351) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:40.027948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafae19b-5912-4681-a5a8-57da31ac9ecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:40.029359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafae19b-5912-4681-a5a8-57da31ac9ecf None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:40.034765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 557/1117] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:39:39 2022] GET /identity/v3/role_assignments?user.id=ebc0ac0a26b94a8d832c65431cf40351&scope.project.id=6d8124f1961047e5b1e1428b3f2e1cd4&role.id=06cbbfa32c9549ffa2d1fd68736820a1 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:41.922170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b57d62-5e4d-432b-8c6d-3b7b99d25455 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:41.922717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b57d62-5e4d-432b-8c6d-3b7b99d25455 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:41.922717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b57d62-5e4d-432b-8c6d-3b7b99d25455 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:41.924078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 561/1118] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:41.929272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ba6f-858a-49dd-bd36-cd535e08b5ab None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:41.929659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ba6f-858a-49dd-bd36-cd535e08b5ab None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:41.929835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ba6f-858a-49dd-bd36-cd535e08b5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:41.948431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-e5b9ba6f-858a-49dd-bd36-cd535e08b5ab None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:41.949614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e5b9ba6f-858a-49dd-bd36-cd535e08b5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:41.966244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:42.015037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 558/1119] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:42.289499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b57d62-5e4d-432b-8c6d-3b7b99d25455 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:42.314700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:42.388885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b57d62-5e4d-432b-8c6d-3b7b99d25455 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:42.425856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ae5f6-fefe-4f5f-94da-f2d915390187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:42.426548 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ae5f6-fefe-4f5f-94da-f2d915390187 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:42.426856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ae5f6-fefe-4f5f-94da-f2d915390187 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:42.427215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ae5f6-fefe-4f5f-94da-f2d915390187 None admin] PATH_INFO: `/v3/roles/06cbbfa32c9549ffa2d1fd68736820a1` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:42.428906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ae5f6-fefe-4f5f-94da-f2d915390187 None admin] RBAC: Authorizing `identity:get_role(role_id=06cbbfa32c9549ffa2d1fd68736820a1)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:42.430448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ae5f6-fefe-4f5f-94da-f2d915390187 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:42.432187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 562/1120] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:39:42 2022] GET /identity/v3/roles/06cbbfa32c9549ffa2d1fd68736820a1 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:42.438500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9ba6f-858a-49dd-bd36-cd535e08b5ab None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:42.533925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9ba6f-858a-49dd-bd36-cd535e08b5ab None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:42.566602 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b531862-9cf3-483f-853b-9f94c0a13454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:42.567181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b531862-9cf3-483f-853b-9f94c0a13454 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:42.567457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b531862-9cf3-483f-853b-9f94c0a13454 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:42.567724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b531862-9cf3-483f-853b-9f94c0a13454 None admin] PATH_INFO: `/v3/users/ebc0ac0a26b94a8d832c65431cf40351` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:42.568807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b531862-9cf3-483f-853b-9f94c0a13454 None admin] RBAC: Authorizing `identity:get_user(user_id=ebc0ac0a26b94a8d832c65431cf40351)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:42.570221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b531862-9cf3-483f-853b-9f94c0a13454 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:42.571762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 559/1121] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:39:42 2022] GET /identity/v3/users/ebc0ac0a26b94a8d832c65431cf40351 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:39:42.577819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ae5f6-fefe-4f5f-94da-f2d915390187 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:42.665501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:42.673729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ae5f6-fefe-4f5f-94da-f2d915390187 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:42.705541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67514ef6-0429-46c4-85ff-3d5fd60c0ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:42.706139 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67514ef6-0429-46c4-85ff-3d5fd60c0ca6 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:42.706412 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67514ef6-0429-46c4-85ff-3d5fd60c0ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:42.706679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67514ef6-0429-46c4-85ff-3d5fd60c0ca6 None admin] PATH_INFO: `/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:42.707799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67514ef6-0429-46c4-85ff-3d5fd60c0ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=6d8124f1961047e5b1e1428b3f2e1cd4)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:42.709193 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67514ef6-0429-46c4-85ff-3d5fd60c0ca6 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:42.710773 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 563/1122] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:39:42 2022] GET /identity/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:42.717357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b531862-9cf3-483f-853b-9f94c0a13454 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:42.741762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:42.816162 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b531862-9cf3-483f-853b-9f94c0a13454 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:42.849636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e89a6-ace1-4286-b9d4-b0371213cdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:42.850226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e89a6-ace1-4286-b9d4-b0371213cdca None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:42.850509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e89a6-ace1-4286-b9d4-b0371213cdca None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:42.850783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e89a6-ace1-4286-b9d4-b0371213cdca None admin] PATH_INFO: `/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4/users/ebc0ac0a26b94a8d832c65431cf40351/roles/06cbbfa32c9549ffa2d1fd68736820a1` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:42.852930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e89a6-ace1-4286-b9d4-b0371213cdca None admin] RBAC: Authorizing `identity:create_grant(project_id=6d8124f1961047e5b1e1428b3f2e1cd4, user_id=ebc0ac0a26b94a8d832c65431cf40351, role_id=06cbbfa32c9549ffa2d1fd68736820a1)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:42.854635 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e89a6-ace1-4286-b9d4-b0371213cdca None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:42.932666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 560/1123] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:39:42 2022] PUT /identity/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4/users/ebc0ac0a26b94a8d832c65431cf40351/roles/06cbbfa32c9549ffa2d1fd68736820a1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:39:44.777578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94784-3064-409a-b96d-2ae0f7a7a365 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:44.778060 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94784-3064-409a-b96d-2ae0f7a7a365 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:44.778165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94784-3064-409a-b96d-2ae0f7a7a365 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:44.779475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 564/1124] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:44.784660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805b1f4-ab97-4785-83b8-de9bdf159d08 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:44.785082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805b1f4-ab97-4785-83b8-de9bdf159d08 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:44.785218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805b1f4-ab97-4785-83b8-de9bdf159d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:44.803438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4805b1f4-ab97-4785-83b8-de9bdf159d08 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:44.804625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4805b1f4-ab97-4785-83b8-de9bdf159d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:44.869392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 561/1125] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:45.136095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d94784-3064-409a-b96d-2ae0f7a7a365 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:45.235263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d94784-3064-409a-b96d-2ae0f7a7a365 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:45.267018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892944e-b860-488e-bd97-c3ffb3637b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:45.267625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892944e-b860-488e-bd97-c3ffb3637b4e None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:45.267901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892944e-b860-488e-bd97-c3ffb3637b4e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:45.268170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892944e-b860-488e-bd97-c3ffb3637b4e None admin] PATH_INFO: `/v3/roles/06cbbfa32c9549ffa2d1fd68736820a1` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:45.269531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892944e-b860-488e-bd97-c3ffb3637b4e None admin] RBAC: Authorizing `identity:get_role(role_id=06cbbfa32c9549ffa2d1fd68736820a1)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:45.270909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892944e-b860-488e-bd97-c3ffb3637b4e None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:45.272191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 565/1126] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:39:45 2022] GET /identity/v3/roles/06cbbfa32c9549ffa2d1fd68736820a1 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:45.278328 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805b1f4-ab97-4785-83b8-de9bdf159d08 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:45.292759 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:45.375809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805b1f4-ab97-4785-83b8-de9bdf159d08 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:45.408964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30102c-780a-489b-9025-6e3f4affe912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:45.409532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30102c-780a-489b-9025-6e3f4affe912 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:45.409812 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30102c-780a-489b-9025-6e3f4affe912 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:45.410085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30102c-780a-489b-9025-6e3f4affe912 None admin] PATH_INFO: `/v3/users/ebc0ac0a26b94a8d832c65431cf40351` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:45.411220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30102c-780a-489b-9025-6e3f4affe912 None admin] RBAC: Authorizing `identity:get_user(user_id=ebc0ac0a26b94a8d832c65431cf40351)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:45.412683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30102c-780a-489b-9025-6e3f4affe912 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:45.414240 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 562/1127] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:39:45 2022] GET /identity/v3/users/ebc0ac0a26b94a8d832c65431cf40351 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:45.420782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892944e-b860-488e-bd97-c3ffb3637b4e None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:45.448514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:45.520907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892944e-b860-488e-bd97-c3ffb3637b4e None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:45.554399 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5e982-123a-4040-af7f-983194bd32e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:45.555027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5e982-123a-4040-af7f-983194bd32e8 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:45.555307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5e982-123a-4040-af7f-983194bd32e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:45.555579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5e982-123a-4040-af7f-983194bd32e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:45.620312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5e982-123a-4040-af7f-983194bd32e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:45.621729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5e982-123a-4040-af7f-983194bd32e8 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:45.647628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:45.717258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 566/1128] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:39:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:39:45.723268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30102c-780a-489b-9025-6e3f4affe912 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:45.801960 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:45.820107 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30102c-780a-489b-9025-6e3f4affe912 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:45.854704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadc82b-4110-4047-9d5b-2fcf1e46f370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:45.855365 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadc82b-4110-4047-9d5b-2fcf1e46f370 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:45.855645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadc82b-4110-4047-9d5b-2fcf1e46f370 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:45.855915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadc82b-4110-4047-9d5b-2fcf1e46f370 None admin] PATH_INFO: `/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:45.857027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadc82b-4110-4047-9d5b-2fcf1e46f370 None admin] RBAC: Authorizing `identity:get_project(project_id=6d8124f1961047e5b1e1428b3f2e1cd4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:45.858438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadc82b-4110-4047-9d5b-2fcf1e46f370 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:45.860096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 563/1129] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:39:45 2022] GET /identity/v3/projects/6d8124f1961047e5b1e1428b3f2e1cd4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:45.866339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5e982-123a-4040-af7f-983194bd32e8 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:45.964633 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5e982-123a-4040-af7f-983194bd32e8 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:45.990323 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:45.998326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171316e-5403-4b9e-8cfb-00a34171c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:45.998948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171316e-5403-4b9e-8cfb-00a34171c598 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:46.000655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171316e-5403-4b9e-8cfb-00a34171c598 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:46.000655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171316e-5403-4b9e-8cfb-00a34171c598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:46.000655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171316e-5403-4b9e-8cfb-00a34171c598 None admin] RBAC: Adding query filter params (role.id=06cbbfa32c9549ffa2d1fd68736820a1, scope.project.id=6d8124f1961047e5b1e1428b3f2e1cd4, user.id=ebc0ac0a26b94a8d832c65431cf40351) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:46.000655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171316e-5403-4b9e-8cfb-00a34171c598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:46.001907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171316e-5403-4b9e-8cfb-00a34171c598 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:46.007603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 567/1130] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:39:45 2022] GET /identity/v3/role_assignments?user.id=ebc0ac0a26b94a8d832c65431cf40351&scope.project.id=6d8124f1961047e5b1e1428b3f2e1cd4&role.id=06cbbfa32c9549ffa2d1fd68736820a1 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:47.903601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc82ab-79f9-46a8-aedd-af07dad3b904 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:47.904167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc82ab-79f9-46a8-aedd-af07dad3b904 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:47.904167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc82ab-79f9-46a8-aedd-af07dad3b904 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:47.905480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 564/1131] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:47.910534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b18886-9a62-43f8-a2d9-806aaf7f875c None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:47.910992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b18886-9a62-43f8-a2d9-806aaf7f875c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:47.911085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b18886-9a62-43f8-a2d9-806aaf7f875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:47.928677 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-73b18886-9a62-43f8-a2d9-806aaf7f875c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:47.929845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-73b18886-9a62-43f8-a2d9-806aaf7f875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:47.994617 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 568/1132] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:48.262690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc82ab-79f9-46a8-aedd-af07dad3b904 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:48.361295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc82ab-79f9-46a8-aedd-af07dad3b904 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:48.394689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de18bf6-9074-4c44-b0f6-da0666ada72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:48.395329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de18bf6-9074-4c44-b0f6-da0666ada72c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:48.395631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de18bf6-9074-4c44-b0f6-da0666ada72c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:48.395907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de18bf6-9074-4c44-b0f6-da0666ada72c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:48.397011 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de18bf6-9074-4c44-b0f6-da0666ada72c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:48.398419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de18bf6-9074-4c44-b0f6-da0666ada72c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:48.399989 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 565/1133] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:48.405644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b18886-9a62-43f8-a2d9-806aaf7f875c None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:48.502732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b18886-9a62-43f8-a2d9-806aaf7f875c None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:48.525290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:48.536500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cd7f9-d1d1-41b1-9aaf-7ed4e8e331c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:48.537099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cd7f9-d1d1-41b1-9aaf-7ed4e8e331c3 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:48.537397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cd7f9-d1d1-41b1-9aaf-7ed4e8e331c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:48.537670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cd7f9-d1d1-41b1-9aaf-7ed4e8e331c3 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:48.538305 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cd7f9-d1d1-41b1-9aaf-7ed4e8e331c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:48.539786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cd7f9-d1d1-41b1-9aaf-7ed4e8e331c3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:48.642183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 569/1134] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:39:48 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:39:50.568778 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641bf6-7c6e-47e1-9cd1-a92678650ed5 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:50.569339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641bf6-7c6e-47e1-9cd1-a92678650ed5 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:50.569339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641bf6-7c6e-47e1-9cd1-a92678650ed5 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:50.570728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 566/1135] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:50.576485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6718c-5d61-4ab6-b6e4-39e88f758141 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:50.576865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6718c-5d61-4ab6-b6e4-39e88f758141 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:50.577026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6718c-5d61-4ab6-b6e4-39e88f758141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:50.594521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-59c6718c-5d61-4ab6-b6e4-39e88f758141 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:50.595713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-59c6718c-5d61-4ab6-b6e4-39e88f758141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:50.659654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 570/1136] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:50.929054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49641bf6-7c6e-47e1-9cd1-a92678650ed5 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:50.947510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:51.029018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49641bf6-7c6e-47e1-9cd1-a92678650ed5 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:51.063259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadf1ec-fe03-4b86-a0cf-5cbac7cde491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:51.063906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadf1ec-fe03-4b86-a0cf-5cbac7cde491 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:51.064185 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadf1ec-fe03-4b86-a0cf-5cbac7cde491 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:51.064456 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadf1ec-fe03-4b86-a0cf-5cbac7cde491 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:51.065591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadf1ec-fe03-4b86-a0cf-5cbac7cde491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:51.067026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadf1ec-fe03-4b86-a0cf-5cbac7cde491 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:51.068577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 567/1137] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:39:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:51.074387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6718c-5d61-4ab6-b6e4-39e88f758141 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:51.170953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6718c-5d61-4ab6-b6e4-39e88f758141 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:51.173214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:51.204884 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38082-2564-4ea2-9e5e-c5eef07f9067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:51.205430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38082-2564-4ea2-9e5e-c5eef07f9067 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:51.205712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38082-2564-4ea2-9e5e-c5eef07f9067 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:51.205987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38082-2564-4ea2-9e5e-c5eef07f9067 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:51.206638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa38082-2564-4ea2-9e5e-c5eef07f9067 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:51.208203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa38082-2564-4ea2-9e5e-c5eef07f9067 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:51.304045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 571/1138] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:39:51 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:39:53.232576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa5925-f274-48b0-bb0f-795e57de8b5d None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:53.233159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa5925-f274-48b0-bb0f-795e57de8b5d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:53.233159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa5925-f274-48b0-bb0f-795e57de8b5d None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:53.234537 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 568/1139] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:53.239637 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598368-40fc-4519-b3a0-dc141b6c75bd None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:53.240005 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598368-40fc-4519-b3a0-dc141b6c75bd None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:53.240195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598368-40fc-4519-b3a0-dc141b6c75bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:53.258071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-55598368-40fc-4519-b3a0-dc141b6c75bd None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:53.259314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-55598368-40fc-4519-b3a0-dc141b6c75bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:53.324112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 572/1140] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:53.595516 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa5925-f274-48b0-bb0f-795e57de8b5d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:53.678552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:53.694960 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa5925-f274-48b0-bb0f-795e57de8b5d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:53.727705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb663ee4-8ea0-4c66-a2d4-91c61e4a63d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:53.731486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb663ee4-8ea0-4c66-a2d4-91c61e4a63d7 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:53.731486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb663ee4-8ea0-4c66-a2d4-91c61e4a63d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:53.731486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb663ee4-8ea0-4c66-a2d4-91c61e4a63d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:53.742274 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb663ee4-8ea0-4c66-a2d4-91c61e4a63d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-cb663ee4-8ea0-4c66-a2d4-91c61e4a63d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:39:53.747697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:53.748869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:53.749986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 569/1141] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:39:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:53.754901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55598368-40fc-4519-b3a0-dc141b6c75bd None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:53.840717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:53.849746 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55598368-40fc-4519-b3a0-dc141b6c75bd None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:53.883548 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0e759-b7de-4306-88be-8ad117cbfb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:53.884147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0e759-b7de-4306-88be-8ad117cbfb4b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:53.884460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0e759-b7de-4306-88be-8ad117cbfb4b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:53.884733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0e759-b7de-4306-88be-8ad117cbfb4b None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:53.885394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0e759-b7de-4306-88be-8ad117cbfb4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:53.885699 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0e759-b7de-4306-88be-8ad117cbfb4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:53.887101 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0e759-b7de-4306-88be-8ad117cbfb4b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:53.895178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 573/1142] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:39:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:53.900937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb663ee4-8ea0-4c66-a2d4-91c61e4a63d7 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:53.999432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb663ee4-8ea0-4c66-a2d4-91c61e4a63d7 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:54.031753 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb15ab-541f-4d4d-ac42-f0d6d1ece0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:54.032365 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb15ab-541f-4d4d-ac42-f0d6d1ece0ed None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:54.032648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb15ab-541f-4d4d-ac42-f0d6d1ece0ed None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:54.032921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb15ab-541f-4d4d-ac42-f0d6d1ece0ed None admin] PATH_INFO: `/v3/users/803879c2c90e465197b0745580ed24a9` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:54.046268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb15ab-541f-4d4d-ac42-f0d6d1ece0ed None admin] RBAC: Authorizing `identity:get_user(user_id=803879c2c90e465197b0745580ed24a9)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:54.047709 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb15ab-541f-4d4d-ac42-f0d6d1ece0ed None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:54.049270 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 570/1143] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:39:53 2022] GET /identity/v3/users/803879c2c90e465197b0745580ed24a9 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:54.055325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0e759-b7de-4306-88be-8ad117cbfb4b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:54.159528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0e759-b7de-4306-88be-8ad117cbfb4b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:54.194564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ff30-2a46-47a4-bd46-532970c6c5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:54.195219 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ff30-2a46-47a4-bd46-532970c6c5d4 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:54.195495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ff30-2a46-47a4-bd46-532970c6c5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:54.195763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ff30-2a46-47a4-bd46-532970c6c5d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:54.217505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:54.266504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78ff30-2a46-47a4-bd46-532970c6c5d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:54.268111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78ff30-2a46-47a4-bd46-532970c6c5d4 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:54.366387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 574/1144] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:39:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:39:54.372447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb15ab-541f-4d4d-ac42-f0d6d1ece0ed None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:54.375440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:54.471417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb15ab-541f-4d4d-ac42-f0d6d1ece0ed None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:54.505297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d66ef2-37cd-4bf1-94f0-8f10564ddee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:54.505873 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d66ef2-37cd-4bf1-94f0-8f10564ddee8 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:54.506154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d66ef2-37cd-4bf1-94f0-8f10564ddee8 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:54.506426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d66ef2-37cd-4bf1-94f0-8f10564ddee8 None admin] PATH_INFO: `/v3/projects/124f9ed8752344b6a2e88a5a8fa4ba91` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:54.507586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d66ef2-37cd-4bf1-94f0-8f10564ddee8 None admin] RBAC: Authorizing `identity:get_project(project_id=124f9ed8752344b6a2e88a5a8fa4ba91)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:54.509055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d66ef2-37cd-4bf1-94f0-8f10564ddee8 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:54.510715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 571/1145] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:39:54 2022] GET /identity/v3/projects/124f9ed8752344b6a2e88a5a8fa4ba91 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:54.516847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ff30-2a46-47a4-bd46-532970c6c5d4 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:54.568999 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:54.615287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ff30-2a46-47a4-bd46-532970c6c5d4 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:54.648091 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15624b2b-c58e-4a04-a507-0b747c9c0160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:54.648687 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15624b2b-c58e-4a04-a507-0b747c9c0160 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:54.648969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15624b2b-c58e-4a04-a507-0b747c9c0160 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:54.649243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15624b2b-c58e-4a04-a507-0b747c9c0160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:54.649960 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15624b2b-c58e-4a04-a507-0b747c9c0160 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=124f9ed8752344b6a2e88a5a8fa4ba91, user.id=803879c2c90e465197b0745580ed24a9) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:54.650856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15624b2b-c58e-4a04-a507-0b747c9c0160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:54.652350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15624b2b-c58e-4a04-a507-0b747c9c0160 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:54.657623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 575/1146] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:39:54 2022] GET /identity/v3/role_assignments?user.id=803879c2c90e465197b0745580ed24a9&scope.project.id=124f9ed8752344b6a2e88a5a8fa4ba91&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:56.535446 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2024-e0bc-431d-b253-d79eb4017b68 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:56.536005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2024-e0bc-431d-b253-d79eb4017b68 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:56.536182 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2024-e0bc-431d-b253-d79eb4017b68 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:56.538187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 572/1147] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:56.544086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc09b1-2f31-4320-8cce-5aad377672d5 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:56.544532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc09b1-2f31-4320-8cce-5aad377672d5 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:56.544630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc09b1-2f31-4320-8cce-5aad377672d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:56.563187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-4efc09b1-2f31-4320-8cce-5aad377672d5 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:56.564378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4efc09b1-2f31-4320-8cce-5aad377672d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:56.629857 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 576/1148] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:56.897260 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2024-e0bc-431d-b253-d79eb4017b68 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:56.966499 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:56.997549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2024-e0bc-431d-b253-d79eb4017b68 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:57.029604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e633bb-f4f6-4ea3-9754-6a7e167e5ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:57.030214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e633bb-f4f6-4ea3-9754-6a7e167e5ae6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:57.030492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e633bb-f4f6-4ea3-9754-6a7e167e5ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:57.030762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e633bb-f4f6-4ea3-9754-6a7e167e5ae6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:57.041026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e633bb-f4f6-4ea3-9754-6a7e167e5ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-58e633bb-f4f6-4ea3-9754-6a7e167e5ae6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:39:57.045779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:39:57.046856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:39:57.047920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 573/1149] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:39:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:39:57.052788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc09b1-2f31-4320-8cce-5aad377672d5 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:57.097420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:57.149288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc09b1-2f31-4320-8cce-5aad377672d5 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:57.182622 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636839bc-c5fa-4535-b532-bb8dd9eb5dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:57.183249 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636839bc-c5fa-4535-b532-bb8dd9eb5dbc None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:57.183531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636839bc-c5fa-4535-b532-bb8dd9eb5dbc None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:57.183806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636839bc-c5fa-4535-b532-bb8dd9eb5dbc None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:57.184461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636839bc-c5fa-4535-b532-bb8dd9eb5dbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:39:57.184763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636839bc-c5fa-4535-b532-bb8dd9eb5dbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:57.186130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636839bc-c5fa-4535-b532-bb8dd9eb5dbc None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:57.193990 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 577/1150] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:39:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:57.199660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e633bb-f4f6-4ea3-9754-6a7e167e5ae6 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:57.297237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e633bb-f4f6-4ea3-9754-6a7e167e5ae6 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:57.325320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:57.330946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6421ba-f509-4f33-b71c-3f1fa6ede11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:57.331564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6421ba-f509-4f33-b71c-3f1fa6ede11a None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:57.331846 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6421ba-f509-4f33-b71c-3f1fa6ede11a None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:57.332121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6421ba-f509-4f33-b71c-3f1fa6ede11a None admin] PATH_INFO: `/v3/users/803879c2c90e465197b0745580ed24a9` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:57.333228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6421ba-f509-4f33-b71c-3f1fa6ede11a None admin] RBAC: Authorizing `identity:get_user(user_id=803879c2c90e465197b0745580ed24a9)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:57.334631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6421ba-f509-4f33-b71c-3f1fa6ede11a None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:57.336248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 574/1151] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:39:57 2022] GET /identity/v3/users/803879c2c90e465197b0745580ed24a9 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:57.341994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636839bc-c5fa-4535-b532-bb8dd9eb5dbc None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:57.440427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636839bc-c5fa-4535-b532-bb8dd9eb5dbc None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:57.448861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:57.472944 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316d4f6-50ff-4cf6-a4e4-f7dd0151a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:57.473563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316d4f6-50ff-4cf6-a4e4-f7dd0151a337 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:57.473844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316d4f6-50ff-4cf6-a4e4-f7dd0151a337 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:57.474116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316d4f6-50ff-4cf6-a4e4-f7dd0151a337 None admin] PATH_INFO: `/v3/projects/124f9ed8752344b6a2e88a5a8fa4ba91` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:57.475251 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316d4f6-50ff-4cf6-a4e4-f7dd0151a337 None admin] RBAC: Authorizing `identity:get_project(project_id=124f9ed8752344b6a2e88a5a8fa4ba91)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:57.476687 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316d4f6-50ff-4cf6-a4e4-f7dd0151a337 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:57.479427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 578/1152] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:39:57 2022] GET /identity/v3/projects/124f9ed8752344b6a2e88a5a8fa4ba91 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:57.485043 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6421ba-f509-4f33-b71c-3f1fa6ede11a None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:57.580553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6421ba-f509-4f33-b71c-3f1fa6ede11a None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:57.613509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b9910-bd91-4d6d-ab35-737ba2d224c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:57.614148 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b9910-bd91-4d6d-ab35-737ba2d224c5 None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:57.614428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b9910-bd91-4d6d-ab35-737ba2d224c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:57.614705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b9910-bd91-4d6d-ab35-737ba2d224c5 None admin] PATH_INFO: `/v3/projects/124f9ed8752344b6a2e88a5a8fa4ba91/users/803879c2c90e465197b0745580ed24a9/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:57.616589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b9910-bd91-4d6d-ab35-737ba2d224c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=124f9ed8752344b6a2e88a5a8fa4ba91, user_id=803879c2c90e465197b0745580ed24a9, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:57.617988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b9910-bd91-4d6d-ab35-737ba2d224c5 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:57.688902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 575/1153] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:39:57 2022] PUT /identity/v3/projects/124f9ed8752344b6a2e88a5a8fa4ba91/users/803879c2c90e465197b0745580ed24a9/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:39:59.574292 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35136eaf-3d5c-4d6f-9d50-882f37efd4ba None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:59.574854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35136eaf-3d5c-4d6f-9d50-882f37efd4ba None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:59.574854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35136eaf-3d5c-4d6f-9d50-882f37efd4ba None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:59.576215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 579/1154] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:59.581303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca5d5-9904-4155-8ccc-bc375257e0eb None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:59.581684 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca5d5-9904-4155-8ccc-bc375257e0eb None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:59.581854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca5d5-9904-4155-8ccc-bc375257e0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:59.600213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f68ca5d5-9904-4155-8ccc-bc375257e0eb None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:59.601401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f68ca5d5-9904-4155-8ccc-bc375257e0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:59.655144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:59.668988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 576/1155] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:39:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:39:59.940836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35136eaf-3d5c-4d6f-9d50-882f37efd4ba None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:00.038796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35136eaf-3d5c-4d6f-9d50-882f37efd4ba None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:00.070860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97429692-d5a6-4565-b9f3-755e39d03aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:00.071499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97429692-d5a6-4565-b9f3-755e39d03aa0 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:00.072300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97429692-d5a6-4565-b9f3-755e39d03aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:00.072570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97429692-d5a6-4565-b9f3-755e39d03aa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:00.082659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97429692-d5a6-4565-b9f3-755e39d03aa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-97429692-d5a6-4565-b9f3-755e39d03aa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:40:00.088011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:40:00.089078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:40:00.090200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 580/1156] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:39:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:40:00.095067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ca5d5-9904-4155-8ccc-bc375257e0eb None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:00.191785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ca5d5-9904-4155-8ccc-bc375257e0eb None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:00.225461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b04c40-0b82-49dc-a6fc-2d9642cf7b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:00.226067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b04c40-0b82-49dc-a6fc-2d9642cf7b84 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:00.226350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b04c40-0b82-49dc-a6fc-2d9642cf7b84 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:00.226622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b04c40-0b82-49dc-a6fc-2d9642cf7b84 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:00.227308 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b04c40-0b82-49dc-a6fc-2d9642cf7b84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:40:00.227612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b04c40-0b82-49dc-a6fc-2d9642cf7b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:00.229281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b04c40-0b82-49dc-a6fc-2d9642cf7b84 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:00.237270 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 577/1157] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:40:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:00.243170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97429692-d5a6-4565-b9f3-755e39d03aa0 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:00.279704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:00.343251 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97429692-d5a6-4565-b9f3-755e39d03aa0 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:00.376344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756a420-8737-4de2-9ada-70776c16f4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:00.376959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756a420-8737-4de2-9ada-70776c16f4ab None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:00.377241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756a420-8737-4de2-9ada-70776c16f4ab None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:00.377515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756a420-8737-4de2-9ada-70776c16f4ab None admin] PATH_INFO: `/v3/users/803879c2c90e465197b0745580ed24a9` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:00.378646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756a420-8737-4de2-9ada-70776c16f4ab None admin] RBAC: Authorizing `identity:get_user(user_id=803879c2c90e465197b0745580ed24a9)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:00.380113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756a420-8737-4de2-9ada-70776c16f4ab None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:00.381707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 581/1158] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:40:00 2022] GET /identity/v3/users/803879c2c90e465197b0745580ed24a9 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:00.388048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b04c40-0b82-49dc-a6fc-2d9642cf7b84 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:00.437181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:00.487119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b04c40-0b82-49dc-a6fc-2d9642cf7b84 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:00.519050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af719f6-a67f-4749-bfc4-6093ade38006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:00.519647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af719f6-a67f-4749-bfc4-6093ade38006 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:00.519924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af719f6-a67f-4749-bfc4-6093ade38006 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:00.520192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af719f6-a67f-4749-bfc4-6093ade38006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:00.585463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af719f6-a67f-4749-bfc4-6093ade38006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:00.586913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af719f6-a67f-4749-bfc4-6093ade38006 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:00.632760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:00.681509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 578/1159] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:40:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:40:00.687430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756a420-8737-4de2-9ada-70776c16f4ab None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:00.786829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756a420-8737-4de2-9ada-70776c16f4ab None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:00.789153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:00.818712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911c33c-e37b-49f4-bee6-74c16f926b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:00.819425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911c33c-e37b-49f4-bee6-74c16f926b6c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:00.819704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911c33c-e37b-49f4-bee6-74c16f926b6c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:00.819977 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911c33c-e37b-49f4-bee6-74c16f926b6c None admin] PATH_INFO: `/v3/projects/124f9ed8752344b6a2e88a5a8fa4ba91` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:00.821102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911c33c-e37b-49f4-bee6-74c16f926b6c None admin] RBAC: Authorizing `identity:get_project(project_id=124f9ed8752344b6a2e88a5a8fa4ba91)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:00.823152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911c33c-e37b-49f4-bee6-74c16f926b6c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:00.824768 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 582/1160] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:40:00 2022] GET /identity/v3/projects/124f9ed8752344b6a2e88a5a8fa4ba91 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:00.831102 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af719f6-a67f-4749-bfc4-6093ade38006 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:00.927047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af719f6-a67f-4749-bfc4-6093ade38006 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:00.961030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a0ea8-7f17-4a2e-9ed5-416623d15bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:00.961626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0ea8-7f17-4a2e-9ed5-416623d15bb5 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:00.961903 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0ea8-7f17-4a2e-9ed5-416623d15bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:00.962171 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0ea8-7f17-4a2e-9ed5-416623d15bb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:00.962966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a0ea8-7f17-4a2e-9ed5-416623d15bb5 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=124f9ed8752344b6a2e88a5a8fa4ba91, user.id=803879c2c90e465197b0745580ed24a9) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:40:00.963273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a0ea8-7f17-4a2e-9ed5-416623d15bb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:00.964679 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a0ea8-7f17-4a2e-9ed5-416623d15bb5 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:00.970274 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 579/1161] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:40:00 2022] GET /identity/v3/role_assignments?user.id=803879c2c90e465197b0745580ed24a9&scope.project.id=124f9ed8752344b6a2e88a5a8fa4ba91&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:02.888326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd9d29-eac4-4063-861b-677cc2042a46 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:02.888864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd9d29-eac4-4063-861b-677cc2042a46 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:02.888864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd9d29-eac4-4063-861b-677cc2042a46 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:02.890311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 583/1162] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:40:02.895606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c180e-8769-4800-b260-11ea32e93f64 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:02.896029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c180e-8769-4800-b260-11ea32e93f64 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:02.896160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c180e-8769-4800-b260-11ea32e93f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:02.913788 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-474c180e-8769-4800-b260-11ea32e93f64 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:40:02.915034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-474c180e-8769-4800-b260-11ea32e93f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:40:02.924442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:02.980337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 580/1163] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:40:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:40:03.246158 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd9d29-eac4-4063-861b-677cc2042a46 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:03.345345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd9d29-eac4-4063-861b-677cc2042a46 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:03.378509 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73a618-a529-4354-94a6-e1d10957e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:03.379142 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73a618-a529-4354-94a6-e1d10957e13d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:03.379427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73a618-a529-4354-94a6-e1d10957e13d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:03.379699 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73a618-a529-4354-94a6-e1d10957e13d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:03.419440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:03.445015 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73a618-a529-4354-94a6-e1d10957e13d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:03.446459 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73a618-a529-4354-94a6-e1d10957e13d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:03.542740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 584/1164] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:40:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:40:03.548536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c180e-8769-4800-b260-11ea32e93f64 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:03.645245 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c180e-8769-4800-b260-11ea32e93f64 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:03.677819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7b351-9bfa-4c57-bf27-1897b96e5df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:03.678435 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b351-9bfa-4c57-bf27-1897b96e5df1 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:03.678715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b351-9bfa-4c57-bf27-1897b96e5df1 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:03.679014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b351-9bfa-4c57-bf27-1897b96e5df1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:03.685490 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7b351-9bfa-4c57-bf27-1897b96e5df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:03.686926 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7b351-9bfa-4c57-bf27-1897b96e5df1 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-69b7b351-9bfa-4c57-bf27-1897b96e5df1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:40:03.698483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:40:03.699693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:40:03.700641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 581/1165] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Aug 29 23:40:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:40:03.705493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73a618-a529-4354-94a6-e1d10957e13d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:03.774306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:03.802610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73a618-a529-4354-94a6-e1d10957e13d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:03.835307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba27224-91b4-4d1a-bbf5-f0ee3b41f823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:03.835897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba27224-91b4-4d1a-bbf5-f0ee3b41f823 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:03.836171 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba27224-91b4-4d1a-bbf5-f0ee3b41f823 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:03.836438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba27224-91b4-4d1a-bbf5-f0ee3b41f823 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:03.837066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba27224-91b4-4d1a-bbf5-f0ee3b41f823 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:40:03.837939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba27224-91b4-4d1a-bbf5-f0ee3b41f823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:03.839309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba27224-91b4-4d1a-bbf5-f0ee3b41f823 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:03.846158 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 585/1166] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Aug 29 23:40:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:05.721497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b4f19-bf6a-4a35-8919-dfd7119e3d6c None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:05.722022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b4f19-bf6a-4a35-8919-dfd7119e3d6c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:05.722022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b4f19-bf6a-4a35-8919-dfd7119e3d6c None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:05.723431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 582/1167] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:40:05.729563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16261304-bdb3-40d1-8481-df3938568241 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:05.729987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16261304-bdb3-40d1-8481-df3938568241 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:05.730110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16261304-bdb3-40d1-8481-df3938568241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:05.747900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-16261304-bdb3-40d1-8481-df3938568241 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:40:05.749082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-16261304-bdb3-40d1-8481-df3938568241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:40:05.813368 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 586/1168] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:40:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:40:06.084343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b4f19-bf6a-4a35-8919-dfd7119e3d6c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:06.088871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:06.186687 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b4f19-bf6a-4a35-8919-dfd7119e3d6c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:06.219352 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df98795-1494-4ef9-8cae-f7989a3ec9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:06.219937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df98795-1494-4ef9-8cae-f7989a3ec9b1 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:06.220216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df98795-1494-4ef9-8cae-f7989a3ec9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:06.220489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df98795-1494-4ef9-8cae-f7989a3ec9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:06.221172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df98795-1494-4ef9-8cae-f7989a3ec9b1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:06.222529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df98795-1494-4ef9-8cae-f7989a3ec9b1 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:06.296146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 583/1169] 10.222.0.73 () {60 vars in 1138 bytes} [Mon Aug 29 23:40:06 2022] POST /identity/v3/domains => generated 267 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:40:08.214308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807924-b96b-4d03-b13c-f561e1ab561c None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:08.214838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807924-b96b-4d03-b13c-f561e1ab561c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:08.214838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807924-b96b-4d03-b13c-f561e1ab561c None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:08.216228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 587/1170] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:40:08.221327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f73964-a30b-45ea-9a01-cac3ec162998 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:08.221747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f73964-a30b-45ea-9a01-cac3ec162998 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:08.221874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f73964-a30b-45ea-9a01-cac3ec162998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:08.239965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f1f73964-a30b-45ea-9a01-cac3ec162998 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:40:08.241163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f1f73964-a30b-45ea-9a01-cac3ec162998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:40:08.299998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:08.308543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 584/1171] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:40:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:40:08.582548 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26807924-b96b-4d03-b13c-f561e1ab561c None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:08.649481 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:08.683662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26807924-b96b-4d03-b13c-f561e1ab561c None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:08.716311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977babbb-90a7-4157-9c78-d95e1f7dcfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:08.716929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977babbb-90a7-4157-9c78-d95e1f7dcfc1 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:08.717307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977babbb-90a7-4157-9c78-d95e1f7dcfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:08.717563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977babbb-90a7-4157-9c78-d95e1f7dcfc1 None admin] PATH_INFO: `/v3/domains/0cc2ec38c84d40d6b453f1b3ffb79771` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:08.727936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977babbb-90a7-4157-9c78-d95e1f7dcfc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0cc2ec38c84d40d6b453f1b3ffb79771)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:08.729410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977babbb-90a7-4157-9c78-d95e1f7dcfc1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:08.731021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 588/1172] 10.222.0.73 () {56 vars in 1183 bytes} [Mon Aug 29 23:40:08 2022] GET /identity/v3/domains/0cc2ec38c84d40d6b453f1b3ffb79771 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:08.736891 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f73964-a30b-45ea-9a01-cac3ec162998 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:08.832996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f73964-a30b-45ea-9a01-cac3ec162998 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:08.865744 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc04dc-a579-421c-acc9-87e08348ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:08.866348 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc04dc-a579-421c-acc9-87e08348ac21 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:08.866630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc04dc-a579-421c-acc9-87e08348ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:08.866924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc04dc-a579-421c-acc9-87e08348ac21 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:08.867567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc04dc-a579-421c-acc9-87e08348ac21 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:08.869588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc04dc-a579-421c-acc9-87e08348ac21 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:08.943780 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 585/1173] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:40:08 2022] POST /identity/v3/projects => generated 361 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:40:10.865975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edcaee-3f0d-4206-9a9c-c1e1b3029635 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:10.866527 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edcaee-3f0d-4206-9a9c-c1e1b3029635 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:10.866527 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edcaee-3f0d-4206-9a9c-c1e1b3029635 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:10.867893 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 589/1174] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:40:10.873639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49631d4-3971-4d59-8d87-00aee5e3e96d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:10.874076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49631d4-3971-4d59-8d87-00aee5e3e96d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:10.874223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49631d4-3971-4d59-8d87-00aee5e3e96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:10.893064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-b49631d4-3971-4d59-8d87-00aee5e3e96d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:40:10.894292 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b49631d4-3971-4d59-8d87-00aee5e3e96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:40:10.937468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:10.961721 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 586/1175] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:40:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:40:11.236985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edcaee-3f0d-4206-9a9c-c1e1b3029635 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:11.334829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edcaee-3f0d-4206-9a9c-c1e1b3029635 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:11.359926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:11.368840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943944f5-25a2-4d5a-a0e4-abe6c8a76ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:11.369452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943944f5-25a2-4d5a-a0e4-abe6c8a76ce5 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:11.369725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943944f5-25a2-4d5a-a0e4-abe6c8a76ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:11.369991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943944f5-25a2-4d5a-a0e4-abe6c8a76ce5 None admin] PATH_INFO: `/v3/domains/0cc2ec38c84d40d6b453f1b3ffb79771` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:11.371111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943944f5-25a2-4d5a-a0e4-abe6c8a76ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0cc2ec38c84d40d6b453f1b3ffb79771)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:11.372578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943944f5-25a2-4d5a-a0e4-abe6c8a76ce5 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:11.374755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 590/1176] 10.222.0.73 () {56 vars in 1183 bytes} [Mon Aug 29 23:40:11 2022] GET /identity/v3/domains/0cc2ec38c84d40d6b453f1b3ffb79771 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:11.380683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49631d4-3971-4d59-8d87-00aee5e3e96d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:11.475741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49631d4-3971-4d59-8d87-00aee5e3e96d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:11.508364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52db9ba-ce01-45e5-a124-f7b8c1be5563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:11.508988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52db9ba-ce01-45e5-a124-f7b8c1be5563 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:11.509267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52db9ba-ce01-45e5-a124-f7b8c1be5563 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:11.509537 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52db9ba-ce01-45e5-a124-f7b8c1be5563 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:11.510183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52db9ba-ce01-45e5-a124-f7b8c1be5563 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:11.511614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52db9ba-ce01-45e5-a124-f7b8c1be5563 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:11.588277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 587/1177] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:40:11 2022] POST /identity/v3/users => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:40:13.493876 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046e90-c98b-42d9-8e15-ebe5d379f19d None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:13.494522 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046e90-c98b-42d9-8e15-ebe5d379f19d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:13.494522 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046e90-c98b-42d9-8e15-ebe5d379f19d None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:13.495839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 591/1178] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:40:13.500834 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c34a0-9a81-4fb8-88a5-051005d3cb34 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:13.501235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c34a0-9a81-4fb8-88a5-051005d3cb34 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:13.501387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c34a0-9a81-4fb8-88a5-051005d3cb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:13.518948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-660c34a0-9a81-4fb8-88a5-051005d3cb34 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:40:13.520118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-660c34a0-9a81-4fb8-88a5-051005d3cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:40:13.545132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:13.583667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 588/1179] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:40:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:40:13.846626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26046e90-c98b-42d9-8e15-ebe5d379f19d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:13.945657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26046e90-c98b-42d9-8e15-ebe5d379f19d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:13.978933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d70d88-99f1-4969-9000-9deddea2e8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:13.979548 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d70d88-99f1-4969-9000-9deddea2e8a8 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:13.979827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d70d88-99f1-4969-9000-9deddea2e8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:13.980100 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d70d88-99f1-4969-9000-9deddea2e8a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:13.990355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d70d88-99f1-4969-9000-9deddea2e8a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-12d70d88-99f1-4969-9000-9deddea2e8a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:40:13.995222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:40:13.996376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:40:13.997456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 592/1180] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:40:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:40:14.002104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c34a0-9a81-4fb8-88a5-051005d3cb34 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:14.099175 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c34a0-9a81-4fb8-88a5-051005d3cb34 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:14.132672 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7b3c7-d760-405e-bc5c-e716b6868645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:14.133270 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7b3c7-d760-405e-bc5c-e716b6868645 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:14.134096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7b3c7-d760-405e-bc5c-e716b6868645 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:14.134400 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7b3c7-d760-405e-bc5c-e716b6868645 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:14.135104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7b3c7-d760-405e-bc5c-e716b6868645 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:40:14.135409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7b3c7-d760-405e-bc5c-e716b6868645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:14.136821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7b3c7-d760-405e-bc5c-e716b6868645 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:14.144727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 589/1181] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:14.151974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d70d88-99f1-4969-9000-9deddea2e8a8 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:14.206065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:14.250351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d70d88-99f1-4969-9000-9deddea2e8a8 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:14.283769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308294fa-3674-45e5-bfa7-49c03ed1cc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:14.284406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308294fa-3674-45e5-bfa7-49c03ed1cc94 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:14.284684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308294fa-3674-45e5-bfa7-49c03ed1cc94 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:14.284956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308294fa-3674-45e5-bfa7-49c03ed1cc94 None admin] PATH_INFO: `/v3/users/4fbc19eca0c9479bbcd63b528ef18e0b` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:14.297844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308294fa-3674-45e5-bfa7-49c03ed1cc94 None admin] RBAC: Authorizing `identity:get_user(user_id=4fbc19eca0c9479bbcd63b528ef18e0b)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:14.299306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308294fa-3674-45e5-bfa7-49c03ed1cc94 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:14.300888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 593/1182] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:40:14 2022] GET /identity/v3/users/4fbc19eca0c9479bbcd63b528ef18e0b => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:14.306758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7b3c7-d760-405e-bc5c-e716b6868645 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:14.331853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:14.403693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7b3c7-d760-405e-bc5c-e716b6868645 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:14.436997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e06013-2c4c-433c-975e-6fff789ea8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:14.437589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e06013-2c4c-433c-975e-6fff789ea8c8 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:14.437864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e06013-2c4c-433c-975e-6fff789ea8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:14.438131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e06013-2c4c-433c-975e-6fff789ea8c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:14.502527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e06013-2c4c-433c-975e-6fff789ea8c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:14.503985 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e06013-2c4c-433c-975e-6fff789ea8c8 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:14.527073 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:14.599046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 590/1183] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:40:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:40:14.606028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308294fa-3674-45e5-bfa7-49c03ed1cc94 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:14.700244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308294fa-3674-45e5-bfa7-49c03ed1cc94 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:14.713312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:14.733752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78a400-3566-4591-a431-582175f3e350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:14.734368 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78a400-3566-4591-a431-582175f3e350 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:14.734641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78a400-3566-4591-a431-582175f3e350 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:14.734937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78a400-3566-4591-a431-582175f3e350 None admin] PATH_INFO: `/v3/projects/28389e8ba89f488fa2507ac34be0f157` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:14.736090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78a400-3566-4591-a431-582175f3e350 None admin] RBAC: Authorizing `identity:get_project(project_id=28389e8ba89f488fa2507ac34be0f157)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:14.737546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78a400-3566-4591-a431-582175f3e350 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:14.739211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 594/1184] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:40:14 2022] GET /identity/v3/projects/28389e8ba89f488fa2507ac34be0f157 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:14.745234 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e06013-2c4c-433c-975e-6fff789ea8c8 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:14.841369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e06013-2c4c-433c-975e-6fff789ea8c8 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:14.863221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:14.873643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a93e9a-fc20-4f67-8dd0-45f93f30b23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:14.874241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93e9a-fc20-4f67-8dd0-45f93f30b23b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:14.874523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93e9a-fc20-4f67-8dd0-45f93f30b23b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:14.874796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93e9a-fc20-4f67-8dd0-45f93f30b23b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:14.875547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a93e9a-fc20-4f67-8dd0-45f93f30b23b None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=28389e8ba89f488fa2507ac34be0f157, user.id=4fbc19eca0c9479bbcd63b528ef18e0b) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:40:14.875865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a93e9a-fc20-4f67-8dd0-45f93f30b23b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:14.877277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a93e9a-fc20-4f67-8dd0-45f93f30b23b None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:14.882508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 591/1185] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:40:14 2022] GET /identity/v3/role_assignments?user.id=4fbc19eca0c9479bbcd63b528ef18e0b&scope.project.id=28389e8ba89f488fa2507ac34be0f157&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:16.737819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a22037-57d8-42a1-bda0-cf49c489c99f None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:16.738364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a22037-57d8-42a1-bda0-cf49c489c99f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:16.738364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a22037-57d8-42a1-bda0-cf49c489c99f None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:16.739759 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 595/1186] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:40:16.745428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c687b-f773-45d4-8390-a488f11b4771 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:16.745839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c687b-f773-45d4-8390-a488f11b4771 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:16.745979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c687b-f773-45d4-8390-a488f11b4771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:16.764441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-827c687b-f773-45d4-8390-a488f11b4771 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:40:16.765624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-827c687b-f773-45d4-8390-a488f11b4771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:40:16.829829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 592/1187] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:40:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:40:17.102095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a22037-57d8-42a1-bda0-cf49c489c99f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:17.201594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a22037-57d8-42a1-bda0-cf49c489c99f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:17.234795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077a97a-7a86-47d4-afbd-de25217dc377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:17.235438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077a97a-7a86-47d4-afbd-de25217dc377 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:17.235721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077a97a-7a86-47d4-afbd-de25217dc377 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:17.235998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077a97a-7a86-47d4-afbd-de25217dc377 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:17.245795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077a97a-7a86-47d4-afbd-de25217dc377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-e077a97a-7a86-47d4-afbd-de25217dc377 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:40:17.250586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:40:17.251690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:40:17.252532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 596/1188] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:40:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:40:17.257636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c687b-f773-45d4-8390-a488f11b4771 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:17.354100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c687b-f773-45d4-8390-a488f11b4771 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:17.370536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:17.387192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f5a0e-a204-4ab5-b491-d75f16cde1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:17.387792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f5a0e-a204-4ab5-b491-d75f16cde1d9 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:17.388070 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f5a0e-a204-4ab5-b491-d75f16cde1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:17.388341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f5a0e-a204-4ab5-b491-d75f16cde1d9 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:17.388988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f5a0e-a204-4ab5-b491-d75f16cde1d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:40:17.389284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f5a0e-a204-4ab5-b491-d75f16cde1d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:17.390629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f5a0e-a204-4ab5-b491-d75f16cde1d9 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:17.398455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 593/1189] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:40:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:17.404868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077a97a-7a86-47d4-afbd-de25217dc377 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:17.447381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:17.504266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077a97a-7a86-47d4-afbd-de25217dc377 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:17.537437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf943b-2288-4504-9392-dc5b061aaf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:17.538050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf943b-2288-4504-9392-dc5b061aaf6c None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:17.538330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf943b-2288-4504-9392-dc5b061aaf6c None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:17.538604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf943b-2288-4504-9392-dc5b061aaf6c None admin] PATH_INFO: `/v3/users/4fbc19eca0c9479bbcd63b528ef18e0b` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:17.539777 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf943b-2288-4504-9392-dc5b061aaf6c None admin] RBAC: Authorizing `identity:get_user(user_id=4fbc19eca0c9479bbcd63b528ef18e0b)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:17.541196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf943b-2288-4504-9392-dc5b061aaf6c None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:17.542761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 597/1190] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:40:17 2022] GET /identity/v3/users/4fbc19eca0c9479bbcd63b528ef18e0b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:17.548439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f5a0e-a204-4ab5-b491-d75f16cde1d9 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:17.646314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f5a0e-a204-4ab5-b491-d75f16cde1d9 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:17.678128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef7240-efb8-495e-b5a2-d536735e8809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:17.678739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef7240-efb8-495e-b5a2-d536735e8809 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:17.679049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef7240-efb8-495e-b5a2-d536735e8809 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:17.679323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef7240-efb8-495e-b5a2-d536735e8809 None admin] PATH_INFO: `/v3/projects/28389e8ba89f488fa2507ac34be0f157` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:17.680904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef7240-efb8-495e-b5a2-d536735e8809 None admin] RBAC: Authorizing `identity:get_project(project_id=28389e8ba89f488fa2507ac34be0f157)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:17.682313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef7240-efb8-495e-b5a2-d536735e8809 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:17.683947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 594/1191] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:40:17 2022] GET /identity/v3/projects/28389e8ba89f488fa2507ac34be0f157 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:17.689710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf943b-2288-4504-9392-dc5b061aaf6c None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:17.788898 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf943b-2288-4504-9392-dc5b061aaf6c None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:17.798356 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:17.822660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a092f6-d28c-42cb-b90c-9bb80c11efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:17.823341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a092f6-d28c-42cb-b90c-9bb80c11efae None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:17.823626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a092f6-d28c-42cb-b90c-9bb80c11efae None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:17.823904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a092f6-d28c-42cb-b90c-9bb80c11efae None admin] PATH_INFO: `/v3/projects/28389e8ba89f488fa2507ac34be0f157/users/4fbc19eca0c9479bbcd63b528ef18e0b/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:17.825792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a092f6-d28c-42cb-b90c-9bb80c11efae None admin] RBAC: Authorizing `identity:create_grant(project_id=28389e8ba89f488fa2507ac34be0f157, user_id=4fbc19eca0c9479bbcd63b528ef18e0b, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:17.827288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a092f6-d28c-42cb-b90c-9bb80c11efae None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:17.976422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 598/1192] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:40:17 2022] PUT /identity/v3/projects/28389e8ba89f488fa2507ac34be0f157/users/4fbc19eca0c9479bbcd63b528ef18e0b/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:40:19.855467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2c6e-7173-480d-9447-a7856b085e5c None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:19.856015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2c6e-7173-480d-9447-a7856b085e5c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:19.856015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2c6e-7173-480d-9447-a7856b085e5c None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:19.857346 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 595/1193] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:40:19.862757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47608f-599a-48b2-a1c6-c97697c95793 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:19.863233 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47608f-599a-48b2-a1c6-c97697c95793 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:19.863421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47608f-599a-48b2-a1c6-c97697c95793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:19.881878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-0b47608f-599a-48b2-a1c6-c97697c95793 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:40:19.883113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0b47608f-599a-48b2-a1c6-c97697c95793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:40:19.946959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 599/1194] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:40:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:40:20.215702 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d2c6e-7173-480d-9447-a7856b085e5c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:20.265187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:20.315191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d2c6e-7173-480d-9447-a7856b085e5c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:20.348093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c287836-aa8d-4f73-bca2-b570cf75516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:20.348711 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c287836-aa8d-4f73-bca2-b570cf75516b None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:20.348991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c287836-aa8d-4f73-bca2-b570cf75516b None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:20.349264 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c287836-aa8d-4f73-bca2-b570cf75516b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:20.359748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c287836-aa8d-4f73-bca2-b570cf75516b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-1c287836-aa8d-4f73-bca2-b570cf75516b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:40:20.364524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:40:20.365593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:40:20.366791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 596/1195] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:40:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:40:20.371684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47608f-599a-48b2-a1c6-c97697c95793 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:20.465915 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:20.469330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47608f-599a-48b2-a1c6-c97697c95793 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:20.502571 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f20680-38cb-42ff-ae4c-f2641a712b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:20.503197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f20680-38cb-42ff-ae4c-f2641a712b79 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:20.503476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f20680-38cb-42ff-ae4c-f2641a712b79 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:20.503749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f20680-38cb-42ff-ae4c-f2641a712b79 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:20.504402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f20680-38cb-42ff-ae4c-f2641a712b79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:40:20.504705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f20680-38cb-42ff-ae4c-f2641a712b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:20.506058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f20680-38cb-42ff-ae4c-f2641a712b79 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:20.514361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 600/1196] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:20.520098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c287836-aa8d-4f73-bca2-b570cf75516b None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:20.616465 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c287836-aa8d-4f73-bca2-b570cf75516b None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:20.625580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:20.649515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9f3f2-ac28-4e37-a7e1-79c0a381ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:20.650131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9f3f2-ac28-4e37-a7e1-79c0a381ed9c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:20.650406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9f3f2-ac28-4e37-a7e1-79c0a381ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:20.650674 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9f3f2-ac28-4e37-a7e1-79c0a381ed9c None admin] PATH_INFO: `/v3/users/4fbc19eca0c9479bbcd63b528ef18e0b` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:20.651791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9f3f2-ac28-4e37-a7e1-79c0a381ed9c None admin] RBAC: Authorizing `identity:get_user(user_id=4fbc19eca0c9479bbcd63b528ef18e0b)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:20.653209 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9f3f2-ac28-4e37-a7e1-79c0a381ed9c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:20.654818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 597/1197] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Aug 29 23:40:20 2022] GET /identity/v3/users/4fbc19eca0c9479bbcd63b528ef18e0b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:20.660678 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f20680-38cb-42ff-ae4c-f2641a712b79 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:20.760397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f20680-38cb-42ff-ae4c-f2641a712b79 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:20.793018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765f15d-0dad-470c-bfb1-21516c8ee158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:20.793618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765f15d-0dad-470c-bfb1-21516c8ee158 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:20.793900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765f15d-0dad-470c-bfb1-21516c8ee158 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:20.794175 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765f15d-0dad-470c-bfb1-21516c8ee158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:20.821102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:20.859767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765f15d-0dad-470c-bfb1-21516c8ee158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:20.861207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765f15d-0dad-470c-bfb1-21516c8ee158 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:20.956675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 601/1198] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:40:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:40:20.962596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9f3f2-ac28-4e37-a7e1-79c0a381ed9c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:21.058497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9f3f2-ac28-4e37-a7e1-79c0a381ed9c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:21.089897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fe4f9-5bc1-4549-8409-72bd3677e8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:21.090506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe4f9-5bc1-4549-8409-72bd3677e8cd None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:21.090781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe4f9-5bc1-4549-8409-72bd3677e8cd None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:21.091083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe4f9-5bc1-4549-8409-72bd3677e8cd None admin] PATH_INFO: `/v3/projects/28389e8ba89f488fa2507ac34be0f157` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:21.092168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fe4f9-5bc1-4549-8409-72bd3677e8cd None admin] RBAC: Authorizing `identity:get_project(project_id=28389e8ba89f488fa2507ac34be0f157)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:21.093589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fe4f9-5bc1-4549-8409-72bd3677e8cd None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:21.095200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 598/1199] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Aug 29 23:40:20 2022] GET /identity/v3/projects/28389e8ba89f488fa2507ac34be0f157 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:21.101296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765f15d-0dad-470c-bfb1-21516c8ee158 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:40:21.159150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:21.198785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765f15d-0dad-470c-bfb1-21516c8ee158 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:40:21.233126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fe569-6b2a-45a1-8f94-f58262276e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:40:21.233719 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe569-6b2a-45a1-8f94-f58262276e02 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:40:21.234001 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe569-6b2a-45a1-8f94-f58262276e02 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:40:21.234275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe569-6b2a-45a1-8f94-f58262276e02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:40:21.235017 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fe569-6b2a-45a1-8f94-f58262276e02 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=28389e8ba89f488fa2507ac34be0f157, user.id=4fbc19eca0c9479bbcd63b528ef18e0b) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:40:21.235333 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fe569-6b2a-45a1-8f94-f58262276e02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:40:21.236750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fe569-6b2a-45a1-8f94-f58262276e02 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:40:21.242308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 602/1200] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:40:21 2022] GET /identity/v3/role_assignments?user.id=4fbc19eca0c9479bbcd63b528ef18e0b&scope.project.id=28389e8ba89f488fa2507ac34be0f157&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:40:31.086213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=78 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:40:31.239809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=38 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:33.518174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b084f-230c-4d39-b8b2-33f32ea80d43 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:33.518783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b084f-230c-4d39-b8b2-33f32ea80d43 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:33.518783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b084f-230c-4d39-b8b2-33f32ea80d43 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:33.520096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 599/1201] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:33.525202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86385a0-447c-4173-a2a2-be2ff702a33a None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:33.525691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86385a0-447c-4173-a2a2-be2ff702a33a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:33.525854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86385a0-447c-4173-a2a2-be2ff702a33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:33.544367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-b86385a0-447c-4173-a2a2-be2ff702a33a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:33.545540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b86385a0-447c-4173-a2a2-be2ff702a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:33.612170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 603/1202] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:41:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:41:33.886387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b084f-230c-4d39-b8b2-33f32ea80d43 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:33.989856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b084f-230c-4d39-b8b2-33f32ea80d43 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:34.023710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f55bd-b69d-4f7b-ab51-7d66dc710579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:34.024337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f55bd-b69d-4f7b-ab51-7d66dc710579 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:34.024620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f55bd-b69d-4f7b-ab51-7d66dc710579 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:34.024893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f55bd-b69d-4f7b-ab51-7d66dc710579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:34.034899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f55bd-b69d-4f7b-ab51-7d66dc710579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:34.036369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f55bd-b69d-4f7b-ab51-7d66dc710579 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-7d4f55bd-b69d-4f7b-ab51-7d66dc710579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:34.051686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:34.053544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:34.059290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:34.059290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:34.059290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:34.059290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 600/1203] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:41:34.059717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86385a0-447c-4173-a2a2-be2ff702a33a None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:34.157386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86385a0-447c-4173-a2a2-be2ff702a33a None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:34.186415 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:34.192007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fdfb3-f539-4778-a4e1-5244b1503562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:34.192605 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fdfb3-f539-4778-a4e1-5244b1503562 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:34.192880 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fdfb3-f539-4778-a4e1-5244b1503562 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:34.193157 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fdfb3-f539-4778-a4e1-5244b1503562 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:34.193790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fdfb3-f539-4778-a4e1-5244b1503562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:34.194091 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fdfb3-f539-4778-a4e1-5244b1503562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:34.195535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fdfb3-f539-4778-a4e1-5244b1503562 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:34.207545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 604/1204] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:34.213390 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f55bd-b69d-4f7b-ab51-7d66dc710579 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:34.266163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:34.312867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f55bd-b69d-4f7b-ab51-7d66dc710579 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:34.344547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723cdf8-e7ea-443b-9917-fee522368792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:34.345147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723cdf8-e7ea-443b-9917-fee522368792 None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:34.345428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723cdf8-e7ea-443b-9917-fee522368792 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:34.345701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723cdf8-e7ea-443b-9917-fee522368792 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:34.346343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723cdf8-e7ea-443b-9917-fee522368792 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:34.347827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723cdf8-e7ea-443b-9917-fee522368792 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:34.499944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 601/1205] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Aug 29 23:41:34 2022] POST /identity/v3/users => generated 251 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:36.420196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8dca3-4f92-45d5-930e-398c87b5fff7 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.420739 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8dca3-4f92-45d5-930e-398c87b5fff7 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.420739 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8dca3-4f92-45d5-930e-398c87b5fff7 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.422203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 605/1206] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:36.427393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab17704-a691-44c5-bc53-7e19f45fb5ca None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.428148 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab17704-a691-44c5-bc53-7e19f45fb5ca None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.428148 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab17704-a691-44c5-bc53-7e19f45fb5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.445792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4ab17704-a691-44c5-bc53-7e19f45fb5ca None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:36.447522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4ab17704-a691-44c5-bc53-7e19f45fb5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:36.511845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 602/1207] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:41:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:41:36.784000 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8dca3-4f92-45d5-930e-398c87b5fff7 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:36.887892 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8dca3-4f92-45d5-930e-398c87b5fff7 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:36.920376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeb0e3-0933-42b6-9656-a1b5ab43eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:36.920996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeb0e3-0933-42b6-9656-a1b5ab43eedf None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.921268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeb0e3-0933-42b6-9656-a1b5ab43eedf None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.921532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeb0e3-0933-42b6-9656-a1b5ab43eedf None admin] PATH_INFO: `/v3/roles/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.932360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eeb0e3-0933-42b6-9656-a1b5ab43eedf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-65eeb0e3-0933-42b6-9656-a1b5ab43eedf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:41:36.937263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:36.938389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:36.939483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 606/1208] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:41:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:36.944539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab17704-a691-44c5-bc53-7e19f45fb5ca None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:36.983938 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:37.041581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab17704-a691-44c5-bc53-7e19f45fb5ca None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:37.076176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93d60f-7a96-479a-883e-96f3a5b26e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:37.076782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93d60f-7a96-479a-883e-96f3a5b26e59 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.077089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93d60f-7a96-479a-883e-96f3a5b26e59 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.077362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93d60f-7a96-479a-883e-96f3a5b26e59 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.078018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93d60f-7a96-479a-883e-96f3a5b26e59 None admin] RBAC: Adding query filter params (name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:37.078321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93d60f-7a96-479a-883e-96f3a5b26e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:37.079711 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93d60f-7a96-479a-883e-96f3a5b26e59 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:37.087514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 603/1209] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:41:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:37.093353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeb0e3-0933-42b6-9656-a1b5ab43eedf None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:37.142938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:37.190696 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeb0e3-0933-42b6-9656-a1b5ab43eedf None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:37.222905 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd21fa-c6c1-4743-8280-9cb20340f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:37.223565 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd21fa-c6c1-4743-8280-9cb20340f17a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.223848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd21fa-c6c1-4743-8280-9cb20340f17a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.224122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd21fa-c6c1-4743-8280-9cb20340f17a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.235266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd21fa-c6c1-4743-8280-9cb20340f17a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:37.236706 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd21fa-c6c1-4743-8280-9cb20340f17a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-0acd21fa-c6c1-4743-8280-9cb20340f17a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:37.252688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:37.253822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:37.255112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:37.255112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:37.255112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:37.255112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 607/1210] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:37.259774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93d60f-7a96-479a-883e-96f3a5b26e59 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:37.357999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:37.360896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93d60f-7a96-479a-883e-96f3a5b26e59 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:37.393703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246d408-53ac-441b-b66f-51498553dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:37.394298 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d408-53ac-441b-b66f-51498553dff2 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.394576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d408-53ac-441b-b66f-51498553dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.394846 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d408-53ac-441b-b66f-51498553dff2 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.395512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246d408-53ac-441b-b66f-51498553dff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:37.395810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246d408-53ac-441b-b66f-51498553dff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:37.397160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246d408-53ac-441b-b66f-51498553dff2 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:37.408094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 604/1211] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:37.413849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd21fa-c6c1-4743-8280-9cb20340f17a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:37.513816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd21fa-c6c1-4743-8280-9cb20340f17a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:37.515351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:37.548584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7794f-6119-4e2f-a8bc-647097469aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:37.549217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7794f-6119-4e2f-a8bc-647097469aac None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.549497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7794f-6119-4e2f-a8bc-647097469aac None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.549770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7794f-6119-4e2f-a8bc-647097469aac None admin] PATH_INFO: `/v3/users/placement` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.558153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7794f-6119-4e2f-a8bc-647097469aac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:37.559940 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7794f-6119-4e2f-a8bc-647097469aac None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-9af7794f-6119-4e2f-a8bc-647097469aac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:41:37.571523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:37.572666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:37.573869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:37.573869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:37.573869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:41:37.573869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:41:37.573869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:41:37.573869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:41:37.573869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:41:37.573869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:41:37.573869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:41:37.573869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:37.573869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 608/1212] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:37.578637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246d408-53ac-441b-b66f-51498553dff2 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:37.682481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246d408-53ac-441b-b66f-51498553dff2 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:37.718674 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97740f-04d2-4677-9635-66f8a7564601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:37.719314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97740f-04d2-4677-9635-66f8a7564601 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.720101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97740f-04d2-4677-9635-66f8a7564601 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.720101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97740f-04d2-4677-9635-66f8a7564601 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.720632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97740f-04d2-4677-9635-66f8a7564601 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:37.720936 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97740f-04d2-4677-9635-66f8a7564601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:37.722350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97740f-04d2-4677-9635-66f8a7564601 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:37.740415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 605/1213] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Aug 29 23:41:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:37.746908 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7794f-6119-4e2f-a8bc-647097469aac None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:37.846217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7794f-6119-4e2f-a8bc-647097469aac None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:37.878806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58075a5d-7f03-4cb5-8351-4f9414e17a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:37.879453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58075a5d-7f03-4cb5-8351-4f9414e17a71 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.879730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58075a5d-7f03-4cb5-8351-4f9414e17a71 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.879999 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58075a5d-7f03-4cb5-8351-4f9414e17a71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.908994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:37.946937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58075a5d-7f03-4cb5-8351-4f9414e17a71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:37.948333 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58075a5d-7f03-4cb5-8351-4f9414e17a71 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:38.051290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 609/1214] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:41:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:41:38.057923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97740f-04d2-4677-9635-66f8a7564601 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:38.077058 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:38.158366 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97740f-04d2-4677-9635-66f8a7564601 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:38.192597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b02d8-cdd5-46a7-b5d7-43c392a20c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:38.196248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b02d8-cdd5-46a7-b5d7-43c392a20c55 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:38.196248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b02d8-cdd5-46a7-b5d7-43c392a20c55 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:38.196248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b02d8-cdd5-46a7-b5d7-43c392a20c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:38.203983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b02d8-cdd5-46a7-b5d7-43c392a20c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:38.205333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b02d8-cdd5-46a7-b5d7-43c392a20c55 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-d98b02d8-cdd5-46a7-b5d7-43c392a20c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:38.219972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:38.221072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:38.222136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:38.222136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:38.222136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:38.222136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 606/1215] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:38.227093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58075a5d-7f03-4cb5-8351-4f9414e17a71 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:38.287588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:38.325135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58075a5d-7f03-4cb5-8351-4f9414e17a71 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:38.358919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5029cd5-150b-4953-8f8a-ea0807302f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:38.373463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5029cd5-150b-4953-8f8a-ea0807302f9f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:38.373463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5029cd5-150b-4953-8f8a-ea0807302f9f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:38.373463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5029cd5-150b-4953-8f8a-ea0807302f9f None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:38.373463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5029cd5-150b-4953-8f8a-ea0807302f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:38.373463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5029cd5-150b-4953-8f8a-ea0807302f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:38.373463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5029cd5-150b-4953-8f8a-ea0807302f9f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:38.373978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 610/1216] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:41:38.379015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b02d8-cdd5-46a7-b5d7-43c392a20c55 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:38.448082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:38.479214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b02d8-cdd5-46a7-b5d7-43c392a20c55 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:38.511210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e26ec1-c174-4657-99c4-622425d3993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:38.511838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e26ec1-c174-4657-99c4-622425d3993c None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:38.512113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e26ec1-c174-4657-99c4-622425d3993c None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:38.512379 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e26ec1-c174-4657-99c4-622425d3993c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:38.519070 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e26ec1-c174-4657-99c4-622425d3993c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:38.520491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e26ec1-c174-4657-99c4-622425d3993c None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-85e26ec1-c174-4657-99c4-622425d3993c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:41:38.532194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:38.533267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:38.534419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:41:38.534419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:41:38.534419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:41:38.534419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:41:38.534419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:41:38.534419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:41:38.534419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:41:38.534419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:38.534419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 607/1217] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:41:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:38.539301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5029cd5-150b-4953-8f8a-ea0807302f9f None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:38.637843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5029cd5-150b-4953-8f8a-ea0807302f9f None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:38.660422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:38.672531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24fe6d-d124-4373-8e4d-2f85f89cd5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:38.673137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24fe6d-d124-4373-8e4d-2f85f89cd5fd None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:38.673439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24fe6d-d124-4373-8e4d-2f85f89cd5fd None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:38.673716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24fe6d-d124-4373-8e4d-2f85f89cd5fd None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:38.674468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24fe6d-d124-4373-8e4d-2f85f89cd5fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:38.674775 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24fe6d-d124-4373-8e4d-2f85f89cd5fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:38.676315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24fe6d-d124-4373-8e4d-2f85f89cd5fd None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:38.688155 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 611/1218] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:41:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:38.694324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e26ec1-c174-4657-99c4-622425d3993c None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:38.797638 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e26ec1-c174-4657-99c4-622425d3993c None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:38.825117 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:38.830448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c36e92-6648-4f72-91cc-4c804f4be8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:38.831077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36e92-6648-4f72-91cc-4c804f4be8ef None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:38.831354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36e92-6648-4f72-91cc-4c804f4be8ef None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:38.831623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36e92-6648-4f72-91cc-4c804f4be8ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:38.832333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c36e92-6648-4f72-91cc-4c804f4be8ef None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=ce79452e14fa4984875dca43672ed25a) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:38.832637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c36e92-6648-4f72-91cc-4c804f4be8ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:38.834077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c36e92-6648-4f72-91cc-4c804f4be8ef None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:38.839769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 608/1219] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:41:38 2022] GET /identity/v3/role_assignments?user.id=ce79452e14fa4984875dca43672ed25a&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:40.732891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9de6f6-57c2-4d99-a754-743bff69fd0f None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:40.733439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9de6f6-57c2-4d99-a754-743bff69fd0f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:40.733536 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9de6f6-57c2-4d99-a754-743bff69fd0f None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:40.734854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 612/1220] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:40.740157 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02e6ea-8c4b-4c6a-81d6-f9a0bf185696 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:40.740584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02e6ea-8c4b-4c6a-81d6-f9a0bf185696 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:40.740705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02e6ea-8c4b-4c6a-81d6-f9a0bf185696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:40.758554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-af02e6ea-8c4b-4c6a-81d6-f9a0bf185696 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:40.759819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-af02e6ea-8c4b-4c6a-81d6-f9a0bf185696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:40.824828 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 609/1221] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:41:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:41:41.094159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9de6f6-57c2-4d99-a754-743bff69fd0f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:41.195476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9de6f6-57c2-4d99-a754-743bff69fd0f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:41.229156 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9b971-d433-4afb-a001-480d2ce8be29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:41.229782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9b971-d433-4afb-a001-480d2ce8be29 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:41.230062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9b971-d433-4afb-a001-480d2ce8be29 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:41.230339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9b971-d433-4afb-a001-480d2ce8be29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:41.240627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9b971-d433-4afb-a001-480d2ce8be29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-40d9b971-d433-4afb-a001-480d2ce8be29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:41:41.246165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:41.247330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:41.248581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 613/1222] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:41:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:41.253301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02e6ea-8c4b-4c6a-81d6-f9a0bf185696 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:41.349782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02e6ea-8c4b-4c6a-81d6-f9a0bf185696 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:41.374845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:41.385296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c425d01-7318-4710-a863-a12e22cc1bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:41.385904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c425d01-7318-4710-a863-a12e22cc1bcd None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:41.386183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c425d01-7318-4710-a863-a12e22cc1bcd None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:41.386452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c425d01-7318-4710-a863-a12e22cc1bcd None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:41.387147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c425d01-7318-4710-a863-a12e22cc1bcd None admin] RBAC: Adding query filter params (name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:41.387449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c425d01-7318-4710-a863-a12e22cc1bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:41.388860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c425d01-7318-4710-a863-a12e22cc1bcd None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:41.396709 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 610/1223] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:41:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:41.403385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9b971-d433-4afb-a001-480d2ce8be29 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:41.448080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:41.503693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9b971-d433-4afb-a001-480d2ce8be29 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:41.535852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3474c-43ba-4816-af44-1b213fa9e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:41.536460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3474c-43ba-4816-af44-1b213fa9e321 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:41.536739 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3474c-43ba-4816-af44-1b213fa9e321 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:41.537005 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3474c-43ba-4816-af44-1b213fa9e321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:41.548535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3474c-43ba-4816-af44-1b213fa9e321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:41.552751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3474c-43ba-4816-af44-1b213fa9e321 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-0fd3474c-43ba-4816-af44-1b213fa9e321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:41.564076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:41.565215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:41.566296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:41.566296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:41.566296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:41.566296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 614/1224] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:41.571017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c425d01-7318-4710-a863-a12e22cc1bcd None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:41.672798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c425d01-7318-4710-a863-a12e22cc1bcd None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:41.705578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01810dd2-f843-4d74-b2e0-1c262544eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:41.707999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01810dd2-f843-4d74-b2e0-1c262544eced None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:41.707999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01810dd2-f843-4d74-b2e0-1c262544eced None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:41.707999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01810dd2-f843-4d74-b2e0-1c262544eced None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:41.707999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01810dd2-f843-4d74-b2e0-1c262544eced None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:41.707999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01810dd2-f843-4d74-b2e0-1c262544eced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:41.708991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01810dd2-f843-4d74-b2e0-1c262544eced None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:41.721408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 611/1225] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:41.727476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3474c-43ba-4816-af44-1b213fa9e321 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:41.823742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:41.830575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3474c-43ba-4816-af44-1b213fa9e321 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:41.864333 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ff794-5f6d-4fa3-b54d-17f388f58ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:41.864956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ff794-5f6d-4fa3-b54d-17f388f58ae9 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:41.865237 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ff794-5f6d-4fa3-b54d-17f388f58ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:41.865506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ff794-5f6d-4fa3-b54d-17f388f58ae9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:41.872787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ff794-5f6d-4fa3-b54d-17f388f58ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:41.874261 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ff794-5f6d-4fa3-b54d-17f388f58ae9 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-ce8ff794-5f6d-4fa3-b54d-17f388f58ae9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:41:41.886082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:41.887099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:41.888341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:41.888341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:41.888341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:41:41.888341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:41:41.888341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:41:41.888341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:41:41.888341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:41:41.888341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:41:41.888341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:41:41.888341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:41.888341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 615/1226] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:41.893441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01810dd2-f843-4d74-b2e0-1c262544eced None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:41.941705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:41.993601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01810dd2-f843-4d74-b2e0-1c262544eced None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:42.026923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14fe34-8009-4eab-b38c-86062603c2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:42.027525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14fe34-8009-4eab-b38c-86062603c2a7 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:42.027799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14fe34-8009-4eab-b38c-86062603c2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:42.028063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14fe34-8009-4eab-b38c-86062603c2a7 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:42.028778 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14fe34-8009-4eab-b38c-86062603c2a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:42.029075 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14fe34-8009-4eab-b38c-86062603c2a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:42.030467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14fe34-8009-4eab-b38c-86062603c2a7 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:42.047432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 612/1227] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Aug 29 23:41:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:42.052986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ff794-5f6d-4fa3-b54d-17f388f58ae9 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:42.152403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ff794-5f6d-4fa3-b54d-17f388f58ae9 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:42.186265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80382c-60e6-44f0-8603-cc65cc3780bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:42.186926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80382c-60e6-44f0-8603-cc65cc3780bf None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:42.187211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80382c-60e6-44f0-8603-cc65cc3780bf None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:42.187484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80382c-60e6-44f0-8603-cc65cc3780bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:42.198943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80382c-60e6-44f0-8603-cc65cc3780bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:42.200378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80382c-60e6-44f0-8603-cc65cc3780bf None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-3b80382c-60e6-44f0-8603-cc65cc3780bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:42.214374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:42.215570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:42.216679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:42.216679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:42.216679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:42.216679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 616/1228] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:42.221749 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14fe34-8009-4eab-b38c-86062603c2a7 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:42.320972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14fe34-8009-4eab-b38c-86062603c2a7 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:42.323979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:42.355598 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52688e7d-e1e6-4917-afbf-7cd8863969c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:42.356203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52688e7d-e1e6-4917-afbf-7cd8863969c5 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:42.356481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52688e7d-e1e6-4917-afbf-7cd8863969c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:42.356751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52688e7d-e1e6-4917-afbf-7cd8863969c5 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:42.357381 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52688e7d-e1e6-4917-afbf-7cd8863969c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:42.357683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52688e7d-e1e6-4917-afbf-7cd8863969c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:42.359108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52688e7d-e1e6-4917-afbf-7cd8863969c5 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:42.370483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 613/1229] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:42.376840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80382c-60e6-44f0-8603-cc65cc3780bf None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:42.386435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:42.477522 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80382c-60e6-44f0-8603-cc65cc3780bf None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:42.511867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b6086-95f1-4a0c-b2c0-b5441e0dce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:42.512489 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b6086-95f1-4a0c-b2c0-b5441e0dce3d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:42.512854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b6086-95f1-4a0c-b2c0-b5441e0dce3d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:42.513123 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b6086-95f1-4a0c-b2c0-b5441e0dce3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:42.519682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b6086-95f1-4a0c-b2c0-b5441e0dce3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:42.521113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b6086-95f1-4a0c-b2c0-b5441e0dce3d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-866b6086-95f1-4a0c-b2c0-b5441e0dce3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:41:42.532241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:42.533301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:42.534614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:41:42.534614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:41:42.534614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:41:42.534614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:41:42.534614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:41:42.534614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:41:42.534614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:41:42.534614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:42.534614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 617/1230] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:42.539308 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52688e7d-e1e6-4917-afbf-7cd8863969c5 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:42.640104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52688e7d-e1e6-4917-afbf-7cd8863969c5 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:42.674101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67fd0b-ea7e-4ef1-b4ff-32d1c2ae84e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:42.674707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67fd0b-ea7e-4ef1-b4ff-32d1c2ae84e5 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:42.675085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67fd0b-ea7e-4ef1-b4ff-32d1c2ae84e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:42.675361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67fd0b-ea7e-4ef1-b4ff-32d1c2ae84e5 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:42.676046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67fd0b-ea7e-4ef1-b4ff-32d1c2ae84e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:42.676351 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67fd0b-ea7e-4ef1-b4ff-32d1c2ae84e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:42.677757 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67fd0b-ea7e-4ef1-b4ff-32d1c2ae84e5 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:42.690301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 614/1231] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:42.696365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b6086-95f1-4a0c-b2c0-b5441e0dce3d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:42.764055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:42.797620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b6086-95f1-4a0c-b2c0-b5441e0dce3d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:42.830003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12c561-6021-4d3a-9109-8b6ef77d6dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:42.830650 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12c561-6021-4d3a-9109-8b6ef77d6dee None admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:42.830952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12c561-6021-4d3a-9109-8b6ef77d6dee None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:42.831224 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12c561-6021-4d3a-9109-8b6ef77d6dee None admin] PATH_INFO: `/v3/projects/da13e1cbae664d5a92198052526ee459/users/ce79452e14fa4984875dca43672ed25a/roles/ec4f9fa2b3e6483f97993b78c43ea7a4` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:42.845486 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12c561-6021-4d3a-9109-8b6ef77d6dee None admin] RBAC: Authorizing `identity:create_grant(project_id=da13e1cbae664d5a92198052526ee459, user_id=ce79452e14fa4984875dca43672ed25a, role_id=ec4f9fa2b3e6483f97993b78c43ea7a4)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:42.846967 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12c561-6021-4d3a-9109-8b6ef77d6dee None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:42.961171 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 618/1232] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:41:42 2022] PUT /identity/v3/projects/da13e1cbae664d5a92198052526ee459/users/ce79452e14fa4984875dca43672ed25a/roles/ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:44.876008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33110ee7-563a-4bcd-a45f-f26763fe5fc5 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:44.876521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33110ee7-563a-4bcd-a45f-f26763fe5fc5 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:44.876630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33110ee7-563a-4bcd-a45f-f26763fe5fc5 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:44.877892 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 615/1233] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:41:44.883110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b393d-f4ea-4eb9-abb4-a938533b6e74 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:44.883512 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b393d-f4ea-4eb9-abb4-a938533b6e74 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:44.883651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b393d-f4ea-4eb9-abb4-a938533b6e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:44.902613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-ce2b393d-f4ea-4eb9-abb4-a938533b6e74 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:44.903875 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ce2b393d-f4ea-4eb9-abb4-a938533b6e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:44.969564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 619/1234] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:41:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:41:45.242544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33110ee7-563a-4bcd-a45f-f26763fe5fc5 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:45.267737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:45.346157 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33110ee7-563a-4bcd-a45f-f26763fe5fc5 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:45.379035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008c418-04f8-46fd-82cc-f8a48bdbd893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:45.379654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008c418-04f8-46fd-82cc-f8a48bdbd893 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:45.379931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008c418-04f8-46fd-82cc-f8a48bdbd893 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:45.380197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008c418-04f8-46fd-82cc-f8a48bdbd893 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:45.389942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008c418-04f8-46fd-82cc-f8a48bdbd893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-f008c418-04f8-46fd-82cc-f8a48bdbd893 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:41:45.394688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:45.395879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:45.396997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 616/1235] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Aug 29 23:41:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:45.402648 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b393d-f4ea-4eb9-abb4-a938533b6e74 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:45.450267 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:45.501996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b393d-f4ea-4eb9-abb4-a938533b6e74 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:45.535212 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46321f0-85b2-44bb-87cf-094ff86d2e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:45.535808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46321f0-85b2-44bb-87cf-094ff86d2e0b None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:45.536083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46321f0-85b2-44bb-87cf-094ff86d2e0b None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:45.536350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46321f0-85b2-44bb-87cf-094ff86d2e0b None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:45.537037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46321f0-85b2-44bb-87cf-094ff86d2e0b None admin] RBAC: Adding query filter params (name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:45.537328 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46321f0-85b2-44bb-87cf-094ff86d2e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:45.538684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46321f0-85b2-44bb-87cf-094ff86d2e0b None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:45.546869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 620/1236] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Aug 29 23:41:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:45.552892 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008c418-04f8-46fd-82cc-f8a48bdbd893 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:45.638251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:45.654717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008c418-04f8-46fd-82cc-f8a48bdbd893 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:45.688025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ad8fc-a37f-4ac8-8664-68890c88ee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:45.688655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ad8fc-a37f-4ac8-8664-68890c88ee84 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:45.688935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ad8fc-a37f-4ac8-8664-68890c88ee84 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:45.689204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ad8fc-a37f-4ac8-8664-68890c88ee84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:45.699491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ad8fc-a37f-4ac8-8664-68890c88ee84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:45.700908 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ad8fc-a37f-4ac8-8664-68890c88ee84 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-2d9ad8fc-a37f-4ac8-8664-68890c88ee84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:45.715878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:45.720458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:45.721556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:45.721556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:45.721556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:45.721556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 617/1237] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:45.723232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46321f0-85b2-44bb-87cf-094ff86d2e0b None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:45.824361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46321f0-85b2-44bb-87cf-094ff86d2e0b None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:45.832834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:45.856813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb285d4-0dde-485a-b7db-c840fb4e2744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:45.857473 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb285d4-0dde-485a-b7db-c840fb4e2744 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:45.857750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb285d4-0dde-485a-b7db-c840fb4e2744 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:45.858019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb285d4-0dde-485a-b7db-c840fb4e2744 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:45.858645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb285d4-0dde-485a-b7db-c840fb4e2744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:45.859098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb285d4-0dde-485a-b7db-c840fb4e2744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:45.860454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb285d4-0dde-485a-b7db-c840fb4e2744 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:45.872295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 621/1238] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:45.877986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ad8fc-a37f-4ac8-8664-68890c88ee84 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:45.977115 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ad8fc-a37f-4ac8-8664-68890c88ee84 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:46.011197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c663c1-8e26-47ec-9e1b-4420e2aea566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:46.011903 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c663c1-8e26-47ec-9e1b-4420e2aea566 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:46.012183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c663c1-8e26-47ec-9e1b-4420e2aea566 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:46.012455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c663c1-8e26-47ec-9e1b-4420e2aea566 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:46.015084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:46.020015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c663c1-8e26-47ec-9e1b-4420e2aea566 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:46.021434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c663c1-8e26-47ec-9e1b-4420e2aea566 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-64c663c1-8e26-47ec-9e1b-4420e2aea566 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:41:46.032300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:46.036393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:46.037577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:46.037577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:46.037577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:41:46.037577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:41:46.037577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:41:46.037577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:41:46.037577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:41:46.037577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:41:46.037577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:41:46.037577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:46.037577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 618/1239] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:46.039216 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb285d4-0dde-485a-b7db-c840fb4e2744 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:46.138112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb285d4-0dde-485a-b7db-c840fb4e2744 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:46.171531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a595b4b-ff95-4b36-a160-6f3d3dc22697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:46.172130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a595b4b-ff95-4b36-a160-6f3d3dc22697 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:46.172412 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a595b4b-ff95-4b36-a160-6f3d3dc22697 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:46.172687 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a595b4b-ff95-4b36-a160-6f3d3dc22697 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:46.173403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a595b4b-ff95-4b36-a160-6f3d3dc22697 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:46.173710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a595b4b-ff95-4b36-a160-6f3d3dc22697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:46.175163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a595b4b-ff95-4b36-a160-6f3d3dc22697 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:46.193562 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 622/1240] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Aug 29 23:41:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:46.199491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c663c1-8e26-47ec-9e1b-4420e2aea566 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:46.300878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c663c1-8e26-47ec-9e1b-4420e2aea566 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:46.334074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a61dae-4143-45ff-8ad7-b6c6709694a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:46.334675 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61dae-4143-45ff-8ad7-b6c6709694a4 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:46.334984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61dae-4143-45ff-8ad7-b6c6709694a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:46.335262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61dae-4143-45ff-8ad7-b6c6709694a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:46.398068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:46.404668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a61dae-4143-45ff-8ad7-b6c6709694a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:46.406214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a61dae-4143-45ff-8ad7-b6c6709694a4 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:46.504056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 619/1241] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:41:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:41:46.509956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a595b4b-ff95-4b36-a160-6f3d3dc22697 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:46.536129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:46.607766 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a595b4b-ff95-4b36-a160-6f3d3dc22697 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:46.640605 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275f392-0b27-481c-9707-eb0449ced8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:46.641233 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275f392-0b27-481c-9707-eb0449ced8ef None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:46.641511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275f392-0b27-481c-9707-eb0449ced8ef None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:46.641787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275f392-0b27-481c-9707-eb0449ced8ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:46.667755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275f392-0b27-481c-9707-eb0449ced8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:46.667755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275f392-0b27-481c-9707-eb0449ced8ef None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-4275f392-0b27-481c-9707-eb0449ced8ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:46.668170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:46.669262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:46.670645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:46.670645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:46.670645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:46.670645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 623/1242] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:46.675207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a61dae-4143-45ff-8ad7-b6c6709694a4 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:46.770072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:46.776488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a61dae-4143-45ff-8ad7-b6c6709694a4 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:46.809631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27335892-0328-4ed5-8abf-64d0d064c87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:46.810230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27335892-0328-4ed5-8abf-64d0d064c87e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:46.810506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27335892-0328-4ed5-8abf-64d0d064c87e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:46.810777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27335892-0328-4ed5-8abf-64d0d064c87e None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:46.811527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27335892-0328-4ed5-8abf-64d0d064c87e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:46.811858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27335892-0328-4ed5-8abf-64d0d064c87e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:46.813172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27335892-0328-4ed5-8abf-64d0d064c87e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:46.824297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 620/1243] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:46.830149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275f392-0b27-481c-9707-eb0449ced8ef None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:46.909208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:46.930237 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275f392-0b27-481c-9707-eb0449ced8ef None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:46.963220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e354b-1f54-48dc-95c4-012be9d5f9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:46.963842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e354b-1f54-48dc-95c4-012be9d5f9c8 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:46.964125 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e354b-1f54-48dc-95c4-012be9d5f9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:46.964402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e354b-1f54-48dc-95c4-012be9d5f9c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:46.970909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e354b-1f54-48dc-95c4-012be9d5f9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:46.972383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e354b-1f54-48dc-95c4-012be9d5f9c8 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-868e354b-1f54-48dc-95c4-012be9d5f9c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:41:46.983714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:46.984790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:46.985800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:41:46.985800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:41:46.985800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:41:46.985800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:41:46.985800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:41:46.985800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:41:46.985800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:41:46.985800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:46.985800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 624/1244] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:41:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:46.990693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27335892-0328-4ed5-8abf-64d0d064c87e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:47.089426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27335892-0328-4ed5-8abf-64d0d064c87e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:47.122354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b2e39-882e-4522-9551-ce538b95aa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:47.123037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b2e39-882e-4522-9551-ce538b95aa30 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:47.123339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b2e39-882e-4522-9551-ce538b95aa30 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:47.123608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b2e39-882e-4522-9551-ce538b95aa30 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:47.124288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b2e39-882e-4522-9551-ce538b95aa30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:47.124588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b2e39-882e-4522-9551-ce538b95aa30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:47.126062 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b2e39-882e-4522-9551-ce538b95aa30 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:47.138202 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 621/1245] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:41:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:47.144406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e354b-1f54-48dc-95c4-012be9d5f9c8 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:47.243308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e354b-1f54-48dc-95c4-012be9d5f9c8 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:47.276449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a42ab2-b04c-48d6-a998-53bfb4f3c4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:47.277040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a42ab2-b04c-48d6-a998-53bfb4f3c4f3 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:47.277319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a42ab2-b04c-48d6-a998-53bfb4f3c4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:47.277590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a42ab2-b04c-48d6-a998-53bfb4f3c4f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:47.278306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a42ab2-b04c-48d6-a998-53bfb4f3c4f3 None admin] RBAC: Adding query filter params (role.id=ec4f9fa2b3e6483f97993b78c43ea7a4, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=ce79452e14fa4984875dca43672ed25a) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:47.278610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a42ab2-b04c-48d6-a998-53bfb4f3c4f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:47.280061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a42ab2-b04c-48d6-a998-53bfb4f3c4f3 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:47.285899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 625/1246] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:41:47 2022] GET /identity/v3/role_assignments?user.id=ce79452e14fa4984875dca43672ed25a&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=ec4f9fa2b3e6483f97993b78c43ea7a4 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:41:49.254598 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960849fb-5bd3-45d4-a629-83da19e9a0ce None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:49.255151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960849fb-5bd3-45d4-a629-83da19e9a0ce None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:49.255151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960849fb-5bd3-45d4-a629-83da19e9a0ce None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:49.256474 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 622/1247] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:49.262438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef1dcc-f3bd-4a37-9c16-0433500c01ae None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:49.262861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef1dcc-f3bd-4a37-9c16-0433500c01ae None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:49.263016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef1dcc-f3bd-4a37-9c16-0433500c01ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:49.269287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:49.282050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-1cef1dcc-f3bd-4a37-9c16-0433500c01ae None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:49.283288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1cef1dcc-f3bd-4a37-9c16-0433500c01ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:49.348381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 626/1248] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:41:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:41:49.618111 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960849fb-5bd3-45d4-a629-83da19e9a0ce None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:49.637217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:49.718696 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960849fb-5bd3-45d4-a629-83da19e9a0ce None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:49.753566 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad88ab-ecd3-4e63-b988-d2dcb6efa5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:49.754190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad88ab-ecd3-4e63-b988-d2dcb6efa5e3 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:49.754464 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad88ab-ecd3-4e63-b988-d2dcb6efa5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:49.754731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad88ab-ecd3-4e63-b988-d2dcb6efa5e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:49.765427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad88ab-ecd3-4e63-b988-d2dcb6efa5e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-caad88ab-ecd3-4e63-b988-d2dcb6efa5e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:41:49.770158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:49.771336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:49.772172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 623/1249] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:41:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:49.777230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef1dcc-f3bd-4a37-9c16-0433500c01ae None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:49.873168 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef1dcc-f3bd-4a37-9c16-0433500c01ae None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:49.902481 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:49.907440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ecfe0-e4e1-4d3d-815c-dd888c087999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:49.908053 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ecfe0-e4e1-4d3d-815c-dd888c087999 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:49.908337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ecfe0-e4e1-4d3d-815c-dd888c087999 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:49.908613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ecfe0-e4e1-4d3d-815c-dd888c087999 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:49.909303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ecfe0-e4e1-4d3d-815c-dd888c087999 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:49.909608 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ecfe0-e4e1-4d3d-815c-dd888c087999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:49.910997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ecfe0-e4e1-4d3d-815c-dd888c087999 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:49.919418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 627/1250] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:41:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:49.925124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad88ab-ecd3-4e63-b988-d2dcb6efa5e3 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:50.001574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:50.023633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad88ab-ecd3-4e63-b988-d2dcb6efa5e3 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:50.057969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5806ce-c08d-40bb-bd12-a2d6c21ace78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:50.058598 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5806ce-c08d-40bb-bd12-a2d6c21ace78 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:50.058907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5806ce-c08d-40bb-bd12-a2d6c21ace78 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:50.059178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5806ce-c08d-40bb-bd12-a2d6c21ace78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:50.069054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5806ce-c08d-40bb-bd12-a2d6c21ace78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:50.070471 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5806ce-c08d-40bb-bd12-a2d6c21ace78 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-aa5806ce-c08d-40bb-bd12-a2d6c21ace78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:50.085410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:50.087221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:50.088609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:50.088609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:50.088609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:50.088609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 624/1251] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:50.092590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ecfe0-e4e1-4d3d-815c-dd888c087999 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:50.192771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ecfe0-e4e1-4d3d-815c-dd888c087999 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:50.224743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107b3a-8c95-4826-9d12-88cea8abc1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:50.225334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107b3a-8c95-4826-9d12-88cea8abc1fd None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:50.225610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107b3a-8c95-4826-9d12-88cea8abc1fd None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:50.225879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107b3a-8c95-4826-9d12-88cea8abc1fd None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:50.226762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc107b3a-8c95-4826-9d12-88cea8abc1fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:50.227088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc107b3a-8c95-4826-9d12-88cea8abc1fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:50.229042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc107b3a-8c95-4826-9d12-88cea8abc1fd None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:50.240343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 628/1252] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:50.246582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5806ce-c08d-40bb-bd12-a2d6c21ace78 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:50.344118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5806ce-c08d-40bb-bd12-a2d6c21ace78 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:50.370297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:50.378260 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0ee8d-c6e6-42d5-bfcc-b5fa45b42c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:50.378896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0ee8d-c6e6-42d5-bfcc-b5fa45b42c95 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:50.379184 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0ee8d-c6e6-42d5-bfcc-b5fa45b42c95 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:50.379450 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0ee8d-c6e6-42d5-bfcc-b5fa45b42c95 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:50.386824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0ee8d-c6e6-42d5-bfcc-b5fa45b42c95 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:50.388487 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0ee8d-c6e6-42d5-bfcc-b5fa45b42c95 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-59d0ee8d-c6e6-42d5-bfcc-b5fa45b42c95 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:41:50.400068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:50.406551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:50.407564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:50.407564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:50.407564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:41:50.407564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:41:50.407564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:41:50.407564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:41:50.407564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:41:50.407564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:41:50.407564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:41:50.407564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:50.407564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 625/1253] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:50.408282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107b3a-8c95-4826-9d12-88cea8abc1fd None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:50.463649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:50.508279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107b3a-8c95-4826-9d12-88cea8abc1fd None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:50.542178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21644fa8-5dfa-4dfc-8e83-92026ae84862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:50.543135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21644fa8-5dfa-4dfc-8e83-92026ae84862 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:50.543435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21644fa8-5dfa-4dfc-8e83-92026ae84862 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:50.544185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21644fa8-5dfa-4dfc-8e83-92026ae84862 None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:50.544923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21644fa8-5dfa-4dfc-8e83-92026ae84862 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:50.545235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21644fa8-5dfa-4dfc-8e83-92026ae84862 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:50.546676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21644fa8-5dfa-4dfc-8e83-92026ae84862 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:50.563645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 629/1254] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Aug 29 23:41:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:50.569651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0ee8d-c6e6-42d5-bfcc-b5fa45b42c95 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:50.669544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0ee8d-c6e6-42d5-bfcc-b5fa45b42c95 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:50.702789 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb618dd-a9fd-4c1f-a335-4f28e3e83c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:50.703413 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb618dd-a9fd-4c1f-a335-4f28e3e83c11 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:50.703693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb618dd-a9fd-4c1f-a335-4f28e3e83c11 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:50.703963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb618dd-a9fd-4c1f-a335-4f28e3e83c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:50.760797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:50.773470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb618dd-a9fd-4c1f-a335-4f28e3e83c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:50.775687 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb618dd-a9fd-4c1f-a335-4f28e3e83c11 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:50.872035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 626/1255] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:41:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:41:50.877929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21644fa8-5dfa-4dfc-8e83-92026ae84862 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:50.975217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21644fa8-5dfa-4dfc-8e83-92026ae84862 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:50.988757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:51.009706 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b47f9d-42de-4d82-b415-993a6b6a8e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:51.010330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b47f9d-42de-4d82-b415-993a6b6a8e48 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.010610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b47f9d-42de-4d82-b415-993a6b6a8e48 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.010926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b47f9d-42de-4d82-b415-993a6b6a8e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.020604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b47f9d-42de-4d82-b415-993a6b6a8e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:51.022097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b47f9d-42de-4d82-b415-993a6b6a8e48 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-45b47f9d-42de-4d82-b415-993a6b6a8e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:51.036864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:51.038252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:51.039341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:51.039341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:51.039341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:51.039341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 630/1256] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:51.043741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb618dd-a9fd-4c1f-a335-4f28e3e83c11 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:51.130830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:51.143175 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb618dd-a9fd-4c1f-a335-4f28e3e83c11 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:51.176364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6508e-2230-4d8f-9d81-1209acfee684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:51.176963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6508e-2230-4d8f-9d81-1209acfee684 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.177244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6508e-2230-4d8f-9d81-1209acfee684 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.177517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6508e-2230-4d8f-9d81-1209acfee684 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.178148 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6508e-2230-4d8f-9d81-1209acfee684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:51.178448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6508e-2230-4d8f-9d81-1209acfee684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:51.179827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6508e-2230-4d8f-9d81-1209acfee684 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:51.191786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 627/1257] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:51.197984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b47f9d-42de-4d82-b415-993a6b6a8e48 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:51.296834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b47f9d-42de-4d82-b415-993a6b6a8e48 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:51.330534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec9c32-8d2f-4b61-a175-3c7401c708b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:51.331181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9c32-8d2f-4b61-a175-3c7401c708b0 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.331462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9c32-8d2f-4b61-a175-3c7401c708b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.331735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9c32-8d2f-4b61-a175-3c7401c708b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.338292 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec9c32-8d2f-4b61-a175-3c7401c708b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:51.339760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec9c32-8d2f-4b61-a175-3c7401c708b0 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-28ec9c32-8d2f-4b61-a175-3c7401c708b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:41:51.352055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:51.354258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:51.355494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:41:51.355494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:41:51.355494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:41:51.355494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:41:51.355494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:41:51.355494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:41:51.355494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:41:51.355494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:51.355494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 631/1258] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:41:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:51.359222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6508e-2230-4d8f-9d81-1209acfee684 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:51.458495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6508e-2230-4d8f-9d81-1209acfee684 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:51.491737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16380da-bfc7-4f52-af5d-349241a67c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:51.492338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16380da-bfc7-4f52-af5d-349241a67c57 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.492619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16380da-bfc7-4f52-af5d-349241a67c57 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.492893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16380da-bfc7-4f52-af5d-349241a67c57 None admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.494195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16380da-bfc7-4f52-af5d-349241a67c57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:51.494501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16380da-bfc7-4f52-af5d-349241a67c57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:51.495962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16380da-bfc7-4f52-af5d-349241a67c57 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:51.507998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 628/1259] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:51.514179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec9c32-8d2f-4b61-a175-3c7401c708b0 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:51.539642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:51.612583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec9c32-8d2f-4b61-a175-3c7401c708b0 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:51.646512 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc00e8-e84c-4c1e-a7d9-aa3ac005f827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:51.647128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc00e8-e84c-4c1e-a7d9-aa3ac005f827 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.647462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc00e8-e84c-4c1e-a7d9-aa3ac005f827 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.649971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc00e8-e84c-4c1e-a7d9-aa3ac005f827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.649971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc00e8-e84c-4c1e-a7d9-aa3ac005f827 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=ce79452e14fa4984875dca43672ed25a) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:51.649971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc00e8-e84c-4c1e-a7d9-aa3ac005f827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:51.650245 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc00e8-e84c-4c1e-a7d9-aa3ac005f827 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:51.655414 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 632/1260] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:41:51 2022] GET /identity/v3/role_assignments?user.id=ce79452e14fa4984875dca43672ed25a&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:53.524849 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd7c37-f604-406c-8702-ed8acb7cdfc2 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:53.525376 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd7c37-f604-406c-8702-ed8acb7cdfc2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:53.525376 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd7c37-f604-406c-8702-ed8acb7cdfc2 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:53.526730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 629/1261] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:53.531886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d53ae3-3540-48b1-9676-e45344114b69 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:53.532319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d53ae3-3540-48b1-9676-e45344114b69 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:53.532460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d53ae3-3540-48b1-9676-e45344114b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:53.550980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-60d53ae3-3540-48b1-9676-e45344114b69 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:53.552198 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-60d53ae3-3540-48b1-9676-e45344114b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:53.619015 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 633/1262] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:41:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:41:53.890049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd7c37-f604-406c-8702-ed8acb7cdfc2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:53.900986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:53.991888 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd7c37-f604-406c-8702-ed8acb7cdfc2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:54.025060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4fc10-62be-406b-8163-e2fbe4914bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:54.025677 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4fc10-62be-406b-8163-e2fbe4914bbc None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:54.025957 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4fc10-62be-406b-8163-e2fbe4914bbc None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:54.026237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4fc10-62be-406b-8163-e2fbe4914bbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:54.036723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4fc10-62be-406b-8163-e2fbe4914bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-f8f4fc10-62be-406b-8163-e2fbe4914bbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:41:54.042010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:54.043345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:54.044498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 630/1263] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:41:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:54.049180 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d53ae3-3540-48b1-9676-e45344114b69 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:54.067889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:54.147610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d53ae3-3540-48b1-9676-e45344114b69 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:54.181394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbe881-d2bc-46cd-8b1d-969b3048bb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:54.182040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe881-d2bc-46cd-8b1d-969b3048bb00 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:54.182324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe881-d2bc-46cd-8b1d-969b3048bb00 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:54.182599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe881-d2bc-46cd-8b1d-969b3048bb00 None admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:54.183291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbe881-d2bc-46cd-8b1d-969b3048bb00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:54.183598 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbe881-d2bc-46cd-8b1d-969b3048bb00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:54.184968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbe881-d2bc-46cd-8b1d-969b3048bb00 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:54.192951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 634/1264] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:41:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:54.198770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4fc10-62be-406b-8163-e2fbe4914bbc None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:54.267693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:54.300258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4fc10-62be-406b-8163-e2fbe4914bbc None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:54.332464 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315541-0819-42a8-8c86-d1bf79f8f608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:54.333078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315541-0819-42a8-8c86-d1bf79f8f608 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:54.333352 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315541-0819-42a8-8c86-d1bf79f8f608 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:54.333617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315541-0819-42a8-8c86-d1bf79f8f608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:54.343947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22315541-0819-42a8-8c86-d1bf79f8f608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:54.345362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22315541-0819-42a8-8c86-d1bf79f8f608 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-22315541-0819-42a8-8c86-d1bf79f8f608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:54.360660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:54.361760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:54.362699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:54.362699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:54.362699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:54.362699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 631/1265] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:54.367566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbe881-d2bc-46cd-8b1d-969b3048bb00 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:54.448409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:54.467765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbe881-d2bc-46cd-8b1d-969b3048bb00 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:54.500338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199b6b5-57e0-4d86-954e-22bb89ee4203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:54.500937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b6b5-57e0-4d86-954e-22bb89ee4203 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:54.501217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b6b5-57e0-4d86-954e-22bb89ee4203 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:54.501488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b6b5-57e0-4d86-954e-22bb89ee4203 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:54.502145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199b6b5-57e0-4d86-954e-22bb89ee4203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:54.502448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199b6b5-57e0-4d86-954e-22bb89ee4203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:54.503839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199b6b5-57e0-4d86-954e-22bb89ee4203 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:54.515797 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 635/1266] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:54.522461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315541-0819-42a8-8c86-d1bf79f8f608 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:54.627179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315541-0819-42a8-8c86-d1bf79f8f608 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:54.647792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:54.662233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fdf76-067f-4e2f-94af-9251b2d8a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:54.662863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fdf76-067f-4e2f-94af-9251b2d8a631 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:54.663176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fdf76-067f-4e2f-94af-9251b2d8a631 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:54.663441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fdf76-067f-4e2f-94af-9251b2d8a631 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:54.671190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fdf76-067f-4e2f-94af-9251b2d8a631 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:54.672639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fdf76-067f-4e2f-94af-9251b2d8a631 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-966fdf76-067f-4e2f-94af-9251b2d8a631 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:41:54.683930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:54.687198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:54.688406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:54.688406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:54.688406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:41:54.688406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:41:54.688406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:41:54.688406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:41:54.688406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:41:54.688406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:41:54.688406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:41:54.688406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:54.688406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 632/1267] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:54.690981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199b6b5-57e0-4d86-954e-22bb89ee4203 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:54.802553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199b6b5-57e0-4d86-954e-22bb89ee4203 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:54.836546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440915b0-6637-4933-b8e6-2ff6c7fc299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:54.837680 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440915b0-6637-4933-b8e6-2ff6c7fc299f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:54.837982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440915b0-6637-4933-b8e6-2ff6c7fc299f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:54.838260 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440915b0-6637-4933-b8e6-2ff6c7fc299f None admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:54.838989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440915b0-6637-4933-b8e6-2ff6c7fc299f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:54.839300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440915b0-6637-4933-b8e6-2ff6c7fc299f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:54.840729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440915b0-6637-4933-b8e6-2ff6c7fc299f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:54.849324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:54.859259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 636/1268] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Aug 29 23:41:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:54.865253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fdf76-067f-4e2f-94af-9251b2d8a631 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:54.966187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fdf76-067f-4e2f-94af-9251b2d8a631 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:54.999938 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadcb38-048f-4471-bd90-6d2c0a778732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:55.000628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadcb38-048f-4471-bd90-6d2c0a778732 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:55.000915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadcb38-048f-4471-bd90-6d2c0a778732 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:55.001187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadcb38-048f-4471-bd90-6d2c0a778732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:55.011545 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadcb38-048f-4471-bd90-6d2c0a778732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:55.012994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadcb38-048f-4471-bd90-6d2c0a778732 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-fdadcb38-048f-4471-bd90-6d2c0a778732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:55.027688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:55.028751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:55.029639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:55.029639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:55.029639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:55.029639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 633/1269] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:55.034822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440915b0-6637-4933-b8e6-2ff6c7fc299f None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:55.133837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440915b0-6637-4933-b8e6-2ff6c7fc299f None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:55.167464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f3514-ea28-47c1-9560-0d52376a6285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:55.168057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f3514-ea28-47c1-9560-0d52376a6285 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:55.168330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f3514-ea28-47c1-9560-0d52376a6285 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:55.168597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f3514-ea28-47c1-9560-0d52376a6285 None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:55.169223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f3514-ea28-47c1-9560-0d52376a6285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:55.169521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f3514-ea28-47c1-9560-0d52376a6285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:55.170935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f3514-ea28-47c1-9560-0d52376a6285 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:55.181824 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 637/1270] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:55.187745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadcb38-048f-4471-bd90-6d2c0a778732 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:55.220003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:55.290169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadcb38-048f-4471-bd90-6d2c0a778732 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:55.325282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd14ac-9299-4e5e-8870-2f3ee6112ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:55.325915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd14ac-9299-4e5e-8870-2f3ee6112ddc None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:55.326198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd14ac-9299-4e5e-8870-2f3ee6112ddc None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:55.326473 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd14ac-9299-4e5e-8870-2f3ee6112ddc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:55.333121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd14ac-9299-4e5e-8870-2f3ee6112ddc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:55.334542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd14ac-9299-4e5e-8870-2f3ee6112ddc None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-0afd14ac-9299-4e5e-8870-2f3ee6112ddc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:41:55.346918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:55.347854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:55.348862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:41:55.348862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:41:55.348862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:41:55.348862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:41:55.348862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:41:55.348862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:41:55.348862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:41:55.348862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:55.348862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 634/1271] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:41:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:55.354358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f3514-ea28-47c1-9560-0d52376a6285 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:55.413875 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:55.454513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f3514-ea28-47c1-9560-0d52376a6285 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:55.487491 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deab5a-dba2-4baf-9ca5-9f860b85b1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:55.488094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deab5a-dba2-4baf-9ca5-9f860b85b1e7 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:55.488372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deab5a-dba2-4baf-9ca5-9f860b85b1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:55.488640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deab5a-dba2-4baf-9ca5-9f860b85b1e7 None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:55.489350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deab5a-dba2-4baf-9ca5-9f860b85b1e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:55.489649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deab5a-dba2-4baf-9ca5-9f860b85b1e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:55.491109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deab5a-dba2-4baf-9ca5-9f860b85b1e7 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:55.502951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 638/1272] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:41:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:55.509587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd14ac-9299-4e5e-8870-2f3ee6112ddc None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:55.599413 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:55.608005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd14ac-9299-4e5e-8870-2f3ee6112ddc None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:55.641157 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64469e-bd56-456e-ac94-90ebea075ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:55.641804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64469e-bd56-456e-ac94-90ebea075ab3 None admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:55.642082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64469e-bd56-456e-ac94-90ebea075ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:55.642354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64469e-bd56-456e-ac94-90ebea075ab3 None admin] PATH_INFO: `/v3/projects/da13e1cbae664d5a92198052526ee459/users/ce79452e14fa4984875dca43672ed25a/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:55.644408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64469e-bd56-456e-ac94-90ebea075ab3 None admin] RBAC: Authorizing `identity:create_grant(project_id=da13e1cbae664d5a92198052526ee459, user_id=ce79452e14fa4984875dca43672ed25a, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:55.645810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64469e-bd56-456e-ac94-90ebea075ab3 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:55.749478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 635/1273] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Aug 29 23:41:55 2022] PUT /identity/v3/projects/da13e1cbae664d5a92198052526ee459/users/ce79452e14fa4984875dca43672ed25a/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:57.623850 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5107f-85b9-40b2-986a-a8760f542cc7 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.624402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5107f-85b9-40b2-986a-a8760f542cc7 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.624402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5107f-85b9-40b2-986a-a8760f542cc7 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.625789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 639/1274] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:57.631090 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998ba63-4ece-418d-b170-f9850d289b26 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.631499 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998ba63-4ece-418d-b170-f9850d289b26 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.631644 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998ba63-4ece-418d-b170-f9850d289b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.649588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d998ba63-4ece-418d-b170-f9850d289b26 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:57.656709 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d998ba63-4ece-418d-b170-f9850d289b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:57.716007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 636/1275] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:41:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:41:57.983130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5107f-85b9-40b2-986a-a8760f542cc7 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.082761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5107f-85b9-40b2-986a-a8760f542cc7 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.100050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:58.118156 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b28102-9954-408d-be4d-e7a123e391c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.119043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b28102-9954-408d-be4d-e7a123e391c0 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.119322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b28102-9954-408d-be4d-e7a123e391c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.119597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b28102-9954-408d-be4d-e7a123e391c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.129559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b28102-9954-408d-be4d-e7a123e391c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-29b28102-9954-408d-be4d-e7a123e391c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:41:58.134420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:58.135445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:58.136327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 640/1276] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Aug 29 23:41:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:58.141586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998ba63-4ece-418d-b170-f9850d289b26 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.221710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:58.240068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998ba63-4ece-418d-b170-f9850d289b26 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.275016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ced196-d07c-4bae-8add-2a2b9db9b9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.275630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ced196-d07c-4bae-8add-2a2b9db9b9d1 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.275888 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ced196-d07c-4bae-8add-2a2b9db9b9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.276152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ced196-d07c-4bae-8add-2a2b9db9b9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.276796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ced196-d07c-4bae-8add-2a2b9db9b9d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:58.277092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ced196-d07c-4bae-8add-2a2b9db9b9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.278477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ced196-d07c-4bae-8add-2a2b9db9b9d1 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.286309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 637/1277] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Aug 29 23:41:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:58.292051 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b28102-9954-408d-be4d-e7a123e391c0 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.393062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b28102-9954-408d-be4d-e7a123e391c0 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.427212 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1de080-1e90-42e1-a252-06463f4b2047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.427924 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1de080-1e90-42e1-a252-06463f4b2047 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.428196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1de080-1e90-42e1-a252-06463f4b2047 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.428462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1de080-1e90-42e1-a252-06463f4b2047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.438497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1de080-1e90-42e1-a252-06463f4b2047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.440023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1de080-1e90-42e1-a252-06463f4b2047 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-9a1de080-1e90-42e1-a252-06463f4b2047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:58.455223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:58.456396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:58.457594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:58.457594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:58.457594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:58.457594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 641/1278] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:58.463129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ced196-d07c-4bae-8add-2a2b9db9b9d1 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.563545 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ced196-d07c-4bae-8add-2a2b9db9b9d1 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.597267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cbfc9-d26f-40d2-a923-097071b96152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.597893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cbfc9-d26f-40d2-a923-097071b96152 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.598171 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cbfc9-d26f-40d2-a923-097071b96152 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.598442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cbfc9-d26f-40d2-a923-097071b96152 None admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.599114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cbfc9-d26f-40d2-a923-097071b96152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:58.599418 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cbfc9-d26f-40d2-a923-097071b96152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.601062 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cbfc9-d26f-40d2-a923-097071b96152 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.612902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 638/1279] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:58.619123 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1de080-1e90-42e1-a252-06463f4b2047 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.651884 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:58.719264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1de080-1e90-42e1-a252-06463f4b2047 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.754115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6da7f-76c1-4d46-802e-529ffaf2e1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.754773 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6da7f-76c1-4d46-802e-529ffaf2e1c8 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.755091 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6da7f-76c1-4d46-802e-529ffaf2e1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.755367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6da7f-76c1-4d46-802e-529ffaf2e1c8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.763409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6da7f-76c1-4d46-802e-529ffaf2e1c8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.764887 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6da7f-76c1-4d46-802e-529ffaf2e1c8 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-f3b6da7f-76c1-4d46-802e-529ffaf2e1c8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:41:58.775896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:58.782326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:58.783346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:58.783346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:58.783346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:41:58.783346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:41:58.783346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:41:58.783346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:41:58.783346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:41:58.783346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:41:58.783346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:41:58.783346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:41:58.783346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 642/1280] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:58.783970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cbfc9-d26f-40d2-a923-097071b96152 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.786740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:58.884622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cbfc9-d26f-40d2-a923-097071b96152 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.917910 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931da312-16dc-420f-89a9-32d704a12817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.918501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da312-16dc-420f-89a9-32d704a12817 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.918783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da312-16dc-420f-89a9-32d704a12817 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.919086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da312-16dc-420f-89a9-32d704a12817 None admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.919847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931da312-16dc-420f-89a9-32d704a12817 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:58.920147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931da312-16dc-420f-89a9-32d704a12817 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.921593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931da312-16dc-420f-89a9-32d704a12817 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.941686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 639/1281] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Aug 29 23:41:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:58.947853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6da7f-76c1-4d46-802e-529ffaf2e1c8 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.036569 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:59.046252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6da7f-76c1-4d46-802e-529ffaf2e1c8 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.078150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6939e4d-787a-4df8-b737-aff0e49f8892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.078742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6939e4d-787a-4df8-b737-aff0e49f8892 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.079047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6939e4d-787a-4df8-b737-aff0e49f8892 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.079316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6939e4d-787a-4df8-b737-aff0e49f8892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.144418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6939e4d-787a-4df8-b737-aff0e49f8892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.145782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6939e4d-787a-4df8-b737-aff0e49f8892 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.234358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:59.245065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 643/1282] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Aug 29 23:41:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:41:59.250902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931da312-16dc-420f-89a9-32d704a12817 None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.310959 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:59.348591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931da312-16dc-420f-89a9-32d704a12817 None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.384763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c39bf-7208-4dde-a1e1-8a00bb28549e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.385494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c39bf-7208-4dde-a1e1-8a00bb28549e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.385772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c39bf-7208-4dde-a1e1-8a00bb28549e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.386042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c39bf-7208-4dde-a1e1-8a00bb28549e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.407467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c39bf-7208-4dde-a1e1-8a00bb28549e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.407467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c39bf-7208-4dde-a1e1-8a00bb28549e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-1a8c39bf-7208-4dde-a1e1-8a00bb28549e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:41:59.412735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:59.413786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:41:59.415459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:41:59.415459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:41:59.415459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:59.415459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 640/1283] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:59.420319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6939e4d-787a-4df8-b737-aff0e49f8892 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.521104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6939e4d-787a-4df8-b737-aff0e49f8892 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.556535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4c1b8-5f8c-48ce-b30c-0fbfee0e804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.557141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4c1b8-5f8c-48ce-b30c-0fbfee0e804a None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.557421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4c1b8-5f8c-48ce-b30c-0fbfee0e804a None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.557693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4c1b8-5f8c-48ce-b30c-0fbfee0e804a None admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.558329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4c1b8-5f8c-48ce-b30c-0fbfee0e804a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:59.558632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4c1b8-5f8c-48ce-b30c-0fbfee0e804a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.560070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4c1b8-5f8c-48ce-b30c-0fbfee0e804a None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.571579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 644/1284] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Aug 29 23:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:59.577209 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c39bf-7208-4dde-a1e1-8a00bb28549e None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.676126 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c39bf-7208-4dde-a1e1-8a00bb28549e None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.689319 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:59.709116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4adce-7eba-46cd-b724-66421d90833d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.709774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4adce-7eba-46cd-b724-66421d90833d None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.710080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4adce-7eba-46cd-b724-66421d90833d None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.710357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4adce-7eba-46cd-b724-66421d90833d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.717435 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4adce-7eba-46cd-b724-66421d90833d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.718851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4adce-7eba-46cd-b724-66421d90833d None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application [None req-a0a4adce-7eba-46cd-b724-66421d90833d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:41:59.731247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application with Lock( Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:41:59.736887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:41:59.738012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:41:59.738012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:41:59.738012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:41:59.738012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:41:59.738012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:41:59.738012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:41:59.738012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:41:59.738012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: ERROR keystone.server.flask.application Aug 29 23:41:59.738012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 641/1285] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Aug 29 23:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:41:59.738501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4c1b8-5f8c-48ce-b30c-0fbfee0e804a None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.789791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:59.839672 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4c1b8-5f8c-48ce-b30c-0fbfee0e804a None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.874591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48d7dd-23fe-4bec-95fb-8f6e2ad6872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.875222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48d7dd-23fe-4bec-95fb-8f6e2ad6872e None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.875503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48d7dd-23fe-4bec-95fb-8f6e2ad6872e None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.875775 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48d7dd-23fe-4bec-95fb-8f6e2ad6872e None admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.876459 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48d7dd-23fe-4bec-95fb-8f6e2ad6872e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:59.876764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48d7dd-23fe-4bec-95fb-8f6e2ad6872e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.878189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48d7dd-23fe-4bec-95fb-8f6e2ad6872e None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.891139 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 645/1286] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Aug 29 23:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:59.897336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4adce-7eba-46cd-b724-66421d90833d None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.997301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4adce-7eba-46cd-b724-66421d90833d None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:00.029894 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87604ae1-a1fd-425d-9b73-3a913be266b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:00.030492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87604ae1-a1fd-425d-9b73-3a913be266b6 None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:00.030773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87604ae1-a1fd-425d-9b73-3a913be266b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:00.031071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87604ae1-a1fd-425d-9b73-3a913be266b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:00.031793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87604ae1-a1fd-425d-9b73-3a913be266b6 None admin] RBAC: Adding query filter params (role.id=2b3a10551a5542538c01e7d4d1b76af3, scope.project.id=da13e1cbae664d5a92198052526ee459, user.id=ce79452e14fa4984875dca43672ed25a) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:00.032092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87604ae1-a1fd-425d-9b73-3a913be266b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:00.033535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87604ae1-a1fd-425d-9b73-3a913be266b6 None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:00.039246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 642/1287] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Aug 29 23:41:59 2022] GET /identity/v3/role_assignments?user.id=ce79452e14fa4984875dca43672ed25a&scope.project.id=da13e1cbae664d5a92198052526ee459&role.id=2b3a10551a5542538c01e7d4d1b76af3 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:01.963740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77768b60-fd1b-43f8-b7a1-b7f9d3f4c5ee None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:01.964309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77768b60-fd1b-43f8-b7a1-b7f9d3f4c5ee None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:01.964309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77768b60-fd1b-43f8-b7a1-b7f9d3f4c5ee None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:01.965638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 646/1288] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:42:01.970670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6134f4-fe83-430e-9ac2-8decaf709b28 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:01.971129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6134f4-fe83-430e-9ac2-8decaf709b28 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:01.971284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6134f4-fe83-430e-9ac2-8decaf709b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:01.989308 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-bc6134f4-fe83-430e-9ac2-8decaf709b28 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:01.990539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-bc6134f4-fe83-430e-9ac2-8decaf709b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:02.019619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:02.055708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 643/1289] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:42:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:42:02.323424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77768b60-fd1b-43f8-b7a1-b7f9d3f4c5ee None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:02.426206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77768b60-fd1b-43f8-b7a1-b7f9d3f4c5ee None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:02.436855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:02.459805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed48bf-157c-49b3-aeaf-b30edd1d2651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:02.460484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed48bf-157c-49b3-aeaf-b30edd1d2651 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:02.460764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed48bf-157c-49b3-aeaf-b30edd1d2651 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:02.461042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed48bf-157c-49b3-aeaf-b30edd1d2651 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:02.462110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed48bf-157c-49b3-aeaf-b30edd1d2651 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:02.463567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed48bf-157c-49b3-aeaf-b30edd1d2651 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-47ed48bf-157c-49b3-aeaf-b30edd1d2651 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:42:02.472341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:42:02.473401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:42:02.474361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 647/1290] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Aug 29 23:42:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:42:02.480353 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6134f4-fe83-430e-9ac2-8decaf709b28 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:02.579362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6134f4-fe83-430e-9ac2-8decaf709b28 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:02.614099 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e5019-a10e-442b-9e10-67412de6e37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:02.614701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e5019-a10e-442b-9e10-67412de6e37e None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:02.615089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e5019-a10e-442b-9e10-67412de6e37e None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:02.615362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e5019-a10e-442b-9e10-67412de6e37e None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:02.615985 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e5019-a10e-442b-9e10-67412de6e37e None admin] RBAC: Adding query filter params (name=placement) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:02.616290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e5019-a10e-442b-9e10-67412de6e37e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:02.617648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e5019-a10e-442b-9e10-67412de6e37e None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:02.622467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 644/1291] 10.222.0.73 () {56 vars in 1116 bytes} [Mon Aug 29 23:42:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:42:02.628238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed48bf-157c-49b3-aeaf-b30edd1d2651 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:02.730628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed48bf-157c-49b3-aeaf-b30edd1d2651 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:02.764028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575bee2-ea56-465b-a3cc-fe74130f843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:02.764626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bee2-ea56-465b-a3cc-fe74130f843f None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:02.764900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bee2-ea56-465b-a3cc-fe74130f843f None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:02.765167 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bee2-ea56-465b-a3cc-fe74130f843f None admin] PATH_INFO: `/v3/services` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:02.765781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575bee2-ea56-465b-a3cc-fe74130f843f None admin] RBAC: Adding query filter params (type=placement) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:02.766080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575bee2-ea56-465b-a3cc-fe74130f843f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:02.767467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575bee2-ea56-465b-a3cc-fe74130f843f None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:02.772080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 648/1292] 10.222.0.73 () {56 vars in 1116 bytes} [Mon Aug 29 23:42:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:04.647592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56481d7-6a55-4b53-ac6d-a2e368bba066 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:04.648151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56481d7-6a55-4b53-ac6d-a2e368bba066 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:04.648151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56481d7-6a55-4b53-ac6d-a2e368bba066 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:04.649512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 645/1293] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:42:04.654539 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca723b7b-8fd1-4ed8-a821-105f43d7e5a5 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:04.654951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca723b7b-8fd1-4ed8-a821-105f43d7e5a5 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:04.655124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca723b7b-8fd1-4ed8-a821-105f43d7e5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:04.673227 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-ca723b7b-8fd1-4ed8-a821-105f43d7e5a5 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:04.674435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ca723b7b-8fd1-4ed8-a821-105f43d7e5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:04.704395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:04.740712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 649/1294] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:42:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:42:05.007000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56481d7-6a55-4b53-ac6d-a2e368bba066 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:05.037693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:05.107327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56481d7-6a55-4b53-ac6d-a2e368bba066 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:05.140444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7858c-fe32-4117-9e09-e3e3eb5fce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:05.141043 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7858c-fe32-4117-9e09-e3e3eb5fce8f None admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:05.141348 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7858c-fe32-4117-9e09-e3e3eb5fce8f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:05.141622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7858c-fe32-4117-9e09-e3e3eb5fce8f None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:05.142274 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7858c-fe32-4117-9e09-e3e3eb5fce8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:05.143652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7858c-fe32-4117-9e09-e3e3eb5fce8f None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:05.222079 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 646/1295] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Aug 29 23:42:05 2022] POST /identity/v3/services => generated 246 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:07.123253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a14d2d-8792-4385-889e-6a66be176841 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.123781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a14d2d-8792-4385-889e-6a66be176841 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.123781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a14d2d-8792-4385-889e-6a66be176841 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.125188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 650/1296] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:42:07.130357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81fad7-dbb0-4287-8b1d-bcde585ff822 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.130775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81fad7-dbb0-4287-8b1d-bcde585ff822 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.130933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81fad7-dbb0-4287-8b1d-bcde585ff822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.149594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8d81fad7-dbb0-4287-8b1d-bcde585ff822 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:07.150797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8d81fad7-dbb0-4287-8b1d-bcde585ff822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:07.222610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 647/1297] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:42:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:42:07.492039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a14d2d-8792-4385-889e-6a66be176841 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.592607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a14d2d-8792-4385-889e-6a66be176841 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.626489 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa50f1-bbe5-41db-b34a-c8e8f6cc0af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.627183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa50f1-bbe5-41db-b34a-c8e8f6cc0af1 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.627461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa50f1-bbe5-41db-b34a-c8e8f6cc0af1 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.627737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa50f1-bbe5-41db-b34a-c8e8f6cc0af1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.628318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa50f1-bbe5-41db-b34a-c8e8f6cc0af1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.629713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa50f1-bbe5-41db-b34a-c8e8f6cc0af1 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-a6aa50f1-bbe5-41db-b34a-c8e8f6cc0af1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:42:07.639518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:42:07.646806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:42:07.647877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 651/1298] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Aug 29 23:42:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:42:07.648853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81fad7-dbb0-4287-8b1d-bcde585ff822 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.664590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:07.743175 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81fad7-dbb0-4287-8b1d-bcde585ff822 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.778315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6825c-f91d-4434-b05d-64b95eb714cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.778942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6825c-f91d-4434-b05d-64b95eb714cf None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.779227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6825c-f91d-4434-b05d-64b95eb714cf None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.779500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6825c-f91d-4434-b05d-64b95eb714cf None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.780124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6825c-f91d-4434-b05d-64b95eb714cf None admin] RBAC: Adding query filter params (name=placement) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:07.780430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6825c-f91d-4434-b05d-64b95eb714cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.781805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6825c-f91d-4434-b05d-64b95eb714cf None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.786742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 648/1299] 10.222.0.73 () {56 vars in 1116 bytes} [Mon Aug 29 23:42:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:07.792799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa50f1-bbe5-41db-b34a-c8e8f6cc0af1 None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.825955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:07.893406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa50f1-bbe5-41db-b34a-c8e8f6cc0af1 None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.926514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b42b-b421-4592-aaa4-e7226ce4ba77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.927143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b42b-b421-4592-aaa4-e7226ce4ba77 None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.927426 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b42b-b421-4592-aaa4-e7226ce4ba77 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.927704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b42b-b421-4592-aaa4-e7226ce4ba77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.928420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235b42b-b421-4592-aaa4-e7226ce4ba77 None admin] RBAC: Adding query filter params (interface=public, service_id=884e7a9a02194725bb277575f559cce3, region_id=RegionOne) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:07.928725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235b42b-b421-4592-aaa4-e7226ce4ba77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.930684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235b42b-b421-4592-aaa4-e7226ce4ba77 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.935595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 652/1300] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Aug 29 23:42:07 2022] GET /identity/v3/endpoints?service_id=884e7a9a02194725bb277575f559cce3&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:07.941529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6825c-f91d-4434-b05d-64b95eb714cf None admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.022374 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:08.040323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6825c-f91d-4434-b05d-64b95eb714cf None admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:08.073421 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15674fc8-d478-442b-ae25-9d47a150896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:08.074014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674fc8-d478-442b-ae25-9d47a150896f None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.074288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674fc8-d478-442b-ae25-9d47a150896f None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.074555 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674fc8-d478-442b-ae25-9d47a150896f None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.075185 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15674fc8-d478-442b-ae25-9d47a150896f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:08.076520 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15674fc8-d478-442b-ae25-9d47a150896f None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:08.083145 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 649/1301] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Aug 29 23:42:07 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:09.980368 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930e7eb-787e-45b4-8365-18440fc7805b None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.980938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930e7eb-787e-45b4-8365-18440fc7805b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.981039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930e7eb-787e-45b4-8365-18440fc7805b None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.982315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 653/1302] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:42:09.987747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbff7d3-5816-482d-ac10-60a51001f2be None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.988217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbff7d3-5816-482d-ac10-60a51001f2be None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.988313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbff7d3-5816-482d-ac10-60a51001f2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.005984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8fbff7d3-5816-482d-ac10-60a51001f2be None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:10.007229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8fbff7d3-5816-482d-ac10-60a51001f2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.071862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 650/1303] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:42:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:42:10.341950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930e7eb-787e-45b4-8365-18440fc7805b None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:10.436812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:10.443410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930e7eb-787e-45b4-8365-18440fc7805b None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:10.477688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e97126-808d-4bed-a221-55a602e9827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:10.478299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97126-808d-4bed-a221-55a602e9827d None admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.478574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97126-808d-4bed-a221-55a602e9827d None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.478838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97126-808d-4bed-a221-55a602e9827d None admin] PATH_INFO: `/v3/services/placement` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.479435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e97126-808d-4bed-a221-55a602e9827d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:10.480786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e97126-808d-4bed-a221-55a602e9827d None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application [None req-85e97126-808d-4bed-a221-55a602e9827d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:42:10.489451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:42:10.490587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application with Lock( Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: ERROR keystone.server.flask.application Aug 29 23:42:10.491494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 654/1304] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Aug 29 23:42:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:42:10.497035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbff7d3-5816-482d-ac10-60a51001f2be None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:10.581582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:10.604096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbff7d3-5816-482d-ac10-60a51001f2be None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:10.638311 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed7b43-a4b9-4cfa-a984-a96d8c5babae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:10.638950 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed7b43-a4b9-4cfa-a984-a96d8c5babae None admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.639229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed7b43-a4b9-4cfa-a984-a96d8c5babae None admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.639497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed7b43-a4b9-4cfa-a984-a96d8c5babae None admin] PATH_INFO: `/v3/services` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.640112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed7b43-a4b9-4cfa-a984-a96d8c5babae None admin] RBAC: Adding query filter params (name=placement) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:10.640409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed7b43-a4b9-4cfa-a984-a96d8c5babae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:10.641756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed7b43-a4b9-4cfa-a984-a96d8c5babae None admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:10.646851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 651/1305] 10.222.0.73 () {56 vars in 1116 bytes} [Mon Aug 29 23:42:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:42:10.652753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e97126-808d-4bed-a221-55a602e9827d None admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:10.752693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e97126-808d-4bed-a221-55a602e9827d None admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:10.786141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efc31e-6d65-49e0-95bc-c8dc12532b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:10.786740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efc31e-6d65-49e0-95bc-c8dc12532b22 None admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.787116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efc31e-6d65-49e0-95bc-c8dc12532b22 None admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.787394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efc31e-6d65-49e0-95bc-c8dc12532b22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.788066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efc31e-6d65-49e0-95bc-c8dc12532b22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:10.789442 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efc31e-6d65-49e0-95bc-c8dc12532b22 None admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:10.891317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 655/1306] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:20.651121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=30 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:20.886612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:09.981511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126528fb-9d94-4dd2-bb68-ee7f472fd76e None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:09.981986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126528fb-9d94-4dd2-bb68-ee7f472fd76e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:09.982210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126528fb-9d94-4dd2-bb68-ee7f472fd76e None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:09.983591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 652/1307] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:09.989540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9522eb-3433-4c97-ad63-eff079d9959f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:09.993843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9522eb-3433-4c97-ad63-eff079d9959f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:09.993843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9522eb-3433-4c97-ad63-eff079d9959f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:10.123467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-6b9522eb-3433-4c97-ad63-eff079d9959f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:10.131930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6b9522eb-3433-4c97-ad63-eff079d9959f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:10.282731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 656/1308] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:10.577549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eb6e8-af11-43a6-a444-41be4dd0f5ee None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:10.577911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eb6e8-af11-43a6-a444-41be4dd0f5ee None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:10.578092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eb6e8-af11-43a6-a444-41be4dd0f5ee None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:10.579604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 653/1309] 10.222.0.73 () {54 vars in 965 bytes} [Mon Aug 29 23:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:10.585503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014d3d2-2ff7-4f53-9008-f4ca4e055560 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:10.585886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014d3d2-2ff7-4f53-9008-f4ca4e055560 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:10.586386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014d3d2-2ff7-4f53-9008-f4ca4e055560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:10.668636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-b014d3d2-2ff7-4f53-9008-f4ca4e055560 None None] MFA Rules not processed for user `707518bbe380425aa793f005548bc9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:10.669952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b014d3d2-2ff7-4f53-9008-f4ca4e055560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:10.692334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:10.762168 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 657/1310] 10.222.0.73 () {58 vars in 1062 bytes} [Mon Aug 29 23:48:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:10.772058 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514eb6e8-af11-43a6-a444-41be4dd0f5ee None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:10.773883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-514eb6e8-af11-43a6-a444-41be4dd0f5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:10.904226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514eb6e8-af11-43a6-a444-41be4dd0f5ee None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:10.983592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849d530-b8e1-46e8-984e-ac813a744722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:10.984294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849d530-b8e1-46e8-984e-ac813a744722 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:10.984546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849d530-b8e1-46e8-984e-ac813a744722 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:10.984734 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849d530-b8e1-46e8-984e-ac813a744722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:10.986327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5849d530-b8e1-46e8-984e-ac813a744722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:11.046355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:11.105806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849d530-b8e1-46e8-984e-ac813a744722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:11.107356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849d530-b8e1-46e8-984e-ac813a744722 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:11.127641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 654/1311] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:13.338795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09ec6f-cb7d-49f7-a6fe-55d915fcfce1 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.339344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09ec6f-cb7d-49f7-a6fe-55d915fcfce1 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.339454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09ec6f-cb7d-49f7-a6fe-55d915fcfce1 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.340888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 658/1312] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:13.346120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccf1aa-0239-4146-a2d9-5f9e1bff1c1c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.347080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccf1aa-0239-4146-a2d9-5f9e1bff1c1c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.347218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccf1aa-0239-4146-a2d9-5f9e1bff1c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.443599 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-09ccf1aa-0239-4146-a2d9-5f9e1bff1c1c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:13.445050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-09ccf1aa-0239-4146-a2d9-5f9e1bff1c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:13.564076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 655/1313] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:48:13.862835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f9f73-d70d-47ce-8bd3-7e71ee55ba61 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.863153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f9f73-d70d-47ce-8bd3-7e71ee55ba61 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.863425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f9f73-d70d-47ce-8bd3-7e71ee55ba61 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.864789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 659/1314] 10.222.0.73 () {54 vars in 965 bytes} [Mon Aug 29 23:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:13.872485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe5104-deff-4b40-917b-a35a8f329f1d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.872771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe5104-deff-4b40-917b-a35a8f329f1d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.873045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe5104-deff-4b40-917b-a35a8f329f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.885262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:13.949005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-93fe5104-deff-4b40-917b-a35a8f329f1d None None] MFA Rules not processed for user `707518bbe380425aa793f005548bc9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:13.950204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-93fe5104-deff-4b40-917b-a35a8f329f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:14.029782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 656/1315] 10.222.0.73 () {58 vars in 1062 bytes} [Mon Aug 29 23:48:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:48:14.039039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f9f73-d70d-47ce-8bd3-7e71ee55ba61 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:14.040437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-025f9f73-d70d-47ce-8bd3-7e71ee55ba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:14.144113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f9f73-d70d-47ce-8bd3-7e71ee55ba61 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:14.215493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:14.217799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29048f-d3e0-4ea0-881d-ee9592abe492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:14.218406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29048f-d3e0-4ea0-881d-ee9592abe492 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:14.218683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29048f-d3e0-4ea0-881d-ee9592abe492 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:14.218985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29048f-d3e0-4ea0-881d-ee9592abe492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:14.220836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ba29048f-d3e0-4ea0-881d-ee9592abe492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:14.333791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29048f-d3e0-4ea0-881d-ee9592abe492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:14.335293 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29048f-d3e0-4ea0-881d-ee9592abe492 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:14.354130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 660/1316] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:16.970664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf10ef-662f-443f-87da-5775ceba3b9a None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:16.971218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf10ef-662f-443f-87da-5775ceba3b9a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:16.971218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf10ef-662f-443f-87da-5775ceba3b9a None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:16.972587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 657/1317] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:16.977767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09b1b2-3d73-4f31-a5a3-e0093c2cfea2 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:16.978242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09b1b2-3d73-4f31-a5a3-e0093c2cfea2 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:16.978334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09b1b2-3d73-4f31-a5a3-e0093c2cfea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:17.043894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-df09b1b2-3d73-4f31-a5a3-e0093c2cfea2 None None] MFA Rules not processed for user `e791ee39a92340d6a13ec523db2e5b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:17.045101 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-df09b1b2-3d73-4f31-a5a3-e0093c2cfea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:17.097135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:17.141647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 661/1318] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:16 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:17.434489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf10ef-662f-443f-87da-5775ceba3b9a None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:17.436104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1fcf10ef-662f-443f-87da-5775ceba3b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:17.540533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf10ef-662f-443f-87da-5775ceba3b9a None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:17.543352 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:17.613141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561e845-10f7-4ebe-b235-c7607abf0a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:17.614254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561e845-10f7-4ebe-b235-c7607abf0a15 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:17.614531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561e845-10f7-4ebe-b235-c7607abf0a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:17.614801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561e845-10f7-4ebe-b235-c7607abf0a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:17.616432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2561e845-10f7-4ebe-b235-c7607abf0a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:17.721223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561e845-10f7-4ebe-b235-c7607abf0a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:17.722586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561e845-10f7-4ebe-b235-c7607abf0a15 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:17.741221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 658/1319] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:20.412062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def16e7c-3592-4956-b3bb-9ebe8e934ed5 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:20.412593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def16e7c-3592-4956-b3bb-9ebe8e934ed5 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:20.412593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def16e7c-3592-4956-b3bb-9ebe8e934ed5 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:20.413973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 662/1320] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:20.419051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd9763-3940-45aa-88bb-cfb8fa02d817 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:20.419459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd9763-3940-45aa-88bb-cfb8fa02d817 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:20.419605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd9763-3940-45aa-88bb-cfb8fa02d817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:20.460572 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:20.485043 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a3cd9763-3940-45aa-88bb-cfb8fa02d817 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:20.486282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a3cd9763-3940-45aa-88bb-cfb8fa02d817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:20.581374 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 659/1321] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:20.861663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def16e7c-3592-4956-b3bb-9ebe8e934ed5 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:20.863845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-def16e7c-3592-4956-b3bb-9ebe8e934ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:20.967794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def16e7c-3592-4956-b3bb-9ebe8e934ed5 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:21.040061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df79d80-3a2d-47b1-a8bd-d239fac2209f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:21.040660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df79d80-3a2d-47b1-a8bd-d239fac2209f service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:21.040943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df79d80-3a2d-47b1-a8bd-d239fac2209f service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:21.041219 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df79d80-3a2d-47b1-a8bd-d239fac2209f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:21.042823 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6df79d80-3a2d-47b1-a8bd-d239fac2209f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:21.050198 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:21.150902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df79d80-3a2d-47b1-a8bd-d239fac2209f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:21.152352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df79d80-3a2d-47b1-a8bd-d239fac2209f service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:21.170403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 663/1322] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:23.986538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272423d-58c2-4fed-bdd8-485bb6416ec8 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:23.987133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272423d-58c2-4fed-bdd8-485bb6416ec8 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:23.987133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272423d-58c2-4fed-bdd8-485bb6416ec8 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:23.989104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 660/1323] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:23.994674 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866843-dab1-47b8-a864-2f1821f97f21 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:23.995107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866843-dab1-47b8-a864-2f1821f97f21 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:23.995275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866843-dab1-47b8-a864-2f1821f97f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:24.063801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-b9866843-dab1-47b8-a864-2f1821f97f21 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:24.065011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b9866843-dab1-47b8-a864-2f1821f97f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:24.125350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:24.164733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 664/1324] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:24.446331 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272423d-58c2-4fed-bdd8-485bb6416ec8 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:24.447969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d272423d-58c2-4fed-bdd8-485bb6416ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:24.557155 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272423d-58c2-4fed-bdd8-485bb6416ec8 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:24.570113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:24.634740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f790cc-8ab3-4015-8f92-93dc5152225d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:24.635387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f790cc-8ab3-4015-8f92-93dc5152225d service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:24.635663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f790cc-8ab3-4015-8f92-93dc5152225d service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:24.635938 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f790cc-8ab3-4015-8f92-93dc5152225d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:24.637642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d9f790cc-8ab3-4015-8f92-93dc5152225d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:24.835807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f790cc-8ab3-4015-8f92-93dc5152225d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:24.835807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f790cc-8ab3-4015-8f92-93dc5152225d service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:24.835807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 661/1325] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:26.752453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26f76d-aeba-4d9a-b88a-01d96884932d None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:26.753032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26f76d-aeba-4d9a-b88a-01d96884932d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:26.753032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26f76d-aeba-4d9a-b88a-01d96884932d None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:26.754552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 665/1326] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:26.759746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ed95-fedd-4102-bf97-9239ef03aa80 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:26.760205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ed95-fedd-4102-bf97-9239ef03aa80 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:26.760313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ed95-fedd-4102-bf97-9239ef03aa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:26.808548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:26.826928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-6e28ed95-fedd-4102-bf97-9239ef03aa80 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:26.828055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6e28ed95-fedd-4102-bf97-9239ef03aa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:26.924541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 662/1327] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:27.205737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26f76d-aeba-4d9a-b88a-01d96884932d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:27.207590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ed26f76d-aeba-4d9a-b88a-01d96884932d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:27.316716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26f76d-aeba-4d9a-b88a-01d96884932d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:27.390103 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e597fd6-7c7c-40b9-810b-0f2176b60c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:27.390709 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e597fd6-7c7c-40b9-810b-0f2176b60c72 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:27.391019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e597fd6-7c7c-40b9-810b-0f2176b60c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:27.391293 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e597fd6-7c7c-40b9-810b-0f2176b60c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:27.392935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2e597fd6-7c7c-40b9-810b-0f2176b60c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:27.417428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:27.517086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e597fd6-7c7c-40b9-810b-0f2176b60c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:27.518588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e597fd6-7c7c-40b9-810b-0f2176b60c72 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:27.536655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 666/1328] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:29.503897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b49209-7a99-4a22-9674-b106d5670d54 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:29.504417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b49209-7a99-4a22-9674-b106d5670d54 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:29.504524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b49209-7a99-4a22-9674-b106d5670d54 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:29.505795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 663/1329] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:29.510997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0657cd-698d-41d1-887b-5dd47c6e1fcd None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:29.511432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0657cd-698d-41d1-887b-5dd47c6e1fcd None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:29.511623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0657cd-698d-41d1-887b-5dd47c6e1fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:29.580338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-9e0657cd-698d-41d1-887b-5dd47c6e1fcd None None] MFA Rules not processed for user `e791ee39a92340d6a13ec523db2e5b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:29.582153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9e0657cd-698d-41d1-887b-5dd47c6e1fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:29.653442 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:29.684782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 667/1330] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:29.965409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b49209-7a99-4a22-9674-b106d5670d54 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:29.967068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-80b49209-7a99-4a22-9674-b106d5670d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:30.095687 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b49209-7a99-4a22-9674-b106d5670d54 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:30.119547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:30.174018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c092c4-7b4f-4fe1-b520-2c692857e19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:30.174624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c092c4-7b4f-4fe1-b520-2c692857e19f service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:30.174936 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c092c4-7b4f-4fe1-b520-2c692857e19f service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:30.175743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c092c4-7b4f-4fe1-b520-2c692857e19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:30.177363 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-92c092c4-7b4f-4fe1-b520-2c692857e19f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:30.286664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c092c4-7b4f-4fe1-b520-2c692857e19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:30.288125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c092c4-7b4f-4fe1-b520-2c692857e19f service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:30.306095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 664/1331] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:48:32.750434 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef651b-8e3f-4d37-8cb8-c40285580315 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:32.750907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef651b-8e3f-4d37-8cb8-c40285580315 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:32.751003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef651b-8e3f-4d37-8cb8-c40285580315 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:32.752352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 668/1332] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:32.758148 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea2f2d-af0a-4922-83ff-e59fb73cb619 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:32.758571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea2f2d-af0a-4922-83ff-e59fb73cb619 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:32.758707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea2f2d-af0a-4922-83ff-e59fb73cb619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:32.821695 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:32.824289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-48ea2f2d-af0a-4922-83ff-e59fb73cb619 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:32.825514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-48ea2f2d-af0a-4922-83ff-e59fb73cb619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:32.921921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 665/1333] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:33.205235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef651b-8e3f-4d37-8cb8-c40285580315 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:33.207326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-56ef651b-8e3f-4d37-8cb8-c40285580315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:33.310590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef651b-8e3f-4d37-8cb8-c40285580315 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:33.382257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a214db4-1379-41cf-b0bc-64ae9b5d80ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:33.382855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a214db4-1379-41cf-b0bc-64ae9b5d80ab service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:33.383167 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a214db4-1379-41cf-b0bc-64ae9b5d80ab service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:33.383439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a214db4-1379-41cf-b0bc-64ae9b5d80ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:33.385082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0a214db4-1379-41cf-b0bc-64ae9b5d80ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:33.412286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:33.498778 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a214db4-1379-41cf-b0bc-64ae9b5d80ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:33.500182 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a214db4-1379-41cf-b0bc-64ae9b5d80ab service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:33.519805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 669/1334] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:35.477120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16877624-7eb7-4ee0-9793-2f6278c4409e None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:35.477703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16877624-7eb7-4ee0-9793-2f6278c4409e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:35.477703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16877624-7eb7-4ee0-9793-2f6278c4409e None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:35.479128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 666/1335] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:35.484455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d873f-59fb-49db-a63f-007d739e6c6d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:35.484841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d873f-59fb-49db-a63f-007d739e6c6d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:35.485013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d873f-59fb-49db-a63f-007d739e6c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:35.550425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-f64d873f-59fb-49db-a63f-007d739e6c6d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:35.551669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f64d873f-59fb-49db-a63f-007d739e6c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:35.628407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:35.651106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 670/1336] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:35.943769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16877624-7eb7-4ee0-9793-2f6278c4409e None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:35.945321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-16877624-7eb7-4ee0-9793-2f6278c4409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:36.047345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16877624-7eb7-4ee0-9793-2f6278c4409e None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:36.075765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:36.122484 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d7436-7622-46cd-b2a2-2471a713a009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:36.123273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d7436-7622-46cd-b2a2-2471a713a009 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:36.123894 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d7436-7622-46cd-b2a2-2471a713a009 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:36.124168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d7436-7622-46cd-b2a2-2471a713a009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:36.125836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0a6d7436-7622-46cd-b2a2-2471a713a009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:36.233066 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d7436-7622-46cd-b2a2-2471a713a009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:36.234476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d7436-7622-46cd-b2a2-2471a713a009 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:36.252769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 667/1337] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:38.723291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f2ba-1aee-4817-8751-27b5125b047d None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:38.723826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f2ba-1aee-4817-8751-27b5125b047d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:38.723826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f2ba-1aee-4817-8751-27b5125b047d None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:38.725181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 671/1338] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:38.730385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4826f-6384-4ec1-849e-9eba784ecb6f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:38.730822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4826f-6384-4ec1-849e-9eba784ecb6f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:38.730964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4826f-6384-4ec1-849e-9eba784ecb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:38.797935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-82a4826f-6384-4ec1-849e-9eba784ecb6f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:38.799159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-82a4826f-6384-4ec1-849e-9eba784ecb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:38.807729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:38.894480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 668/1339] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:39.182172 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43f2ba-1aee-4817-8751-27b5125b047d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:39.183768 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2a43f2ba-1aee-4817-8751-27b5125b047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:39.288626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43f2ba-1aee-4817-8751-27b5125b047d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:39.363713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a51e8-97d8-4a28-827a-99f7776507e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:39.364294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a51e8-97d8-4a28-827a-99f7776507e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:39.364653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a51e8-97d8-4a28-827a-99f7776507e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:39.364933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a51e8-97d8-4a28-827a-99f7776507e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:39.366552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5f5a51e8-97d8-4a28-827a-99f7776507e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:39.402116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:39.474939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a51e8-97d8-4a28-827a-99f7776507e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:39.476365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a51e8-97d8-4a28-827a-99f7776507e2 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:39.496637 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 672/1340] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:43.614894 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95af163-1eaf-4d80-af72-408c25b2de43 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:43.615424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95af163-1eaf-4d80-af72-408c25b2de43 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:43.615424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95af163-1eaf-4d80-af72-408c25b2de43 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:43.617059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 669/1341] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:43.622338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46136b-6ef4-4ae3-81cf-7bfc81467d92 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:43.622821 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46136b-6ef4-4ae3-81cf-7bfc81467d92 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:43.622965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46136b-6ef4-4ae3-81cf-7bfc81467d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:43.691840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-4d46136b-6ef4-4ae3-81cf-7bfc81467d92 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:43.696023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4d46136b-6ef4-4ae3-81cf-7bfc81467d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:43.782203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:43.793873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 673/1342] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:44.071593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95af163-1eaf-4d80-af72-408c25b2de43 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:44.073210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c95af163-1eaf-4d80-af72-408c25b2de43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:44.175393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95af163-1eaf-4d80-af72-408c25b2de43 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:44.214123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:44.251664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606d500-93bc-432e-8bcb-eb94cc159a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:44.252277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606d500-93bc-432e-8bcb-eb94cc159a2e service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:44.253046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606d500-93bc-432e-8bcb-eb94cc159a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:44.253318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606d500-93bc-432e-8bcb-eb94cc159a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:44.254919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a606d500-93bc-432e-8bcb-eb94cc159a2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:44.362105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606d500-93bc-432e-8bcb-eb94cc159a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:44.363493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606d500-93bc-432e-8bcb-eb94cc159a2e service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:44.383293 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 670/1343] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:47.435468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7607e-0ccd-42ca-b0ec-6b86d0a09a40 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:47.435978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7607e-0ccd-42ca-b0ec-6b86d0a09a40 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:47.435978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7607e-0ccd-42ca-b0ec-6b86d0a09a40 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:47.437284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 674/1344] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:47.443137 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ddcbd-ebe5-409c-80bd-0e8ea2fc9285 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:47.443566 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ddcbd-ebe5-409c-80bd-0e8ea2fc9285 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:47.443671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ddcbd-ebe5-409c-80bd-0e8ea2fc9285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:47.510393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-246ddcbd-ebe5-409c-80bd-0e8ea2fc9285 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:47.511641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-246ddcbd-ebe5-409c-80bd-0e8ea2fc9285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:47.529626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:47.609726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 671/1345] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:47.890455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7607e-0ccd-42ca-b0ec-6b86d0a09a40 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:47.892089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-31e7607e-0ccd-42ca-b0ec-6b86d0a09a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:48.002983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7607e-0ccd-42ca-b0ec-6b86d0a09a40 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:48.076149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2c479-b513-44ac-878a-0bbe7d21bbb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:48.076752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2c479-b513-44ac-878a-0bbe7d21bbb9 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:48.077029 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2c479-b513-44ac-878a-0bbe7d21bbb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:48.077300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2c479-b513-44ac-878a-0bbe7d21bbb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:48.078917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b4e2c479-b513-44ac-878a-0bbe7d21bbb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:48.123604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:48.191987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2c479-b513-44ac-878a-0bbe7d21bbb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:48.193597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2c479-b513-44ac-878a-0bbe7d21bbb9 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:48.213574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 675/1346] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:52.564350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdabcd-5af0-49e9-a174-d9ae318dbf20 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:52.565405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdabcd-5af0-49e9-a174-d9ae318dbf20 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:52.565538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdabcd-5af0-49e9-a174-d9ae318dbf20 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:52.566902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 672/1347] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:48:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:52.572558 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121ad28-0ddd-42bd-a660-69f42ed5759e None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:52.573167 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121ad28-0ddd-42bd-a660-69f42ed5759e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:52.573294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121ad28-0ddd-42bd-a660-69f42ed5759e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:52.646144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-0121ad28-0ddd-42bd-a660-69f42ed5759e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:52.647425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0121ad28-0ddd-42bd-a660-69f42ed5759e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:52.755495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:52.757995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 676/1348] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:48:53.041589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdabcd-5af0-49e9-a174-d9ae318dbf20 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:53.043291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8dbdabcd-5af0-49e9-a174-d9ae318dbf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:53.146314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdabcd-5af0-49e9-a174-d9ae318dbf20 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:53.193698 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:53.219471 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555fe29-92dc-46ce-9e15-a4c668fd08f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:53.220073 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555fe29-92dc-46ce-9e15-a4c668fd08f4 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:53.220352 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555fe29-92dc-46ce-9e15-a4c668fd08f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:53.220622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555fe29-92dc-46ce-9e15-a4c668fd08f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:53.223488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e555fe29-92dc-46ce-9e15-a4c668fd08f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:53.329864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555fe29-92dc-46ce-9e15-a4c668fd08f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:53.331344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555fe29-92dc-46ce-9e15-a4c668fd08f4 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:53.350299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 673/1349] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:58.274092 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c5b04-e102-41e0-82db-4e3787065fc7 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:58.274576 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c5b04-e102-41e0-82db-4e3787065fc7 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:58.274676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c5b04-e102-41e0-82db-4e3787065fc7 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:58.276414 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 677/1350] 10.222.0.73 () {54 vars in 921 bytes} [Mon Aug 29 23:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:48:58.284599 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e94adf-b68d-4b8f-a51b-a93daa4563c2 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:58.285030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e94adf-b68d-4b8f-a51b-a93daa4563c2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:58.285120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e94adf-b68d-4b8f-a51b-a93daa4563c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:58.448223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-c4e94adf-b68d-4b8f-a51b-a93daa4563c2 None None] MFA Rules not processed for user `ce79452e14fa4984875dca43672ed25a`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:58.449557 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c4e94adf-b68d-4b8f-a51b-a93daa4563c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:58.470971 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:58.573976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 674/1351] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Aug 29 23:48:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:02.627132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55c364-4522-4e3b-9a44-13b15153db55 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:02.627671 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55c364-4522-4e3b-9a44-13b15153db55 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:02.627990 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55c364-4522-4e3b-9a44-13b15153db55 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:02.629802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 678/1352] 10.222.0.73 () {54 vars in 921 bytes} [Mon Aug 29 23:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:02.634776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bed9d7-9e08-4675-bc6a-bb4459d046a5 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:02.635260 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bed9d7-9e08-4675-bc6a-bb4459d046a5 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:02.635421 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bed9d7-9e08-4675-bc6a-bb4459d046a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:02.715900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-00bed9d7-9e08-4675-bc6a-bb4459d046a5 None None] MFA Rules not processed for user `ce79452e14fa4984875dca43672ed25a`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:02.717110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-00bed9d7-9e08-4675-bc6a-bb4459d046a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:02.804292 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:02.841500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 675/1353] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Aug 29 23:49:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:04.184344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33fd23-32e8-45e6-ad51-dfff0f230c1e None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:04.184896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33fd23-32e8-45e6-ad51-dfff0f230c1e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:04.184896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33fd23-32e8-45e6-ad51-dfff0f230c1e None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:04.186253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 679/1354] 10.222.0.73 () {54 vars in 921 bytes} [Mon Aug 29 23:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:04.194298 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4f34c-5d95-445a-b700-c4e04059279e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:04.194803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4f34c-5d95-445a-b700-c4e04059279e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:04.194918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4f34c-5d95-445a-b700-c4e04059279e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:04.273147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-2ad4f34c-5d95-445a-b700-c4e04059279e None None] MFA Rules not processed for user `ce79452e14fa4984875dca43672ed25a`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:04.274406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2ad4f34c-5d95-445a-b700-c4e04059279e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:04.380528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 676/1355] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Aug 29 23:49:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:07.741059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7599ee-37f8-4753-8b32-c44da648490e None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:07.741576 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7599ee-37f8-4753-8b32-c44da648490e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:07.741576 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7599ee-37f8-4753-8b32-c44da648490e None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:07.742965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 680/1356] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:07.749095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1403-0d34-4e48-89b6-254837b9675a None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:07.749095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1403-0d34-4e48-89b6-254837b9675a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:07.749526 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1403-0d34-4e48-89b6-254837b9675a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:07.798719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:07.842316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-21fe1403-0d34-4e48-89b6-254837b9675a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:07.844401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-21fe1403-0d34-4e48-89b6-254837b9675a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:07.972898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 677/1357] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:08.274389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10346fb7-1fbf-43d2-ba56-58fe29b116af None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:08.275274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10346fb7-1fbf-43d2-ba56-58fe29b116af None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:08.275881 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10346fb7-1fbf-43d2-ba56-58fe29b116af None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:08.278064 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 681/1358] 10.222.0.73 () {54 vars in 962 bytes} [Mon Aug 29 23:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:08.287707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f87d3-2b6a-417d-a9ea-4ff1cbf314fe None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:08.288609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f87d3-2b6a-417d-a9ea-4ff1cbf314fe None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:08.289498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f87d3-2b6a-417d-a9ea-4ff1cbf314fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:08.374505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-2e0f87d3-2b6a-417d-a9ea-4ff1cbf314fe None None] MFA Rules not processed for user `59a1b0b274294a288dbf07cd99f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:08.376371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2e0f87d3-2b6a-417d-a9ea-4ff1cbf314fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:08.428761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:08.512813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 678/1359] 10.222.0.73 () {58 vars in 1059 bytes} [Mon Aug 29 23:49:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:08.521609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10346fb7-1fbf-43d2-ba56-58fe29b116af None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:08.523180 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-10346fb7-1fbf-43d2-ba56-58fe29b116af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:08.678001 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10346fb7-1fbf-43d2-ba56-58fe29b116af None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:08.759771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:08.804423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6697f1-afc0-4166-9c72-74bf35634f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:08.805175 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6697f1-afc0-4166-9c72-74bf35634f70 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:08.805463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6697f1-afc0-4166-9c72-74bf35634f70 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:08.805738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6697f1-afc0-4166-9c72-74bf35634f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:08.807523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ed6697f1-afc0-4166-9c72-74bf35634f70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:08.902690 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6697f1-afc0-4166-9c72-74bf35634f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:08.904447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6697f1-afc0-4166-9c72-74bf35634f70 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:08.922864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 682/1360] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:11.060201 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f6c51-db5c-4516-8022-d2805866f947 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:11.060745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f6c51-db5c-4516-8022-d2805866f947 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:11.060827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f6c51-db5c-4516-8022-d2805866f947 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:11.062328 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 679/1361] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:11.068420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d01d6d-2d8b-4a76-a72e-ef0d7f35529f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:11.069243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d01d6d-2d8b-4a76-a72e-ef0d7f35529f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:11.069717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d01d6d-2d8b-4a76-a72e-ef0d7f35529f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:11.140831 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-b4d01d6d-2d8b-4a76-a72e-ef0d7f35529f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:11.142669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b4d01d6d-2d8b-4a76-a72e-ef0d7f35529f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:11.181561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:11.254923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 683/1362] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:11.550372 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f6c51-db5c-4516-8022-d2805866f947 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:11.552149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-111f6c51-db5c-4516-8022-d2805866f947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:11.714828 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f6c51-db5c-4516-8022-d2805866f947 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:11.725692 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:11.847676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221c6a8-5454-4153-a7f8-9aabadffa7f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:11.848386 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221c6a8-5454-4153-a7f8-9aabadffa7f4 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:11.848771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221c6a8-5454-4153-a7f8-9aabadffa7f4 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:11.849150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221c6a8-5454-4153-a7f8-9aabadffa7f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:11.851596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0221c6a8-5454-4153-a7f8-9aabadffa7f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:11.963195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221c6a8-5454-4153-a7f8-9aabadffa7f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:11.965758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221c6a8-5454-4153-a7f8-9aabadffa7f4 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:11.991573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 680/1363] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:14.384374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ccc2-3667-4808-844e-1fa5c92e9370 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:14.384937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ccc2-3667-4808-844e-1fa5c92e9370 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:14.384937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ccc2-3667-4808-844e-1fa5c92e9370 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:14.386259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 684/1364] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:14.392131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237b5d-82cf-4798-a76f-65f6d3c8375b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:14.392529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237b5d-82cf-4798-a76f-65f6d3c8375b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:14.392744 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237b5d-82cf-4798-a76f-65f6d3c8375b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:14.408580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:14.464850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d4237b5d-82cf-4798-a76f-65f6d3c8375b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:14.466207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d4237b5d-82cf-4798-a76f-65f6d3c8375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:14.568923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 681/1365] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:14.874080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364af74-e3cf-4c1f-92dc-e98b3691c3e7 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:14.875062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364af74-e3cf-4c1f-92dc-e98b3691c3e7 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:14.875062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364af74-e3cf-4c1f-92dc-e98b3691c3e7 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:14.876659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 685/1366] 10.222.0.73 () {54 vars in 962 bytes} [Mon Aug 29 23:49:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:14.882218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736e459-eeb2-4857-9eeb-6eb40aacc663 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:14.882512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736e459-eeb2-4857-9eeb-6eb40aacc663 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:14.882790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736e459-eeb2-4857-9eeb-6eb40aacc663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:14.967936 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-6736e459-eeb2-4857-9eeb-6eb40aacc663 None None] MFA Rules not processed for user `59a1b0b274294a288dbf07cd99f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:14.969428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6736e459-eeb2-4857-9eeb-6eb40aacc663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:15.008387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:15.099078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 682/1367] 10.222.0.73 () {58 vars in 1059 bytes} [Mon Aug 29 23:49:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:15.106978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364af74-e3cf-4c1f-92dc-e98b3691c3e7 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:15.108674 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9364af74-e3cf-4c1f-92dc-e98b3691c3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:15.264160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364af74-e3cf-4c1f-92dc-e98b3691c3e7 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:15.286785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:15.392221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7cf8b-6e50-40bc-b9e3-6180e8fcee02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:15.393663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7cf8b-6e50-40bc-b9e3-6180e8fcee02 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:15.394155 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7cf8b-6e50-40bc-b9e3-6180e8fcee02 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:15.394633 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7cf8b-6e50-40bc-b9e3-6180e8fcee02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:15.397311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-57e7cf8b-6e50-40bc-b9e3-6180e8fcee02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:15.492921 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7cf8b-6e50-40bc-b9e3-6180e8fcee02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:15.494521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7cf8b-6e50-40bc-b9e3-6180e8fcee02 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:15.523153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 686/1368] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:15.913900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290e80a-d086-4d90-871c-eaa531e08186 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:15.914445 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290e80a-d086-4d90-871c-eaa531e08186 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:15.914445 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290e80a-d086-4d90-871c-eaa531e08186 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:15.915991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 683/1369] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:15.921221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28208f6-2da4-4086-9229-3186d970c8c2 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:15.921517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28208f6-2da4-4086-9229-3186d970c8c2 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:15.921797 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28208f6-2da4-4086-9229-3186d970c8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:15.955555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:15.993763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e28208f6-2da4-4086-9229-3186d970c8c2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:15.995253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e28208f6-2da4-4086-9229-3186d970c8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:16.107367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 687/1370] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:16.684133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2754-811b-409b-867f-3f8567d80979 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:16.684133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2754-811b-409b-867f-3f8567d80979 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:16.684133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2754-811b-409b-867f-3f8567d80979 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:16.686667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 684/1371] 10.222.0.73 () {54 vars in 964 bytes} [Mon Aug 29 23:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:16.691158 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fca904-680f-4c7e-ab7e-736c4d83135b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:16.691663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fca904-680f-4c7e-ab7e-736c4d83135b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:16.691824 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fca904-680f-4c7e-ab7e-736c4d83135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:16.785338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-f0fca904-680f-4c7e-ab7e-736c4d83135b None None] MFA Rules not processed for user `ea872bd7ac2f4640a97648ccf96c02da`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:16.786583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f0fca904-680f-4c7e-ab7e-736c4d83135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:16.836650 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:16.870057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 688/1372] 10.222.0.73 () {58 vars in 1061 bytes} [Mon Aug 29 23:49:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:16.878501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a2754-811b-409b-867f-3f8567d80979 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:16.880044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-262a2754-811b-409b-867f-3f8567d80979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:16.988898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a2754-811b-409b-867f-3f8567d80979 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:17.035573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:17.073093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b968cd-493d-4aa5-8cef-c425f6a511ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:17.073710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b968cd-493d-4aa5-8cef-c425f6a511ca service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:17.073987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b968cd-493d-4aa5-8cef-c425f6a511ca service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:17.074257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b968cd-493d-4aa5-8cef-c425f6a511ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:17.075979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b5b968cd-493d-4aa5-8cef-c425f6a511ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:17.210726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b968cd-493d-4aa5-8cef-c425f6a511ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:17.212809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b968cd-493d-4aa5-8cef-c425f6a511ca service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:17.243673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 685/1373] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:49:17.664321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c67c0-0e0f-4580-aa03-17ad7ea62e60 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:17.664606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c67c0-0e0f-4580-aa03-17ad7ea62e60 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:17.664878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c67c0-0e0f-4580-aa03-17ad7ea62e60 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:17.666230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 689/1374] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:17.671499 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff48af9-84cb-43b9-896c-90e8a3fb3d58 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:17.671857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff48af9-84cb-43b9-896c-90e8a3fb3d58 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:17.672160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff48af9-84cb-43b9-896c-90e8a3fb3d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:17.742042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5ff48af9-84cb-43b9-896c-90e8a3fb3d58 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:17.743326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5ff48af9-84cb-43b9-896c-90e8a3fb3d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:17.765530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:17.842099 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 686/1375] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:18.132324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c67c0-0e0f-4580-aa03-17ad7ea62e60 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:18.133881 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d66c67c0-0e0f-4580-aa03-17ad7ea62e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:18.280594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c67c0-0e0f-4580-aa03-17ad7ea62e60 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:18.333367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:18.395812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e582744-c13c-4712-ba3f-cfdf12f57a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:18.396419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e582744-c13c-4712-ba3f-cfdf12f57a16 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:18.396702 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e582744-c13c-4712-ba3f-cfdf12f57a16 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:18.396975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e582744-c13c-4712-ba3f-cfdf12f57a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:18.398588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5e582744-c13c-4712-ba3f-cfdf12f57a16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:18.490644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e582744-c13c-4712-ba3f-cfdf12f57a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:18.492287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e582744-c13c-4712-ba3f-cfdf12f57a16 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:18.510422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 690/1376] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:20.603621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a46eb-ce18-4e82-a8b9-79e146998106 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:20.604167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a46eb-ce18-4e82-a8b9-79e146998106 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:20.604290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a46eb-ce18-4e82-a8b9-79e146998106 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:20.605551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 687/1377] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:20.610710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a3103-9b2e-4056-ab88-5f3676aa2dd8 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:20.611867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a3103-9b2e-4056-ab88-5f3676aa2dd8 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:20.611867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a3103-9b2e-4056-ab88-5f3676aa2dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:20.679308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-fa1a3103-9b2e-4056-ab88-5f3676aa2dd8 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:20.680538 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-fa1a3103-9b2e-4056-ab88-5f3676aa2dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:20.687733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:20.790126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 691/1378] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:21.097243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a46eb-ce18-4e82-a8b9-79e146998106 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:21.098768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-554a46eb-ce18-4e82-a8b9-79e146998106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:21.259290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a46eb-ce18-4e82-a8b9-79e146998106 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:21.263348 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:21.386654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf57d6-5a67-4919-9e6a-7c188a645e7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:21.387545 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf57d6-5a67-4919-9e6a-7c188a645e7f service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:21.387983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf57d6-5a67-4919-9e6a-7c188a645e7f service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:21.388375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf57d6-5a67-4919-9e6a-7c188a645e7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:21.390530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-20bf57d6-5a67-4919-9e6a-7c188a645e7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:21.491957 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf57d6-5a67-4919-9e6a-7c188a645e7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:21.493587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf57d6-5a67-4919-9e6a-7c188a645e7f service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:21.513872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 688/1379] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:23.544567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29bfe4-6716-401e-b042-269f42312d44 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:23.545120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29bfe4-6716-401e-b042-269f42312d44 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:23.545120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29bfe4-6716-401e-b042-269f42312d44 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:23.546607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 692/1380] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:49:23.551833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371b512-89f4-4c90-be82-11ff5e4020e0 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:23.552275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371b512-89f4-4c90-be82-11ff5e4020e0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:23.552401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371b512-89f4-4c90-be82-11ff5e4020e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:23.564417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:23.623996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-3371b512-89f4-4c90-be82-11ff5e4020e0 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:23.625210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3371b512-89f4-4c90-be82-11ff5e4020e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:23.746941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 689/1381] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:24.032859 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29bfe4-6716-401e-b042-269f42312d44 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:24.034394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ec29bfe4-6716-401e-b042-269f42312d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:24.181755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:24.192750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29bfe4-6716-401e-b042-269f42312d44 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:24.311868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de10e1-215e-49f2-90ce-aba4ccc37e72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:24.312760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de10e1-215e-49f2-90ce-aba4ccc37e72 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:24.313153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de10e1-215e-49f2-90ce-aba4ccc37e72 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:24.313523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de10e1-215e-49f2-90ce-aba4ccc37e72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:24.315312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-20de10e1-215e-49f2-90ce-aba4ccc37e72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:24.412495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de10e1-215e-49f2-90ce-aba4ccc37e72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:24.414238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de10e1-215e-49f2-90ce-aba4ccc37e72 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:24.425419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:24.438264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 693/1382] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:26.903600 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24270675-44fd-4de9-b040-9632d508a94a None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:26.904187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24270675-44fd-4de9-b040-9632d508a94a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:26.904289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24270675-44fd-4de9-b040-9632d508a94a None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:26.906046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 690/1383] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:26.912392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd8f38-8022-468d-94f5-52c2b94a8558 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:26.912819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd8f38-8022-468d-94f5-52c2b94a8558 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:26.913096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd8f38-8022-468d-94f5-52c2b94a8558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:26.997729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-33cd8f38-8022-468d-94f5-52c2b94a8558 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:26.999467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-33cd8f38-8022-468d-94f5-52c2b94a8558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:27.104383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 694/1384] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:27.389387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24270675-44fd-4de9-b040-9632d508a94a None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:27.391036 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-24270675-44fd-4de9-b040-9632d508a94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:27.480748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:27.544504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24270675-44fd-4de9-b040-9632d508a94a None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:27.672139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55ded1-0919-4c0e-aa5c-0c64a2dd38b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:27.672699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55ded1-0919-4c0e-aa5c-0c64a2dd38b4 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:27.673056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55ded1-0919-4c0e-aa5c-0c64a2dd38b4 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:27.673358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55ded1-0919-4c0e-aa5c-0c64a2dd38b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:27.675092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7c55ded1-0919-4c0e-aa5c-0c64a2dd38b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:27.725740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:27.770766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55ded1-0919-4c0e-aa5c-0c64a2dd38b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:27.772875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55ded1-0919-4c0e-aa5c-0c64a2dd38b4 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:27.793631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 691/1385] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:30.247521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93f626-ddcd-4b4c-8629-b2384e87a83f None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:30.248075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93f626-ddcd-4b4c-8629-b2384e87a83f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:30.248075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93f626-ddcd-4b4c-8629-b2384e87a83f None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:30.249449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 695/1386] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:30.255553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf601-a21a-47b3-b988-776b84609276 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:30.256071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf601-a21a-47b3-b988-776b84609276 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:30.256071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf601-a21a-47b3-b988-776b84609276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:30.323582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8c7bf601-a21a-47b3-b988-776b84609276 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:30.324782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8c7bf601-a21a-47b3-b988-776b84609276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:30.427444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 692/1387] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:30.716889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93f626-ddcd-4b4c-8629-b2384e87a83f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:30.718661 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-df93f626-ddcd-4b4c-8629-b2384e87a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:30.798515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:30.871324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93f626-ddcd-4b4c-8629-b2384e87a83f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:30.986692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8144ea-f0ce-49de-ba7b-a51c3a35c0f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:30.987261 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8144ea-f0ce-49de-ba7b-a51c3a35c0f2 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:30.987542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8144ea-f0ce-49de-ba7b-a51c3a35c0f2 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:30.987815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8144ea-f0ce-49de-ba7b-a51c3a35c0f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:30.989429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4d8144ea-f0ce-49de-ba7b-a51c3a35c0f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:31.028934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:31.082369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8144ea-f0ce-49de-ba7b-a51c3a35c0f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:31.084014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8144ea-f0ce-49de-ba7b-a51c3a35c0f2 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:31.103087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 696/1388] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:32.601862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526099a-4d8d-4e68-8398-c6d0103ae213 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:32.602401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526099a-4d8d-4e68-8398-c6d0103ae213 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:32.602401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526099a-4d8d-4e68-8398-c6d0103ae213 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:32.603746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 693/1389] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:32.609063 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c2001-24ad-4b17-98cf-ffae2b228cfb None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:32.609973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c2001-24ad-4b17-98cf-ffae2b228cfb None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:32.614153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c2001-24ad-4b17-98cf-ffae2b228cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:32.677884 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-8e5c2001-24ad-4b17-98cf-ffae2b228cfb None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:32.679145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8e5c2001-24ad-4b17-98cf-ffae2b228cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:32.781267 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 697/1390] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:33.086037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0874f6f-15a1-48ed-9cef-4c9eb648a371 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:33.086320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0874f6f-15a1-48ed-9cef-4c9eb648a371 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:33.086617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0874f6f-15a1-48ed-9cef-4c9eb648a371 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:33.088005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 694/1391] 10.222.0.73 () {54 vars in 967 bytes} [Mon Aug 29 23:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:33.093354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1cac9-096b-4489-b963-e947bd91823b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:33.094204 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1cac9-096b-4489-b963-e947bd91823b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:33.094537 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1cac9-096b-4489-b963-e947bd91823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:33.112006 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:33.159988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1022-27d5-435d-ba4c-5bd9553571c1 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:33.160271 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1022-27d5-435d-ba4c-5bd9553571c1 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:33.160541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1022-27d5-435d-ba4c-5bd9553571c1 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:33.161888 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 695/1392] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:49:33.166743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae5f02-0c7e-4dc4-9bec-0d1b2f8f47e1 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:33.167053 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae5f02-0c7e-4dc4-9bec-0d1b2f8f47e1 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:33.167323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae5f02-0c7e-4dc4-9bec-0d1b2f8f47e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:33.172513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a3c1cac9-096b-4489-b963-e947bd91823b None None] MFA Rules not processed for user `7a10328a436c4159b6519e5493ba57f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:33.173730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a3c1cac9-096b-4489-b963-e947bd91823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:33.203897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:33.235865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-9aae5f02-0c7e-4dc4-9bec-0d1b2f8f47e1 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:33.237107 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9aae5f02-0c7e-4dc4-9bec-0d1b2f8f47e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:33.250217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 698/1393] 10.222.0.73 () {58 vars in 1064 bytes} [Mon Aug 29 23:49:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:33.257636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1cac9-096b-4489-b963-e947bd91823b None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:33.264954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1cac9-096b-4489-b963-e947bd91823b None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:33.335590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 696/1394] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:49:33.340369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae06c9-4e04-4794-9057-118b3e2be22c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a10328a436c4159b6519e5493ba57f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:33.340971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae06c9-4e04-4794-9057-118b3e2be22c service glance] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:33.341250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae06c9-4e04-4794-9057-118b3e2be22c service glance] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:33.341513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae06c9-4e04-4794-9057-118b3e2be22c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:33.343388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cbae06c9-4e04-4794-9057-118b3e2be22c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:33.373518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:33.452289 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae06c9-4e04-4794-9057-118b3e2be22c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:33.454241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae06c9-4e04-4794-9057-118b3e2be22c service glance] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:33.475093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 699/1395] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:49:33.623890 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae5f02-0c7e-4dc4-9bec-0d1b2f8f47e1 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:33.625599 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9aae5f02-0c7e-4dc4-9bec-0d1b2f8f47e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:33.744995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:33.748940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae5f02-0c7e-4dc4-9bec-0d1b2f8f47e1 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:33.865635 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30655680-037e-47f2-9beb-65085d165e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:33.866168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655680-037e-47f2-9beb-65085d165e2e service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:33.866453 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655680-037e-47f2-9beb-65085d165e2e service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:33.866731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655680-037e-47f2-9beb-65085d165e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:33.868537 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-30655680-037e-47f2-9beb-65085d165e2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:33.966736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30655680-037e-47f2-9beb-65085d165e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:33.968642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30655680-037e-47f2-9beb-65085d165e2e service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:33.983947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:33.987584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 697/1396] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:34.359190 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03243bae-1147-45ed-9051-5721aba42c6f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:34.360197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03243bae-1147-45ed-9051-5721aba42c6f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:34.360542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03243bae-1147-45ed-9051-5721aba42c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:34.427789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-03243bae-1147-45ed-9051-5721aba42c6f None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:34.428920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-03243bae-1147-45ed-9051-5721aba42c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:34.509531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:34.515386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 700/1397] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Aug 29 23:49:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:34.563306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002a6e9-fe9a-4ddb-9350-88ed7f3a9571 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:34.563655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002a6e9-fe9a-4ddb-9350-88ed7f3a9571 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:34.566208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002a6e9-fe9a-4ddb-9350-88ed7f3a9571 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:34.566208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 698/1398] 10.222.0.73 () {54 vars in 943 bytes} [Mon Aug 29 23:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:34.571853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362f070-c9a0-4298-bd3f-3fe71eb72663 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:34.572269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362f070-c9a0-4298-bd3f-3fe71eb72663 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:34.572604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362f070-c9a0-4298-bd3f-3fe71eb72663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:34.651899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e362f070-c9a0-4298-bd3f-3fe71eb72663 None None] MFA Rules not processed for user `a75fb249079b4831be08cc4c9f94d6df`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:34.653103 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e362f070-c9a0-4298-bd3f-3fe71eb72663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:34.768658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 701/1399] 10.222.0.73 () {58 vars in 1040 bytes} [Mon Aug 29 23:49:34 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:34.778301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002a6e9-fe9a-4ddb-9350-88ed7f3a9571 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:34.779937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4002a6e9-fe9a-4ddb-9350-88ed7f3a9571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:34.917093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002a6e9-fe9a-4ddb-9350-88ed7f3a9571 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:35.002467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:35.021064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49fd22-a7cb-4c1a-a9d5-b4b4e18d4532 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:35.022410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fd22-a7cb-4c1a-a9d5-b4b4e18d4532 service swift] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:35.022410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fd22-a7cb-4c1a-a9d5-b4b4e18d4532 service swift] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:35.022410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fd22-a7cb-4c1a-a9d5-b4b4e18d4532 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:35.023854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fa49fd22-a7cb-4c1a-a9d5-b4b4e18d4532 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:35.106830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49fd22-a7cb-4c1a-a9d5-b4b4e18d4532 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:35.108467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49fd22-a7cb-4c1a-a9d5-b4b4e18d4532 service swift] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:35.117114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 699/1400] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Aug 29 23:49:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:49:36.094145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9358d-4af3-4190-a380-aa9f4685d196 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:36.094709 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9358d-4af3-4190-a380-aa9f4685d196 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:36.094709 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9358d-4af3-4190-a380-aa9f4685d196 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:36.099989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 702/1401] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:36.101629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab59263-d189-4cca-bbf7-737314083380 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:36.102077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab59263-d189-4cca-bbf7-737314083380 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:36.102168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab59263-d189-4cca-bbf7-737314083380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:36.178494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-bab59263-d189-4cca-bbf7-737314083380 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:36.180773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-bab59263-d189-4cca-bbf7-737314083380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:36.261539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:36.292612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 700/1402] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:36.585123 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9358d-4af3-4190-a380-aa9f4685d196 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:36.586978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8ac9358d-4af3-4190-a380-aa9f4685d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:36.650195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:36.760934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9358d-4af3-4190-a380-aa9f4685d196 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:36.956552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d9ff8-1e15-453f-a640-3e5366c0e26c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:36.956552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d9ff8-1e15-453f-a640-3e5366c0e26c service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:36.956552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d9ff8-1e15-453f-a640-3e5366c0e26c service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:36.956552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d9ff8-1e15-453f-a640-3e5366c0e26c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:36.957091 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5c5d9ff8-1e15-453f-a640-3e5366c0e26c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:36.957091 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:37.040698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d9ff8-1e15-453f-a640-3e5366c0e26c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:37.042437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d9ff8-1e15-453f-a640-3e5366c0e26c service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:37.066923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 703/1403] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:39.464578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1193b97-2804-46c6-91c9-e09f925869da None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:39.465175 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1193b97-2804-46c6-91c9-e09f925869da None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:39.465175 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1193b97-2804-46c6-91c9-e09f925869da None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:39.470921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 701/1404] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:39.472650 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e916852-077a-4600-9543-66c94976be53 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:39.473075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e916852-077a-4600-9543-66c94976be53 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:39.477221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e916852-077a-4600-9543-66c94976be53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:39.552418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-7e916852-077a-4600-9543-66c94976be53 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:39.553661 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7e916852-077a-4600-9543-66c94976be53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:39.664343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:39.673997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 704/1405] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:39.964864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1193b97-2804-46c6-91c9-e09f925869da None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:39.966536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f1193b97-2804-46c6-91c9-e09f925869da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:40.126125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1193b97-2804-46c6-91c9-e09f925869da None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:40.191138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:40.261673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce77d1-0c22-4c6c-8281-acb0b17b2f69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:40.262500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce77d1-0c22-4c6c-8281-acb0b17b2f69 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:40.262857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce77d1-0c22-4c6c-8281-acb0b17b2f69 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:40.263313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce77d1-0c22-4c6c-8281-acb0b17b2f69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:40.265062 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-42ce77d1-0c22-4c6c-8281-acb0b17b2f69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:40.369264 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce77d1-0c22-4c6c-8281-acb0b17b2f69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:40.371142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce77d1-0c22-4c6c-8281-acb0b17b2f69 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:40.393121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 702/1406] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:42.558254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aae0eb-5f56-43b1-90e8-e1350f8aebec None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:42.558842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aae0eb-5f56-43b1-90e8-e1350f8aebec None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:42.559218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aae0eb-5f56-43b1-90e8-e1350f8aebec None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:42.560748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 705/1407] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:42.570069 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1757a-1393-4f07-b450-2f0867f7a79b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:42.570669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1757a-1393-4f07-b450-2f0867f7a79b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:42.570964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1757a-1393-4f07-b450-2f0867f7a79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:42.654741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-cdc1757a-1393-4f07-b450-2f0867f7a79b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:42.656069 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-cdc1757a-1393-4f07-b450-2f0867f7a79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:42.682131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:42.772034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 703/1408] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:43.078278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aae0eb-5f56-43b1-90e8-e1350f8aebec None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:43.080253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-65aae0eb-5f56-43b1-90e8-e1350f8aebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:43.248249 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aae0eb-5f56-43b1-90e8-e1350f8aebec None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:43.322317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:43.375670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65509c5e-6700-4ee7-bb99-a38f950c3d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:43.376384 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65509c5e-6700-4ee7-bb99-a38f950c3d2e service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:43.376743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65509c5e-6700-4ee7-bb99-a38f950c3d2e service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:43.377019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65509c5e-6700-4ee7-bb99-a38f950c3d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:43.378697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-65509c5e-6700-4ee7-bb99-a38f950c3d2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:43.482013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65509c5e-6700-4ee7-bb99-a38f950c3d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:43.483666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65509c5e-6700-4ee7-bb99-a38f950c3d2e service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:43.507296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 706/1409] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:53.171614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=37 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:53.504811 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=65 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:59.071745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8efc20-ac28-494f-b8a6-58ec42011cdf None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:59.072295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8efc20-ac28-494f-b8a6-58ec42011cdf None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:59.072295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8efc20-ac28-494f-b8a6-58ec42011cdf None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:59.073634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 704/1410] 10.222.0.73 () {54 vars in 918 bytes} [Mon Aug 29 23:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:59.078658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa1d59-cfa5-468a-814f-a083c48511f4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:59.079136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa1d59-cfa5-468a-814f-a083c48511f4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:59.079244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa1d59-cfa5-468a-814f-a083c48511f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:59.155597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-94aa1d59-cfa5-468a-814f-a083c48511f4 None None] MFA Rules not processed for user `ce79452e14fa4984875dca43672ed25a`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:59.156812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-94aa1d59-cfa5-468a-814f-a083c48511f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:59.261129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 707/1411] 10.222.0.73 () {58 vars in 1015 bytes} [Mon Aug 29 23:49:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:59.275505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d7ab-2c03-4471-abec-b6a14e4d7933 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:59.275789 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d7ab-2c03-4471-abec-b6a14e4d7933 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:59.276063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d7ab-2c03-4471-abec-b6a14e4d7933 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:59.277396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 705/1412] 10.222.0.73 () {54 vars in 918 bytes} [Mon Aug 29 23:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:49:59.282644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215a32c-0ca7-4e34-a6c1-150c82203527 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:59.282952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215a32c-0ca7-4e34-a6c1-150c82203527 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:59.283222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215a32c-0ca7-4e34-a6c1-150c82203527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:59.354197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:59.357154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-1215a32c-0ca7-4e34-a6c1-150c82203527 None None] MFA Rules not processed for user `59a1b0b274294a288dbf07cd99f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:59.358965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1215a32c-0ca7-4e34-a6c1-150c82203527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:59.475456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 708/1413] 10.222.0.73 () {58 vars in 1015 bytes} [Mon Aug 29 23:49:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:01.847113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e96fc-7932-43d8-a2ca-aeba29bf21ba None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:01.847645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e96fc-7932-43d8-a2ca-aeba29bf21ba None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:01.847645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e96fc-7932-43d8-a2ca-aeba29bf21ba None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:01.848908 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:01.854136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4dc68-d56e-4b9f-b40f-d8b42611f0a4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:01.854580 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4dc68-d56e-4b9f-b40f-d8b42611f0a4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:01.854816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4dc68-d56e-4b9f-b40f-d8b42611f0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:01.921149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-fda4dc68-d56e-4b9f-b40f-d8b42611f0a4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:01.922363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-fda4dc68-d56e-4b9f-b40f-d8b42611f0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:01.976455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:02.019419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:02.305550 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e96fc-7932-43d8-a2ca-aeba29bf21ba None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:02.307103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-976e96fc-7932-43d8-a2ca-aeba29bf21ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:02.449188 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e96fc-7932-43d8-a2ca-aeba29bf21ba None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:02.520050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:02.559230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efb999-a603-428a-a6dc-7a094bc5c921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:02.559768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb999-a603-428a-a6dc-7a094bc5c921 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:02.560045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb999-a603-428a-a6dc-7a094bc5c921 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:02.560314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb999-a603-428a-a6dc-7a094bc5c921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:02.561974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f8efb999-a603-428a-a6dc-7a094bc5c921 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:02.649062 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efb999-a603-428a-a6dc-7a094bc5c921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:02.650679 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efb999-a603-428a-a6dc-7a094bc5c921 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:02.669457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 707/1416] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:03.559726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8386a96-dcd2-4d9b-b2a9-07ef9e69aa47 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:03.560174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8386a96-dcd2-4d9b-b2a9-07ef9e69aa47 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:03.560278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8386a96-dcd2-4d9b-b2a9-07ef9e69aa47 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:03.561770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:03.566731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62096ad-3c13-458e-9a80-6e5e2a5745a5 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:03.567198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62096ad-3c13-458e-9a80-6e5e2a5745a5 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:03.567296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62096ad-3c13-458e-9a80-6e5e2a5745a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:03.641603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a62096ad-3c13-458e-9a80-6e5e2a5745a5 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:03.642808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a62096ad-3c13-458e-9a80-6e5e2a5745a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:03.669233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:03.737966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:03.892023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8386a96-dcd2-4d9b-b2a9-07ef9e69aa47 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:03.893482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e8386a96-dcd2-4d9b-b2a9-07ef9e69aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:04.038866 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8386a96-dcd2-4d9b-b2a9-07ef9e69aa47 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:04.079843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:04.151659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af87e29-8b85-4be0-beea-c5d557da9b15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:04.152190 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af87e29-8b85-4be0-beea-c5d557da9b15 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:04.152464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af87e29-8b85-4be0-beea-c5d557da9b15 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:04.152732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af87e29-8b85-4be0-beea-c5d557da9b15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:04.154341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-3af87e29-8b85-4be0-beea-c5d557da9b15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:04.244467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af87e29-8b85-4be0-beea-c5d557da9b15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:04.246086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af87e29-8b85-4be0-beea-c5d557da9b15 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:04.264026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 711/1419] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:50:05.145191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e789954-263e-497b-bf21-4eff8e616bcc None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:05.145774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e789954-263e-497b-bf21-4eff8e616bcc None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:05.145774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e789954-263e-497b-bf21-4eff8e616bcc None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:05.147126 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:05.151938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33da162-0ee1-4430-80eb-287ad8304ab8 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:05.152367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33da162-0ee1-4430-80eb-287ad8304ab8 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:05.152490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33da162-0ee1-4430-80eb-287ad8304ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:05.206468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:05.227878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-c33da162-0ee1-4430-80eb-287ad8304ab8 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:05.229094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c33da162-0ee1-4430-80eb-287ad8304ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:05.324805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:05.475176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e789954-263e-497b-bf21-4eff8e616bcc None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:05.476754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8e789954-263e-497b-bf21-4eff8e616bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:05.624743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e789954-263e-497b-bf21-4eff8e616bcc None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:05.636729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:05.737145 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51166295-0a87-4747-8f0d-dcb6c6c22651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:05.737676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51166295-0a87-4747-8f0d-dcb6c6c22651 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:05.737961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51166295-0a87-4747-8f0d-dcb6c6c22651 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:05.738226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51166295-0a87-4747-8f0d-dcb6c6c22651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:05.739886 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-51166295-0a87-4747-8f0d-dcb6c6c22651 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:05.828131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51166295-0a87-4747-8f0d-dcb6c6c22651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:05.829713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51166295-0a87-4747-8f0d-dcb6c6c22651 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:05.847812 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 710/1422] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:06.709978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe4499-eeb3-49df-aa4d-b046cb5773ac None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:06.710546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe4499-eeb3-49df-aa4d-b046cb5773ac None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:06.710546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe4499-eeb3-49df-aa4d-b046cb5773ac None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:06.711926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:06.716833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b8db5-6322-448e-ac3d-19c177da2225 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:06.717234 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b8db5-6322-448e-ac3d-19c177da2225 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:06.717664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b8db5-6322-448e-ac3d-19c177da2225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:06.737642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:06.794311 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-099b8db5-6322-448e-ac3d-19c177da2225 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:06.795554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-099b8db5-6322-448e-ac3d-19c177da2225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:06.894276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:07.045207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe4499-eeb3-49df-aa4d-b046cb5773ac None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:07.047348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6ebe4499-eeb3-49df-aa4d-b046cb5773ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:07.164762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:07.201536 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe4499-eeb3-49df-aa4d-b046cb5773ac None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:07.313826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29c5da-46d4-494b-9bb4-2d519a300077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:07.314360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29c5da-46d4-494b-9bb4-2d519a300077 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:07.314642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29c5da-46d4-494b-9bb4-2d519a300077 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:07.315007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29c5da-46d4-494b-9bb4-2d519a300077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:07.316657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-fb29c5da-46d4-494b-9bb4-2d519a300077 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:07.392437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:07.406158 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29c5da-46d4-494b-9bb4-2d519a300077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:07.407795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29c5da-46d4-494b-9bb4-2d519a300077 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:07.426639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 714/1425] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:08.294041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191382e6-8989-473c-9738-0a6b7e5777ed None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:08.294615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191382e6-8989-473c-9738-0a6b7e5777ed None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:08.294615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191382e6-8989-473c-9738-0a6b7e5777ed None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:08.296007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:08.300947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549a6d8-e460-4674-a7d5-f08b67e10a44 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:08.301384 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549a6d8-e460-4674-a7d5-f08b67e10a44 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:08.301482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549a6d8-e460-4674-a7d5-f08b67e10a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:08.376953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-0549a6d8-e460-4674-a7d5-f08b67e10a44 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:08.378161 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0549a6d8-e460-4674-a7d5-f08b67e10a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:08.476420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:08.625820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191382e6-8989-473c-9738-0a6b7e5777ed None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:08.627388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-191382e6-8989-473c-9738-0a6b7e5777ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:08.711603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:08.777387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191382e6-8989-473c-9738-0a6b7e5777ed None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:08.889119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed43411-e035-45b9-85db-717bc37573dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:08.889646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed43411-e035-45b9-85db-717bc37573dd service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:08.889927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed43411-e035-45b9-85db-717bc37573dd service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:08.890197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed43411-e035-45b9-85db-717bc37573dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:08.891852 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6ed43411-e035-45b9-85db-717bc37573dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:08.939883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:08.980794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed43411-e035-45b9-85db-717bc37573dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:08.982394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed43411-e035-45b9-85db-717bc37573dd service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:09.000773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 713/1428] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:09.847937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28efffc-6d33-4c81-ab5c-343e1a6cd67a None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:09.848621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28efffc-6d33-4c81-ab5c-343e1a6cd67a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:09.848621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28efffc-6d33-4c81-ab5c-343e1a6cd67a None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:09.849975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:50:09.855241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba931d0-b624-4b2a-8369-28cd6a1abc0f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:09.855650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba931d0-b624-4b2a-8369-28cd6a1abc0f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:09.855800 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba931d0-b624-4b2a-8369-28cd6a1abc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:09.933798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-0ba931d0-b624-4b2a-8369-28cd6a1abc0f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:09.935091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0ba931d0-b624-4b2a-8369-28cd6a1abc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:10.031790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:10.181961 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28efffc-6d33-4c81-ab5c-343e1a6cd67a None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:10.183534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c28efffc-6d33-4c81-ab5c-343e1a6cd67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:10.232439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:10.330004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28efffc-6d33-4c81-ab5c-343e1a6cd67a None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:10.442259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef21d8-5f79-4167-814d-3d965c92dc85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:10.442862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef21d8-5f79-4167-814d-3d965c92dc85 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:10.443170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef21d8-5f79-4167-814d-3d965c92dc85 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:10.443440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef21d8-5f79-4167-814d-3d965c92dc85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:10.445056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-49ef21d8-5f79-4167-814d-3d965c92dc85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:10.453157 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:10.535938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef21d8-5f79-4167-814d-3d965c92dc85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:10.537525 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef21d8-5f79-4167-814d-3d965c92dc85 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:10.555885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 717/1431] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:11.414277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a21c78-def9-4983-a251-a7259dbd031b None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:11.414824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a21c78-def9-4983-a251-a7259dbd031b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:11.414824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a21c78-def9-4983-a251-a7259dbd031b None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:11.416181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:11.421541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408a8b2-4bae-4477-9c1c-818d5586b8d2 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:11.421946 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408a8b2-4bae-4477-9c1c-818d5586b8d2 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:11.422102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408a8b2-4bae-4477-9c1c-818d5586b8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:11.497459 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-1408a8b2-4bae-4477-9c1c-818d5586b8d2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:11.499302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1408a8b2-4bae-4477-9c1c-818d5586b8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:11.567173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:11.595440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:11.744673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a21c78-def9-4983-a251-a7259dbd031b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:11.746206 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-54a21c78-def9-4983-a251-a7259dbd031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:11.764322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:11.897879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a21c78-def9-4983-a251-a7259dbd031b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:12.105128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:12.131627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83850c8-d392-49eb-8193-a5f732d1873b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:12.132232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83850c8-d392-49eb-8193-a5f732d1873b service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:12.132511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83850c8-d392-49eb-8193-a5f732d1873b service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:12.132782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83850c8-d392-49eb-8193-a5f732d1873b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:12.135157 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f83850c8-d392-49eb-8193-a5f732d1873b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:12.223793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83850c8-d392-49eb-8193-a5f732d1873b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:12.225374 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83850c8-d392-49eb-8193-a5f732d1873b service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:12.243193 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 716/1434] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:13.080478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0cd0a-be26-47d5-a566-0acdee06075c None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:13.081023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0cd0a-be26-47d5-a566-0acdee06075c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:13.081023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0cd0a-be26-47d5-a566-0acdee06075c None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:13.082360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:13.087228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff7dbb-2538-4e4f-a0c5-eb3b269afe75 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:13.087608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff7dbb-2538-4e4f-a0c5-eb3b269afe75 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:13.087786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff7dbb-2538-4e4f-a0c5-eb3b269afe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:13.163713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-93ff7dbb-2538-4e4f-a0c5-eb3b269afe75 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:13.164931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-93ff7dbb-2538-4e4f-a0c5-eb3b269afe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:13.206773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:13.261512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:13.411455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0cd0a-be26-47d5-a566-0acdee06075c None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:13.412910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a4f0cd0a-be26-47d5-a566-0acdee06075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:13.564703 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0cd0a-be26-47d5-a566-0acdee06075c None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:13.619061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:13.678926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b75d0-3ba6-4edb-bcbd-f176db35dc67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:13.679474 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b75d0-3ba6-4edb-bcbd-f176db35dc67 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:13.679758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b75d0-3ba6-4edb-bcbd-f176db35dc67 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:13.680036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b75d0-3ba6-4edb-bcbd-f176db35dc67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:13.681783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-956b75d0-3ba6-4edb-bcbd-f176db35dc67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:13.772348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b75d0-3ba6-4edb-bcbd-f176db35dc67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:13.773944 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b75d0-3ba6-4edb-bcbd-f176db35dc67 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:13.791936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 720/1437] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:14.658014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f3942-51f5-4ff9-b899-3b074ce8f242 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:14.658582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f3942-51f5-4ff9-b899-3b074ce8f242 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:14.658582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f3942-51f5-4ff9-b899-3b074ce8f242 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:14.659988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:14.664870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc756b-2ca9-47ac-97c4-4a287c22dd21 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:14.665270 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc756b-2ca9-47ac-97c4-4a287c22dd21 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:14.665424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc756b-2ca9-47ac-97c4-4a287c22dd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:14.740731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-bdcc756b-2ca9-47ac-97c4-4a287c22dd21 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:14.742016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bdcc756b-2ca9-47ac-97c4-4a287c22dd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:14.743996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:14.840127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:14.990832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f3942-51f5-4ff9-b899-3b074ce8f242 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:14.992332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-651f3942-51f5-4ff9-b899-3b074ce8f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:15.138207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f3942-51f5-4ff9-b899-3b074ce8f242 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:15.165136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:15.252209 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401482f-aba1-4a88-be5c-3c864fd147d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:15.252809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401482f-aba1-4a88-be5c-3c864fd147d1 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:15.253080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401482f-aba1-4a88-be5c-3c864fd147d1 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:15.253344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401482f-aba1-4a88-be5c-3c864fd147d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:15.254969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4401482f-aba1-4a88-be5c-3c864fd147d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:15.342424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401482f-aba1-4a88-be5c-3c864fd147d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:15.344029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401482f-aba1-4a88-be5c-3c864fd147d1 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:15.362142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 719/1440] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:17.178366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f9f8f-8414-45ac-ad07-97e2c1898ca4 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:17.179002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f9f8f-8414-45ac-ad07-97e2c1898ca4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:17.179002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f9f8f-8414-45ac-ad07-97e2c1898ca4 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:17.180309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:17.185929 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19371d16-2524-4014-a5da-8f54f71ac647 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:17.186373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19371d16-2524-4014-a5da-8f54f71ac647 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:17.186512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19371d16-2524-4014-a5da-8f54f71ac647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:17.228704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:17.254548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-19371d16-2524-4014-a5da-8f54f71ac647 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:17.255791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-19371d16-2524-4014-a5da-8f54f71ac647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:17.351030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:17.635876 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f9f8f-8414-45ac-ad07-97e2c1898ca4 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:17.637425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-102f9f8f-8414-45ac-ad07-97e2c1898ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:17.740145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f9f8f-8414-45ac-ad07-97e2c1898ca4 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:17.773053 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:17.815453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1565870-b530-498d-ada3-c66cd0ee1d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:17.816039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1565870-b530-498d-ada3-c66cd0ee1d1e service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:17.816323 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1565870-b530-498d-ada3-c66cd0ee1d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:17.816597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1565870-b530-498d-ada3-c66cd0ee1d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:17.818215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c1565870-b530-498d-ada3-c66cd0ee1d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:17.929804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1565870-b530-498d-ada3-c66cd0ee1d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:17.931270 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1565870-b530-498d-ada3-c66cd0ee1d1e service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:17.949523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 723/1443] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:20.002198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472bffe-7151-4b0c-a801-e22ca8a79d4c None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:20.002796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472bffe-7151-4b0c-a801-e22ca8a79d4c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:20.002796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472bffe-7151-4b0c-a801-e22ca8a79d4c None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:20.004183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:20.009505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420713ed-2833-4e2e-9e03-6483ec6a433a None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:20.009913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420713ed-2833-4e2e-9e03-6483ec6a433a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:20.010057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420713ed-2833-4e2e-9e03-6483ec6a433a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:20.075658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-420713ed-2833-4e2e-9e03-6483ec6a433a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:20.077376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-420713ed-2833-4e2e-9e03-6483ec6a433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:20.090077 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:20.173808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:20.456412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472bffe-7151-4b0c-a801-e22ca8a79d4c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:20.457992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c472bffe-7151-4b0c-a801-e22ca8a79d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:20.561333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472bffe-7151-4b0c-a801-e22ca8a79d4c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:20.573351 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:20.633816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d12ccc-3690-4af3-beb5-77811e8ec097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:20.634424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d12ccc-3690-4af3-beb5-77811e8ec097 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:20.634734 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d12ccc-3690-4af3-beb5-77811e8ec097 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:20.635044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d12ccc-3690-4af3-beb5-77811e8ec097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:20.636693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e8d12ccc-3690-4af3-beb5-77811e8ec097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:20.746120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d12ccc-3690-4af3-beb5-77811e8ec097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:20.747571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d12ccc-3690-4af3-beb5-77811e8ec097 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:20.765720 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 722/1446] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:23.103964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fbf23-2dad-40ce-814b-c74d2bd293ee None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:23.104524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fbf23-2dad-40ce-814b-c74d2bd293ee None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:23.104524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fbf23-2dad-40ce-814b-c74d2bd293ee None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:23.105898 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:23.112039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c9790-a04f-460b-a302-b37e9a6b4db7 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:23.112453 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c9790-a04f-460b-a302-b37e9a6b4db7 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:23.112594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c9790-a04f-460b-a302-b37e9a6b4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:23.160071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:23.178118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-484c9790-a04f-460b-a302-b37e9a6b4db7 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:23.182686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-484c9790-a04f-460b-a302-b37e9a6b4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:23.276422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:23.558934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fbf23-2dad-40ce-814b-c74d2bd293ee None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:23.560517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cc8fbf23-2dad-40ce-814b-c74d2bd293ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:23.665914 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fbf23-2dad-40ce-814b-c74d2bd293ee None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:23.705172 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:23.739659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef5274-20e6-4cd8-be7a-f4c815bd5864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:23.740274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef5274-20e6-4cd8-be7a-f4c815bd5864 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:23.740553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef5274-20e6-4cd8-be7a-f4c815bd5864 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:23.740826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef5274-20e6-4cd8-be7a-f4c815bd5864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:23.742460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e8ef5274-20e6-4cd8-be7a-f4c815bd5864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:23.851348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef5274-20e6-4cd8-be7a-f4c815bd5864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:23.852692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef5274-20e6-4cd8-be7a-f4c815bd5864 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:23.871799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 726/1449] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:25.898758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf31df-e060-49d8-888d-9ee6a5ecf2eb None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:25.899329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf31df-e060-49d8-888d-9ee6a5ecf2eb None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:25.899329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf31df-e060-49d8-888d-9ee6a5ecf2eb None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:25.900580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:25.906386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186701e-3cf6-47b6-99d4-07796f6d110b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:25.906800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186701e-3cf6-47b6-99d4-07796f6d110b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:25.906968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186701e-3cf6-47b6-99d4-07796f6d110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:25.973115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-9186701e-3cf6-47b6-99d4-07796f6d110b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:25.974318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9186701e-3cf6-47b6-99d4-07796f6d110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:25.994824 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:26.070696 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:26.352496 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf31df-e060-49d8-888d-9ee6a5ecf2eb None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:26.354064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-38cf31df-e060-49d8-888d-9ee6a5ecf2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:26.455431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf31df-e060-49d8-888d-9ee6a5ecf2eb None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:26.475328 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:26.528218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8771da9-31c2-469c-9c9f-aea8fe0923ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:26.528824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8771da9-31c2-469c-9c9f-aea8fe0923ea service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:26.529168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8771da9-31c2-469c-9c9f-aea8fe0923ea service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:26.529449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8771da9-31c2-469c-9c9f-aea8fe0923ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:26.531067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f8771da9-31c2-469c-9c9f-aea8fe0923ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:26.640685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8771da9-31c2-469c-9c9f-aea8fe0923ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:26.642040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8771da9-31c2-469c-9c9f-aea8fe0923ea service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:26.660363 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 725/1452] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:28.617150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da895cb5-aab9-4a66-afea-905e2ca31d47 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:28.617960 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da895cb5-aab9-4a66-afea-905e2ca31d47 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:28.618237 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da895cb5-aab9-4a66-afea-905e2ca31d47 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:28.619669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:28.625457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27334e8-f508-4716-803e-e4f2a82231eb None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:28.625912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27334e8-f508-4716-803e-e4f2a82231eb None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:28.626052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27334e8-f508-4716-803e-e4f2a82231eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:28.690501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:28.693035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f27334e8-f508-4716-803e-e4f2a82231eb None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:28.694230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f27334e8-f508-4716-803e-e4f2a82231eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:28.790720 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:29.082017 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da895cb5-aab9-4a66-afea-905e2ca31d47 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:29.083604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-da895cb5-aab9-4a66-afea-905e2ca31d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:29.186757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da895cb5-aab9-4a66-afea-905e2ca31d47 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:29.235660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:29.259819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e6997-0e99-4d96-99ca-daae170bae69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:29.260426 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e6997-0e99-4d96-99ca-daae170bae69 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:29.260711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e6997-0e99-4d96-99ca-daae170bae69 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:29.260979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e6997-0e99-4d96-99ca-daae170bae69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:29.262606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-fe3e6997-0e99-4d96-99ca-daae170bae69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:29.374789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e6997-0e99-4d96-99ca-daae170bae69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:29.376178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e6997-0e99-4d96-99ca-daae170bae69 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:29.394838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 729/1455] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:31.334557 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a85fc5-b2a6-4f5b-91e2-9d1662b788b2 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:31.335128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a85fc5-b2a6-4f5b-91e2-9d1662b788b2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:31.335254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a85fc5-b2a6-4f5b-91e2-9d1662b788b2 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:31.336624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:31.342355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d7413-9d22-434c-ad97-d5eaf70811ab None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:31.342792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d7413-9d22-434c-ad97-d5eaf70811ab None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:31.342971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d7413-9d22-434c-ad97-d5eaf70811ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:31.410632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-263d7413-9d22-434c-ad97-d5eaf70811ab None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:31.411879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-263d7413-9d22-434c-ad97-d5eaf70811ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:31.441044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:31.508920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:31.795431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a85fc5-b2a6-4f5b-91e2-9d1662b788b2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:31.797006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-21a85fc5-b2a6-4f5b-91e2-9d1662b788b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:31.899378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a85fc5-b2a6-4f5b-91e2-9d1662b788b2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:31.927375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:31.971924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c7932-3a6a-4bad-a121-0934c93f0d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:31.972476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7932-3a6a-4bad-a121-0934c93f0d5e service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:31.972756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7932-3a6a-4bad-a121-0934c93f0d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:31.973027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7932-3a6a-4bad-a121-0934c93f0d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:31.974661 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a37c7932-3a6a-4bad-a121-0934c93f0d5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:32.082259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c7932-3a6a-4bad-a121-0934c93f0d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:32.083712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c7932-3a6a-4bad-a121-0934c93f0d5e service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:32.102005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 728/1458] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:34.051355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9f2c7-6f2a-4bd9-9ee0-cae7b51472b1 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:34.051919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9f2c7-6f2a-4bd9-9ee0-cae7b51472b1 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:34.051919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9f2c7-6f2a-4bd9-9ee0-cae7b51472b1 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:34.053260 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:34.058450 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adabca6-e073-4acd-9339-0fbd8f9b0bf7 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:34.058915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adabca6-e073-4acd-9339-0fbd8f9b0bf7 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:34.059040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adabca6-e073-4acd-9339-0fbd8f9b0bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:34.126700 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-3adabca6-e073-4acd-9339-0fbd8f9b0bf7 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:34.127947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3adabca6-e073-4acd-9339-0fbd8f9b0bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:34.136296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:34.226004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:34.506649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9f2c7-6f2a-4bd9-9ee0-cae7b51472b1 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:34.508230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1ee9f2c7-6f2a-4bd9-9ee0-cae7b51472b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:34.613274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9f2c7-6f2a-4bd9-9ee0-cae7b51472b1 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:34.667937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:34.687178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60125a57-c291-446f-beec-e008fd77597e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:34.687779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60125a57-c291-446f-beec-e008fd77597e service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:34.688059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60125a57-c291-446f-beec-e008fd77597e service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:34.688325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60125a57-c291-446f-beec-e008fd77597e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:34.689964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-60125a57-c291-446f-beec-e008fd77597e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:34.799488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60125a57-c291-446f-beec-e008fd77597e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:34.800936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60125a57-c291-446f-beec-e008fd77597e service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:34.818672 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 732/1461] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:36.753144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacc7be-04bd-44e1-a35f-3588fb6601db None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:36.753569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacc7be-04bd-44e1-a35f-3588fb6601db None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:36.753697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacc7be-04bd-44e1-a35f-3588fb6601db None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:36.755091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:36.760238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230ba17-e376-4cd4-9790-c60befdbf907 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:36.760756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230ba17-e376-4cd4-9790-c60befdbf907 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:36.760855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230ba17-e376-4cd4-9790-c60befdbf907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:36.826120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-b230ba17-e376-4cd4-9790-c60befdbf907 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:36.827370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b230ba17-e376-4cd4-9790-c60befdbf907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:36.869147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:36.928686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:37.208439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacc7be-04bd-44e1-a35f-3588fb6601db None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:37.210015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2bacc7be-04bd-44e1-a35f-3588fb6601db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:37.313298 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacc7be-04bd-44e1-a35f-3588fb6601db None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:37.350948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:37.386761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415ffce-8c01-4d4c-9f41-5974a4919f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:37.387397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415ffce-8c01-4d4c-9f41-5974a4919f7e service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:37.388274 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415ffce-8c01-4d4c-9f41-5974a4919f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:37.388809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415ffce-8c01-4d4c-9f41-5974a4919f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:37.390087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0415ffce-8c01-4d4c-9f41-5974a4919f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:37.496688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415ffce-8c01-4d4c-9f41-5974a4919f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:37.498587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415ffce-8c01-4d4c-9f41-5974a4919f7e service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:37.517108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 731/1464] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:39.426578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f2da6-b238-4fd8-80fc-68de645735be None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:39.427185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f2da6-b238-4fd8-80fc-68de645735be None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:39.427185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f2da6-b238-4fd8-80fc-68de645735be None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:39.428519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:39.433693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7c7b-e698-4e3c-af09-a2e99ae5736b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:39.434122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7c7b-e698-4e3c-af09-a2e99ae5736b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:39.434265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7c7b-e698-4e3c-af09-a2e99ae5736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:39.500117 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-48de7c7b-e698-4e3c-af09-a2e99ae5736b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:39.501334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-48de7c7b-e698-4e3c-af09-a2e99ae5736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:39.519594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:39.601146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:39.887657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f2da6-b238-4fd8-80fc-68de645735be None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:39.889370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-851f2da6-b238-4fd8-80fc-68de645735be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:39.995093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f2da6-b238-4fd8-80fc-68de645735be None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:40.061468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:40.068150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ae7e7-63b9-45f9-9334-5744974de833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:40.068755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ae7e7-63b9-45f9-9334-5744974de833 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:40.069035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ae7e7-63b9-45f9-9334-5744974de833 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:40.069308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ae7e7-63b9-45f9-9334-5744974de833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:40.070942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cd9ae7e7-63b9-45f9-9334-5744974de833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:40.180048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ae7e7-63b9-45f9-9334-5744974de833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:40.181497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ae7e7-63b9-45f9-9334-5744974de833 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:40.199484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 735/1467] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:42.131388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e4613-d689-4701-9690-e78a490d6550 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:42.131913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e4613-d689-4701-9690-e78a490d6550 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:42.131913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e4613-d689-4701-9690-e78a490d6550 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:42.133291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:50:42.139365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e142-ffa3-4ae0-8a87-bf66ac2b171f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:42.139758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e142-ffa3-4ae0-8a87-bf66ac2b171f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:42.139926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e142-ffa3-4ae0-8a87-bf66ac2b171f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:42.206652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-0b64e142-ffa3-4ae0-8a87-bf66ac2b171f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:42.207829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0b64e142-ffa3-4ae0-8a87-bf66ac2b171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:42.256481 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:42.304863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:42.588745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e4613-d689-4701-9690-e78a490d6550 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:50:42.590965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-861e4613-d689-4701-9690-e78a490d6550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:42.695106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e4613-d689-4701-9690-e78a490d6550 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:50:42.743743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:42.769269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ac242-fbbc-44b8-96b9-21fa104db4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:50:42.769878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ac242-fbbc-44b8-96b9-21fa104db4ea service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:42.770156 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ac242-fbbc-44b8-96b9-21fa104db4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:42.770425 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ac242-fbbc-44b8-96b9-21fa104db4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:42.772043 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-117ac242-fbbc-44b8-96b9-21fa104db4ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:42.879075 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ac242-fbbc-44b8-96b9-21fa104db4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:50:42.880449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ac242-fbbc-44b8-96b9-21fa104db4ea service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:50:42.898460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 734/1470] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:50:52.303058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=22 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:52.896187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=66 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:02.410607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534a50a-1bb7-4b28-a746-e2365d4536e3 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:02.411206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534a50a-1bb7-4b28-a746-e2365d4536e3 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:02.411206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534a50a-1bb7-4b28-a746-e2365d4536e3 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:02.412555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 737/1471] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:51:02.418478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfb706-06a7-43cc-aec4-6f48b4b5db03 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:02.418920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfb706-06a7-43cc-aec4-6f48b4b5db03 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:02.419062 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfb706-06a7-43cc-aec4-6f48b4b5db03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:02.484045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-95dfb706-06a7-43cc-aec4-6f48b4b5db03 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:02.485321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-95dfb706-06a7-43cc-aec4-6f48b4b5db03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:02.580587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 735/1472] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:02.876345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878f4a3-1d7d-403e-98c7-212eb6c8340e None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:02.876632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878f4a3-1d7d-403e-98c7-212eb6c8340e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:02.876909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878f4a3-1d7d-403e-98c7-212eb6c8340e None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:02.878256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 738/1473] 10.222.0.73 () {54 vars in 967 bytes} [Mon Aug 29 23:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:51:02.882945 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cef77-5809-422b-9c41-2ec49c4ba166 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:02.883236 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cef77-5809-422b-9c41-2ec49c4ba166 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:02.883511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cef77-5809-422b-9c41-2ec49c4ba166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:02.958211 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a36cef77-5809-422b-9c41-2ec49c4ba166 None None] MFA Rules not processed for user `7a10328a436c4159b6519e5493ba57f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:02.959446 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a36cef77-5809-422b-9c41-2ec49c4ba166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:02.979914 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:03.036106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 736/1474] 10.222.0.73 () {58 vars in 1064 bytes} [Mon Aug 29 23:51:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:03.043567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878f4a3-1d7d-403e-98c7-212eb6c8340e None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:03.045141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9878f4a3-1d7d-403e-98c7-212eb6c8340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:03.149203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878f4a3-1d7d-403e-98c7-212eb6c8340e None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:03.221363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d19ac5-3722-4d7b-933d-6bfacaca04b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a10328a436c4159b6519e5493ba57f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:03.221967 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d19ac5-3722-4d7b-933d-6bfacaca04b7 service glance] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:03.222249 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d19ac5-3722-4d7b-933d-6bfacaca04b7 service glance] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:03.222525 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d19ac5-3722-4d7b-933d-6bfacaca04b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:03.224155 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-09d19ac5-3722-4d7b-933d-6bfacaca04b7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:03.277695 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:03.332897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d19ac5-3722-4d7b-933d-6bfacaca04b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:03.334261 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d19ac5-3722-4d7b-933d-6bfacaca04b7 service glance] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:03.352785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 739/1475] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:05.334114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03758c3-d549-4196-b795-368978f493c6 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:05.334683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03758c3-d549-4196-b795-368978f493c6 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:05.334683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03758c3-d549-4196-b795-368978f493c6 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:05.336039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 737/1476] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:51:05.341924 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73227d-0e22-4b29-aeef-c19620554b95 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:05.342388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73227d-0e22-4b29-aeef-c19620554b95 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:05.342497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73227d-0e22-4b29-aeef-c19620554b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:05.407794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-7c73227d-0e22-4b29-aeef-c19620554b95 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:05.409005 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7c73227d-0e22-4b29-aeef-c19620554b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:05.504001 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 740/1477] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:05.781277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03758c3-d549-4196-b795-368978f493c6 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:05.782946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c03758c3-d549-4196-b795-368978f493c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:05.906139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03758c3-d549-4196-b795-368978f493c6 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:05.955123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:05.999060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037aa57-95e3-48ac-9cf2-a3c5ef8dc79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:05.999669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037aa57-95e3-48ac-9cf2-a3c5ef8dc79c admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:05.999950 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037aa57-95e3-48ac-9cf2-a3c5ef8dc79c admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:06.000218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037aa57-95e3-48ac-9cf2-a3c5ef8dc79c admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:06.000856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037aa57-95e3-48ac-9cf2-a3c5ef8dc79c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:06.002634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: WARNING py.warnings [None req-0037aa57-95e3-48ac-9cf2-a3c5ef8dc79c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:51:06.002634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: warnings.warn(msg) Aug 29 23:51:06.002634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: Aug 29 23:51:06.003878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037aa57-95e3-48ac-9cf2-a3c5ef8dc79c admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:06.023068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 738/1478] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Aug 29 23:51:05 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:07.937599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b01d8-ce72-4d88-a2bc-dcee878628a7 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:07.938152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b01d8-ce72-4d88-a2bc-dcee878628a7 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:07.938152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b01d8-ce72-4d88-a2bc-dcee878628a7 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:07.939467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 741/1479] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:51:07.944883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4567a-0c76-4c1f-ab04-7671834fdcf5 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:07.945334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4567a-0c76-4c1f-ab04-7671834fdcf5 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:07.945449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4567a-0c76-4c1f-ab04-7671834fdcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:08.012745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-7bb4567a-0c76-4c1f-ab04-7671834fdcf5 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:08.013964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7bb4567a-0c76-4c1f-ab04-7671834fdcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:08.115142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 739/1480] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:08.407567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b01d8-ce72-4d88-a2bc-dcee878628a7 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:08.409170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5c0b01d8-ce72-4d88-a2bc-dcee878628a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:08.419559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:08.561899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b01d8-ce72-4d88-a2bc-dcee878628a7 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:08.642437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:08.675624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a77ea-a5bd-4c2c-be80-3a9ea0b7fbe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:08.676163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a77ea-a5bd-4c2c-be80-3a9ea0b7fbe8 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:08.676440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a77ea-a5bd-4c2c-be80-3a9ea0b7fbe8 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:08.676710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a77ea-a5bd-4c2c-be80-3a9ea0b7fbe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:08.678338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-891a77ea-a5bd-4c2c-be80-3a9ea0b7fbe8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:08.768743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a77ea-a5bd-4c2c-be80-3a9ea0b7fbe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:08.770353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a77ea-a5bd-4c2c-be80-3a9ea0b7fbe8 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:08.789652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 742/1481] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:10.889532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7b0e3-6541-4db7-ac0f-7ca5216be4b2 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:10.890084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7b0e3-6541-4db7-ac0f-7ca5216be4b2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:10.890084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7b0e3-6541-4db7-ac0f-7ca5216be4b2 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:10.891479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 740/1482] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:51:10.896782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68058897-4a7b-47e1-8f17-ea6a3b038177 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:10.897207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68058897-4a7b-47e1-8f17-ea6a3b038177 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:10.897361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68058897-4a7b-47e1-8f17-ea6a3b038177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:10.965125 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-68058897-4a7b-47e1-8f17-ea6a3b038177 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:10.966590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-68058897-4a7b-47e1-8f17-ea6a3b038177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:11.011867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:11.063181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 743/1483] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:51:11.346322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7b0e3-6541-4db7-ac0f-7ca5216be4b2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:11.347917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-bbe7b0e3-6541-4db7-ac0f-7ca5216be4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:11.371915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:11.451940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7b0e3-6541-4db7-ac0f-7ca5216be4b2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:11.525836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeb2e5-4e05-493a-8f2c-e634b389e62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:11.526453 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeb2e5-4e05-493a-8f2c-e634b389e62f service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:11.526733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeb2e5-4e05-493a-8f2c-e634b389e62f service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:11.527043 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeb2e5-4e05-493a-8f2c-e634b389e62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:11.528662 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-88eeb2e5-4e05-493a-8f2c-e634b389e62f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:11.603753 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:11.638533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeb2e5-4e05-493a-8f2c-e634b389e62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:11.639976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeb2e5-4e05-493a-8f2c-e634b389e62f service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:11.662158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 741/1484] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:13.620513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95029aff-1a60-4aaa-b1a4-c9908ae16075 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:13.621040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95029aff-1a60-4aaa-b1a4-c9908ae16075 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:13.621040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95029aff-1a60-4aaa-b1a4-c9908ae16075 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:13.622506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 744/1485] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:51:13.627615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c4720-d9dc-46de-8015-8be7fe7b21de None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:13.628016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c4720-d9dc-46de-8015-8be7fe7b21de None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:13.628159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c4720-d9dc-46de-8015-8be7fe7b21de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:13.693773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-889c4720-d9dc-46de-8015-8be7fe7b21de None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:13.695026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-889c4720-d9dc-46de-8015-8be7fe7b21de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:13.792412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 742/1486] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:14.085342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95029aff-1a60-4aaa-b1a4-c9908ae16075 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:14.086958 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-95029aff-1a60-4aaa-b1a4-c9908ae16075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:14.192967 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95029aff-1a60-4aaa-b1a4-c9908ae16075 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:14.266972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:14.268730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df646c-3ed3-40b9-b00b-b4a6d3b01b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:14.269334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df646c-3ed3-40b9-b00b-b4a6d3b01b0f service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:14.269615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df646c-3ed3-40b9-b00b-b4a6d3b01b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:14.269886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df646c-3ed3-40b9-b00b-b4a6d3b01b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:14.271556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-18df646c-3ed3-40b9-b00b-b4a6d3b01b0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:14.379419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df646c-3ed3-40b9-b00b-b4a6d3b01b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:14.380780 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df646c-3ed3-40b9-b00b-b4a6d3b01b0f service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:14.399370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 745/1487] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:16.398550 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86492cc1-0cbe-4b83-86fd-384de847a281 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:16.399129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86492cc1-0cbe-4b83-86fd-384de847a281 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:16.399129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86492cc1-0cbe-4b83-86fd-384de847a281 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:16.400527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 743/1488] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:51:16.406399 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a84f1d-0412-4266-89ca-59ffd51295b3 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:16.406854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a84f1d-0412-4266-89ca-59ffd51295b3 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:16.407119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a84f1d-0412-4266-89ca-59ffd51295b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:16.472861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-78a84f1d-0412-4266-89ca-59ffd51295b3 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:16.474078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-78a84f1d-0412-4266-89ca-59ffd51295b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:16.527320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:16.571763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 746/1489] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:16.858176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86492cc1-0cbe-4b83-86fd-384de847a281 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:16.859780 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-86492cc1-0cbe-4b83-86fd-384de847a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:16.895670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:16.964766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86492cc1-0cbe-4b83-86fd-384de847a281 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:17.037849 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994d9c6-74c8-4e8c-b130-54e8a4ad1871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:17.038449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994d9c6-74c8-4e8c-b130-54e8a4ad1871 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:17.038729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994d9c6-74c8-4e8c-b130-54e8a4ad1871 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:17.039034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994d9c6-74c8-4e8c-b130-54e8a4ad1871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:17.040639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c994d9c6-74c8-4e8c-b130-54e8a4ad1871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:17.120784 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:17.150101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994d9c6-74c8-4e8c-b130-54e8a4ad1871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:17.151568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994d9c6-74c8-4e8c-b130-54e8a4ad1871 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:17.169379 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 744/1490] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:19.379536 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9813c-c1de-4aea-a6fd-506dba5dc521 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:19.380074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9813c-c1de-4aea-a6fd-506dba5dc521 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:19.380074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9813c-c1de-4aea-a6fd-506dba5dc521 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:19.381413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 747/1491] 10.222.0.73 () {54 vars in 927 bytes} [Mon Aug 29 23:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:51:19.386723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25df67-d335-4739-a0fa-b654d5c7aa15 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:19.387192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25df67-d335-4739-a0fa-b654d5c7aa15 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:19.387302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25df67-d335-4739-a0fa-b654d5c7aa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:19.452583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-ce25df67-d335-4739-a0fa-b654d5c7aa15 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:19.453802 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ce25df67-d335-4739-a0fa-b654d5c7aa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:19.550959 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 745/1492] 10.222.0.73 () {58 vars in 1024 bytes} [Mon Aug 29 23:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:19.841824 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9813c-c1de-4aea-a6fd-506dba5dc521 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:19.843470 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-dbd9813c-c1de-4aea-a6fd-506dba5dc521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:19.953453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9813c-c1de-4aea-a6fd-506dba5dc521 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:20.027186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ae048-be50-450b-8dd3-67750547666d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:20.027791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ae048-be50-450b-8dd3-67750547666d service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:20.028072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ae048-be50-450b-8dd3-67750547666d service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:20.028342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ae048-be50-450b-8dd3-67750547666d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:20.029951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1d7ae048-be50-450b-8dd3-67750547666d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:20.038995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:20.257697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ae048-be50-450b-8dd3-67750547666d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:20.259187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ae048-be50-450b-8dd3-67750547666d service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:20.277830 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 748/1493] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:29.549198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=82 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:30.275453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=50 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:40.525999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea01ff4-87bc-4059-9aa7-04b1648cf9d6 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:40.526588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea01ff4-87bc-4059-9aa7-04b1648cf9d6 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:40.526588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea01ff4-87bc-4059-9aa7-04b1648cf9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:40.604411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-1ea01ff4-87bc-4059-9aa7-04b1648cf9d6 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:40.605550 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1ea01ff4-87bc-4059-9aa7-04b1648cf9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:40.699476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 746/1494] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:40.707469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b67af-cdc2-41d5-8ba9-cb89a9b85afd None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:40.707991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b67af-cdc2-41d5-8ba9-cb89a9b85afd None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:40.707991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b67af-cdc2-41d5-8ba9-cb89a9b85afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:40.783699 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-998b67af-cdc2-41d5-8ba9-cb89a9b85afd None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:40.784891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-998b67af-cdc2-41d5-8ba9-cb89a9b85afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:40.877152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 749/1495] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:40.882282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea01ff4-87bc-4059-9aa7-04b1648cf9d6 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:40.884041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1ea01ff4-87bc-4059-9aa7-04b1648cf9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:40.896426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea01ff4-87bc-4059-9aa7-04b1648cf9d6 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:40.961614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:40.994783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fdb5b-8caf-4c73-ae7b-6d911a4561bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:40.995419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fdb5b-8caf-4c73-ae7b-6d911a4561bd admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:40.995697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fdb5b-8caf-4c73-ae7b-6d911a4561bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:40.995967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fdb5b-8caf-4c73-ae7b-6d911a4561bd admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:40.996604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fdb5b-8caf-4c73-ae7b-6d911a4561bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:52:40.996910 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fdb5b-8caf-4c73-ae7b-6d911a4561bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:40.997937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: WARNING py.warnings [None req-6b3fdb5b-8caf-4c73-ae7b-6d911a4561bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:52:40.997937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: warnings.warn(msg) Aug 29 23:52:40.997937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: Aug 29 23:52:40.998815 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fdb5b-8caf-4c73-ae7b-6d911a4561bd admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:41.010406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 747/1496] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:52:41.018867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b67af-cdc2-41d5-8ba9-cb89a9b85afd None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:41.028551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b67af-cdc2-41d5-8ba9-cb89a9b85afd None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:41.088954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:41.122729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befb90c-2429-4787-a11e-aef1df2032ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:41.123370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befb90c-2429-4787-a11e-aef1df2032ac admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:41.123651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befb90c-2429-4787-a11e-aef1df2032ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:41.123920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befb90c-2429-4787-a11e-aef1df2032ac admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:41.124549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befb90c-2429-4787-a11e-aef1df2032ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:41.126268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: WARNING py.warnings [None req-0befb90c-2429-4787-a11e-aef1df2032ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:52:41.126268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: warnings.warn(msg) Aug 29 23:52:41.126268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: Aug 29 23:52:41.127544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befb90c-2429-4787-a11e-aef1df2032ac admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:41.243707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 750/1497] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:52:41 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:52:41.248203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fdb5b-8caf-4c73-ae7b-6d911a4561bd admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:41.249816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6b3fdb5b-8caf-4c73-ae7b-6d911a4561bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:41.284429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fdb5b-8caf-4c73-ae7b-6d911a4561bd admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:41.382810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104b5d8-d12c-4bd7-8bde-6077083fb20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:41.383387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104b5d8-d12c-4bd7-8bde-6077083fb20f admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:41.383666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104b5d8-d12c-4bd7-8bde-6077083fb20f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:41.383938 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104b5d8-d12c-4bd7-8bde-6077083fb20f admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:41.384554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104b5d8-d12c-4bd7-8bde-6077083fb20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:41.385552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: WARNING py.warnings [None req-d104b5d8-d12c-4bd7-8bde-6077083fb20f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:52:41.385552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: warnings.warn(msg) Aug 29 23:52:41.385552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: Aug 29 23:52:41.386750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104b5d8-d12c-4bd7-8bde-6077083fb20f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:41.494440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 748/1498] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:52:41 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:52:41.498548 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befb90c-2429-4787-a11e-aef1df2032ac admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:41.500138 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0befb90c-2429-4787-a11e-aef1df2032ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:41.562234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befb90c-2429-4787-a11e-aef1df2032ac admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:41.644967 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:41.655861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f963906-7dd3-4aab-a3cc-73c378dc2288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:41.656526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f963906-7dd3-4aab-a3cc-73c378dc2288 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:41.656834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f963906-7dd3-4aab-a3cc-73c378dc2288 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:41.657107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f963906-7dd3-4aab-a3cc-73c378dc2288 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:41.657746 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f963906-7dd3-4aab-a3cc-73c378dc2288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:41.658815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: WARNING py.warnings [None req-3f963906-7dd3-4aab-a3cc-73c378dc2288 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:52:41.658815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: warnings.warn(msg) Aug 29 23:52:41.658815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: Aug 29 23:52:41.659742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f963906-7dd3-4aab-a3cc-73c378dc2288 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:41.672993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 751/1499] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:52:41.677067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104b5d8-d12c-4bd7-8bde-6077083fb20f admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:41.679299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d104b5d8-d12c-4bd7-8bde-6077083fb20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:41.690832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104b5d8-d12c-4bd7-8bde-6077083fb20f admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:41.715873 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:41.788933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c99a2-6c57-48d2-8ebd-47bc33807b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:41.789539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c99a2-6c57-48d2-8ebd-47bc33807b83 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:41.789817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c99a2-6c57-48d2-8ebd-47bc33807b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:41.790083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c99a2-6c57-48d2-8ebd-47bc33807b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:41.790721 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c99a2-6c57-48d2-8ebd-47bc33807b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:41.791756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: WARNING py.warnings [None req-530c99a2-6c57-48d2-8ebd-47bc33807b83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:52:41.791756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: warnings.warn(msg) Aug 29 23:52:41.791756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: Aug 29 23:52:41.792637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c99a2-6c57-48d2-8ebd-47bc33807b83 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:41.804891 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 749/1500] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:52:41.809121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f963906-7dd3-4aab-a3cc-73c378dc2288 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:41.810663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-3f963906-7dd3-4aab-a3cc-73c378dc2288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:41.844597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f963906-7dd3-4aab-a3cc-73c378dc2288 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:41.942377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb781d1-290f-462a-96bd-f5354715ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:41.942377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb781d1-290f-462a-96bd-f5354715ce2c admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:41.942748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb781d1-290f-462a-96bd-f5354715ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:41.942748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb781d1-290f-462a-96bd-f5354715ce2c admin admin] PATH_INFO: `/v3/projects/3a4e72881b1b4bd8b6063aaf18769ed6/users/ad3c749870654f3b92273f872594a3af/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:41.966502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb781d1-290f-462a-96bd-f5354715ce2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4e72881b1b4bd8b6063aaf18769ed6, user_id=ad3c749870654f3b92273f872594a3af, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:41.967584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: WARNING py.warnings [None req-6eb781d1-290f-462a-96bd-f5354715ce2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:52:41.967584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: warnings.warn(msg) Aug 29 23:52:41.967584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: Aug 29 23:52:41.969564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb781d1-290f-462a-96bd-f5354715ce2c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:42.065045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 752/1501] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:52:41 2022] PUT /identity/v3/projects/3a4e72881b1b4bd8b6063aaf18769ed6/users/ad3c749870654f3b92273f872594a3af/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:42.077454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562506cd-88a9-44b3-9489-0d888ca6ce9f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:42.077763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562506cd-88a9-44b3-9489-0d888ca6ce9f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:42.078037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562506cd-88a9-44b3-9489-0d888ca6ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:42.135142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-562506cd-88a9-44b3-9489-0d888ca6ce9f None None] MFA Rules not processed for user `ad3c749870654f3b92273f872594a3af`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:42.136364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-562506cd-88a9-44b3-9489-0d888ca6ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:42.214198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 750/1502] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:52:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:42.227623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb8cb-3027-44be-aa29-a2a7267c2eaa None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:42.227913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb8cb-3027-44be-aa29-a2a7267c2eaa None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:42.228186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb8cb-3027-44be-aa29-a2a7267c2eaa None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:42.229531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 753/1503] 10.222.0.73 () {54 vars in 964 bytes} [Mon Aug 29 23:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:52:42.234330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41582d-cfb0-4bc8-877d-6598c03b16d6 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:42.234619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41582d-cfb0-4bc8-877d-6598c03b16d6 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:42.234924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41582d-cfb0-4bc8-877d-6598c03b16d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:42.266234 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:42.309765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8c41582d-cfb0-4bc8-877d-6598c03b16d6 None None] MFA Rules not processed for user `ea872bd7ac2f4640a97648ccf96c02da`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:42.311007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8c41582d-cfb0-4bc8-877d-6598c03b16d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:42.385657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 751/1504] 10.222.0.73 () {58 vars in 1061 bytes} [Mon Aug 29 23:52:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:42.393434 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb8cb-3027-44be-aa29-a2a7267c2eaa None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:42.395000 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-3c8fb8cb-3027-44be-aa29-a2a7267c2eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:42.445110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:42.498534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb8cb-3027-44be-aa29-a2a7267c2eaa None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:42.572232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c28310-f073-417d-94a8-890b406925d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:42.572834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c28310-f073-417d-94a8-890b406925d1 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:42.573112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c28310-f073-417d-94a8-890b406925d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:42.573386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c28310-f073-417d-94a8-890b406925d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:42.575067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-52c28310-f073-417d-94a8-890b406925d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:42.674369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c28310-f073-417d-94a8-890b406925d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:42.675831 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c28310-f073-417d-94a8-890b406925d1 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:42.679793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:42.696162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 754/1505] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:42.740115 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2328c4f-dd9f-43d9-bc65-825a8541ccf6 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:42.740538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2328c4f-dd9f-43d9-bc65-825a8541ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:42.741188 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2328c4f-dd9f-43d9-bc65-825a8541ccf6 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:42.742847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 752/1506] 10.222.0.73 () {52 vars in 830 bytes} [Mon Aug 29 23:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:52:42.746039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c28310-f073-417d-94a8-890b406925d1 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:42.747410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-52c28310-f073-417d-94a8-890b406925d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:42.844691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c28310-f073-417d-94a8-890b406925d1 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:42.935800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:42.936415 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:42.936689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:42.936953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] PATH_INFO: `/v3/users/ad3c749870654f3b92273f872594a3af` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:42.948939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3c749870654f3b92273f872594a3af)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:42.950003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: WARNING py.warnings [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:52:42.950003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: warnings.warn(msg) Aug 29 23:52:42.950003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: Aug 29 23:52:42.951219 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:42.960820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:43.108034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3c749870654f3b92273f872594a3af'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:43.131537 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3c749870654f3b92273f872594a3af'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:43.145302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3c749870654f3b92273f872594a3af'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:43.145862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3c749870654f3b92273f872594a3af'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:43.146287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3c749870654f3b92273f872594a3af'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:43.200917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 755/1507] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:52:42 2022] DELETE /identity/v3/users/ad3c749870654f3b92273f872594a3af => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:43.205384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb941c73-6aaa-499c-ad48-1fb44b14b885 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:43.210521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb941c73-6aaa-499c-ad48-1fb44b14b885 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:43.210521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb941c73-6aaa-499c-ad48-1fb44b14b885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:43.262176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-fb941c73-6aaa-499c-ad48-1fb44b14b885 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:43.263419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fb941c73-6aaa-499c-ad48-1fb44b14b885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:43.340131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:43.352718 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 753/1508] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:43.362450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:43.363675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:43.464330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206eadc-1df2-47c6-b8e4-01542637333b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:43.518366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:43.538704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825112d4-e2bb-402e-94de-ad806714d0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:43.540570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825112d4-e2bb-402e-94de-ad806714d0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:43.540852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825112d4-e2bb-402e-94de-ad806714d0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:43.541126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825112d4-e2bb-402e-94de-ad806714d0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:43.542784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-825112d4-e2bb-402e-94de-ad806714d0f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:43.652938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825112d4-e2bb-402e-94de-ad806714d0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:43.654375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825112d4-e2bb-402e-94de-ad806714d0f9 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:43.673652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 756/1509] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:44.153065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb941c73-6aaa-499c-ad48-1fb44b14b885 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:44.154304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fb941c73-6aaa-499c-ad48-1fb44b14b885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:44.169611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb941c73-6aaa-499c-ad48-1fb44b14b885 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:44.267675 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:44.268306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:44.268587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:44.268860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] PATH_INFO: `/v3/projects/3a4e72881b1b4bd8b6063aaf18769ed6` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:44.278739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4e72881b1b4bd8b6063aaf18769ed6)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:44.279798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: WARNING py.warnings [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:52:44.279798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: warnings.warn(msg) Aug 29 23:52:44.279798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: Aug 29 23:52:44.280994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:44.407152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4e72881b1b4bd8b6063aaf18769ed6', 'request_id': 'req-9fca976f-252c-4a8f-9219-43d38d6edb3e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:44.413803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4e72881b1b4bd8b6063aaf18769ed6', 'request_id': 'req-9fca976f-252c-4a8f-9219-43d38d6edb3e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:44.426796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4e72881b1b4bd8b6063aaf18769ed6', 'request_id': 'req-9fca976f-252c-4a8f-9219-43d38d6edb3e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:44.504906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] The token cache is being invalidate because project 3a4e72881b1b4bd8b6063aaf18769ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:52:44.505194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:44.505625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9fca976f-252c-4a8f-9219-43d38d6edb3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:44.507221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 754/1510] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:52:44 2022] DELETE /identity/v3/projects/3a4e72881b1b4bd8b6063aaf18769ed6 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:53.671457 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=62 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:54.502783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:21.468019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc412fb0-3978-488d-8d67-c2f17ba64d45 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:21.468623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc412fb0-3978-488d-8d67-c2f17ba64d45 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:21.468623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc412fb0-3978-488d-8d67-c2f17ba64d45 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:21.469951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:54:21.474638 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61e7b-a9db-473d-a3eb-977325668ac8 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:21.475108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61e7b-a9db-473d-a3eb-977325668ac8 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:21.475217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61e7b-a9db-473d-a3eb-977325668ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:21.555432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-c6c61e7b-a9db-473d-a3eb-977325668ac8 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:54:21.556635 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c6c61e7b-a9db-473d-a3eb-977325668ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:21.658031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:54:21.813783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc412fb0-3978-488d-8d67-c2f17ba64d45 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:21.816601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bc412fb0-3978-488d-8d67-c2f17ba64d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:21.935040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc412fb0-3978-488d-8d67-c2f17ba64d45 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:21.940403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0ddac-9da6-403d-be61-ea2ea34d10d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:21.941002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0ddac-9da6-403d-be61-ea2ea34d10d2 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:21.941278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0ddac-9da6-403d-be61-ea2ea34d10d2 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:21.941546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0ddac-9da6-403d-be61-ea2ea34d10d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:21.949449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0ddac-9da6-403d-be61-ea2ea34d10d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:21.951035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0ddac-9da6-403d-be61-ea2ea34d10d2 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:21.960201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 758/1513] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:54:22.790963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70122dc0-54b3-49dd-a937-203929ebbf11 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:22.791452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70122dc0-54b3-49dd-a937-203929ebbf11 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:22.791572 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70122dc0-54b3-49dd-a937-203929ebbf11 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:22.792896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:54:22.797621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542753b-3db9-47af-9883-bb9ba4d80bde None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:22.798064 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542753b-3db9-47af-9883-bb9ba4d80bde None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:22.798209 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542753b-3db9-47af-9883-bb9ba4d80bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:22.818332 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-f542753b-3db9-47af-9883-bb9ba4d80bde None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:54:22.819565 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f542753b-3db9-47af-9883-bb9ba4d80bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:22.827961 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:54:22.981364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70122dc0-54b3-49dd-a937-203929ebbf11 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:22.996037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70122dc0-54b3-49dd-a937-203929ebbf11 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:23.001521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6007d1-c42e-4b58-8147-f6b8c0353f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:23.002114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6007d1-c42e-4b58-8147-f6b8c0353f37 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:23.002388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6007d1-c42e-4b58-8147-f6b8c0353f37 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:23.002656 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6007d1-c42e-4b58-8147-f6b8c0353f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:23.011265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6007d1-c42e-4b58-8147-f6b8c0353f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:23.012892 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6007d1-c42e-4b58-8147-f6b8c0353f37 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:23.022090 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 757/1516] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:54:23.349867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3b3aa-0734-4272-936d-80078b01f057 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:23.350072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3b3aa-0734-4272-936d-80078b01f057 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:23.350353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3b3aa-0734-4272-936d-80078b01f057 None None] PATH_INFO: `/v3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:23.352213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 760/1517] 10.222.0.79 () {54 vars in 925 bytes} [Mon Aug 29 23:54:23 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:54:23.358131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb455e0-bc4b-4dc7-966c-185a7cbbb5f9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:23.358422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb455e0-bc4b-4dc7-966c-185a7cbbb5f9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:23.358701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb455e0-bc4b-4dc7-966c-185a7cbbb5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:23.419461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5fb455e0-bc4b-4dc7-966c-185a7cbbb5f9 None None] MFA Rules not processed for user `ce79452e14fa4984875dca43672ed25a`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:54:23.420671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5fb455e0-bc4b-4dc7-966c-185a7cbbb5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:23.437704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:23.492130 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 758/1518] 10.222.0.79 () {58 vars in 1015 bytes} [Mon Aug 29 23:54:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:54:27.442503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf647600-1c25-45a1-942d-8d4e9c9f0c04 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:27.443114 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf647600-1c25-45a1-942d-8d4e9c9f0c04 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:27.443114 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf647600-1c25-45a1-942d-8d4e9c9f0c04 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:27.444316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 761/1519] 10.222.0.73 () {54 vars in 961 bytes} [Mon Aug 29 23:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:54:27.449964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc31b3-cfbb-429c-86ac-a9070a4a3b2f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:27.450395 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc31b3-cfbb-429c-86ac-a9070a4a3b2f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:27.450497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc31b3-cfbb-429c-86ac-a9070a4a3b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:27.469554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-2ecc31b3-cfbb-429c-86ac-a9070a4a3b2f None None] MFA Rules not processed for user `ce79452e14fa4984875dca43672ed25a`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:54:27.470734 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2ecc31b3-cfbb-429c-86ac-a9070a4a3b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:27.479594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 759/1520] 10.222.0.73 () {58 vars in 1058 bytes} [Mon Aug 29 23:54:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:54:27.487211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf647600-1c25-45a1-942d-8d4e9c9f0c04 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:27.501046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf647600-1c25-45a1-942d-8d4e9c9f0c04 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:27.506109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cfeca-8d93-408f-a2a4-32f52e53f215 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:27.506700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cfeca-8d93-408f-a2a4-32f52e53f215 service placement] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:27.507742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cfeca-8d93-408f-a2a4-32f52e53f215 service placement] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:27.508029 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cfeca-8d93-408f-a2a4-32f52e53f215 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:27.516279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cfeca-8d93-408f-a2a4-32f52e53f215 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:27.517886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cfeca-8d93-408f-a2a4-32f52e53f215 service placement] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:27.527514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 762/1521] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:54:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:54:34.250939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fac28-f40e-4054-9458-a61896b445c4 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:34.251505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fac28-f40e-4054-9458-a61896b445c4 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:34.251505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fac28-f40e-4054-9458-a61896b445c4 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:34.253050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:54:34.259415 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a0164-f5c0-4500-a6d5-ffa7e8a7033e None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:34.259855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a0164-f5c0-4500-a6d5-ffa7e8a7033e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:34.259956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a0164-f5c0-4500-a6d5-ffa7e8a7033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:34.279229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-bf6a0164-f5c0-4500-a6d5-ffa7e8a7033e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:54:34.280443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bf6a0164-f5c0-4500-a6d5-ffa7e8a7033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:34.288332 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:54:34.440512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fac28-f40e-4054-9458-a61896b445c4 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:34.455693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fac28-f40e-4054-9458-a61896b445c4 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:34.461227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c09a4b-2312-478d-b745-319de000c0bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:34.461825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c09a4b-2312-478d-b745-319de000c0bf service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:34.462109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c09a4b-2312-478d-b745-319de000c0bf service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:34.462382 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c09a4b-2312-478d-b745-319de000c0bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:34.470943 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c09a4b-2312-478d-b745-319de000c0bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:34.472509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c09a4b-2312-478d-b745-319de000c0bf service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:34.482359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 761/1524] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:54:35.305221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc31469-023c-40de-b5d1-b9d5a87a79d3 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:35.305799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc31469-023c-40de-b5d1-b9d5a87a79d3 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:35.305799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc31469-023c-40de-b5d1-b9d5a87a79d3 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:35.307295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:54:35.312049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3d7e5-1450-4d13-b70c-8b023a8ac347 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:35.312499 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3d7e5-1450-4d13-b70c-8b023a8ac347 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:35.312613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3d7e5-1450-4d13-b70c-8b023a8ac347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:35.332152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-82a3d7e5-1450-4d13-b70c-8b023a8ac347 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:54:35.333349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-82a3d7e5-1450-4d13-b70c-8b023a8ac347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:35.342077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:54:35.492923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc31469-023c-40de-b5d1-b9d5a87a79d3 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:35.507143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc31469-023c-40de-b5d1-b9d5a87a79d3 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:35.513147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12e0a2-5a92-4114-b79a-1176bb5dcc30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:35.513744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12e0a2-5a92-4114-b79a-1176bb5dcc30 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:35.514021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12e0a2-5a92-4114-b79a-1176bb5dcc30 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:35.514290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12e0a2-5a92-4114-b79a-1176bb5dcc30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:35.522194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12e0a2-5a92-4114-b79a-1176bb5dcc30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:35.524362 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12e0a2-5a92-4114-b79a-1176bb5dcc30 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:35.533649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 765/1527] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:54:39.334970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23f1e1-4eeb-44c2-b04d-f9e7ae673e36 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:39.336120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23f1e1-4eeb-44c2-b04d-f9e7ae673e36 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:39.336120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23f1e1-4eeb-44c2-b04d-f9e7ae673e36 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:39.337793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:54:39.343085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33832ad5-4b4c-40fa-a716-e1d464641651 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:39.343517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33832ad5-4b4c-40fa-a716-e1d464641651 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:39.343615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33832ad5-4b4c-40fa-a716-e1d464641651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:39.362675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-33832ad5-4b4c-40fa-a716-e1d464641651 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:54:39.363964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-33832ad5-4b4c-40fa-a716-e1d464641651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:39.372221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:54:39.655891 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23f1e1-4eeb-44c2-b04d-f9e7ae673e36 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:39.657597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5b23f1e1-4eeb-44c2-b04d-f9e7ae673e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:39.736100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23f1e1-4eeb-44c2-b04d-f9e7ae673e36 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:39.739820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944a594-a212-4827-9be0-fb0808e174c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:39.740431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944a594-a212-4827-9be0-fb0808e174c5 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:39.740711 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944a594-a212-4827-9be0-fb0808e174c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:39.740985 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944a594-a212-4827-9be0-fb0808e174c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:39.750702 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944a594-a212-4827-9be0-fb0808e174c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:39.752151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944a594-a212-4827-9be0-fb0808e174c5 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:39.761433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 764/1530] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:54:41.654024 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3bcd9-4be2-47eb-9981-6d4f40e52666 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:41.654592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3bcd9-4be2-47eb-9981-6d4f40e52666 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:41.654592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3bcd9-4be2-47eb-9981-6d4f40e52666 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:41.655993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:54:41.661244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23815f-477a-4071-9228-dfa32c530f57 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:41.661635 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23815f-477a-4071-9228-dfa32c530f57 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:41.661829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23815f-477a-4071-9228-dfa32c530f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:41.681620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-1e23815f-477a-4071-9228-dfa32c530f57 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:54:41.682828 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1e23815f-477a-4071-9228-dfa32c530f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:41.690649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:54:41.986060 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3bcd9-4be2-47eb-9981-6d4f40e52666 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:41.997483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3bcd9-4be2-47eb-9981-6d4f40e52666 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:42.001025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b9066-b70d-416f-b03c-7248a49f0ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:42.001618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b9066-b70d-416f-b03c-7248a49f0ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:42.001895 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b9066-b70d-416f-b03c-7248a49f0ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:42.002172 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b9066-b70d-416f-b03c-7248a49f0ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:42.011231 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b9066-b70d-416f-b03c-7248a49f0ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:42.015658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b9066-b70d-416f-b03c-7248a49f0ac6 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:42.021887 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 768/1533] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:54:45.465841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192fd23-d384-472b-86cf-73b4de708ac3 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:45.466385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192fd23-d384-472b-86cf-73b4de708ac3 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:45.466385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192fd23-d384-472b-86cf-73b4de708ac3 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:45.467766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:54:45.472894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b088c-da30-4b90-8c12-ff749532c043 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:45.473438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b088c-da30-4b90-8c12-ff749532c043 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:45.473438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b088c-da30-4b90-8c12-ff749532c043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:45.481230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=81 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:45.493870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-779b088c-da30-4b90-8c12-ff749532c043 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:54:45.495126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-779b088c-da30-4b90-8c12-ff749532c043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:45.503015 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:54:46.058639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192fd23-d384-472b-86cf-73b4de708ac3 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:46.060371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9192fd23-d384-472b-86cf-73b4de708ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:46.125591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:46.139194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192fd23-d384-472b-86cf-73b4de708ac3 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:46.142809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc33495-e9ba-4f83-80c5-d15e45b2ffb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:46.152118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33495-e9ba-4f83-80c5-d15e45b2ffb4 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:46.152118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33495-e9ba-4f83-80c5-d15e45b2ffb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:46.152118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33495-e9ba-4f83-80c5-d15e45b2ffb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:46.153121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc33495-e9ba-4f83-80c5-d15e45b2ffb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:46.154541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc33495-e9ba-4f83-80c5-d15e45b2ffb4 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:46.163968 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 767/1536] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:54:48.086186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2a9b8-a2a4-4e70-92bc-bf4d300fee41 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:48.086726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2a9b8-a2a4-4e70-92bc-bf4d300fee41 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:48.086726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2a9b8-a2a4-4e70-92bc-bf4d300fee41 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:48.088353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:54:48.093485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97687b19-7890-47e2-88bb-57f33efec0ed None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:48.093887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97687b19-7890-47e2-88bb-57f33efec0ed None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:48.094045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97687b19-7890-47e2-88bb-57f33efec0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:48.113683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-97687b19-7890-47e2-88bb-57f33efec0ed None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:54:48.114903 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-97687b19-7890-47e2-88bb-57f33efec0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:48.123350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:54:48.673158 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2a9b8-a2a4-4e70-92bc-bf4d300fee41 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:48.674910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4dd2a9b8-a2a4-4e70-92bc-bf4d300fee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:48.687697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2a9b8-a2a4-4e70-92bc-bf4d300fee41 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:48.691156 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233394a9-bfb1-4f78-af56-92b78bbb6fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:48.691742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233394a9-bfb1-4f78-af56-92b78bbb6fca service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:48.692017 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233394a9-bfb1-4f78-af56-92b78bbb6fca service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:48.692283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233394a9-bfb1-4f78-af56-92b78bbb6fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:48.701440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233394a9-bfb1-4f78-af56-92b78bbb6fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:48.702850 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233394a9-bfb1-4f78-af56-92b78bbb6fca service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:48.712892 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 771/1539] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:54:58.108841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=11 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:58.707974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=8 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:16.457326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cbe33-976e-462a-a184-c333be5b35af None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:16.459893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cbe33-976e-462a-a184-c333be5b35af None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:16.459893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cbe33-976e-462a-a184-c333be5b35af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:16.491978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-590cbe33-976e-462a-a184-c333be5b35af None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:16.493867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-590cbe33-976e-462a-a184-c333be5b35af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:16.505088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 769/1540] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:16.514914 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2976b24-2a16-4b41-81a5-362dfbeb996a None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:16.515521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2976b24-2a16-4b41-81a5-362dfbeb996a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:16.515521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2976b24-2a16-4b41-81a5-362dfbeb996a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:16.543281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-c2976b24-2a16-4b41-81a5-362dfbeb996a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:16.544986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c2976b24-2a16-4b41-81a5-362dfbeb996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:16.562347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 772/1541] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:16.567510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cbe33-976e-462a-a184-c333be5b35af None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:16.589844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cbe33-976e-462a-a184-c333be5b35af None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:16.598544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41588e8a-5258-47ca-aa59-78a00708dabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:16.604660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41588e8a-5258-47ca-aa59-78a00708dabc admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:16.604660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41588e8a-5258-47ca-aa59-78a00708dabc admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:16.604660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41588e8a-5258-47ca-aa59-78a00708dabc admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:16.604660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41588e8a-5258-47ca-aa59-78a00708dabc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:16.604660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41588e8a-5258-47ca-aa59-78a00708dabc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:16.606238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41588e8a-5258-47ca-aa59-78a00708dabc admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:16.624835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 770/1542] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:16.633686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2976b24-2a16-4b41-81a5-362dfbeb996a None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:16.644394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2976b24-2a16-4b41-81a5-362dfbeb996a None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:16.656189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc6497-5fc0-4879-af7f-4d98c1642542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:16.656826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc6497-5fc0-4879-af7f-4d98c1642542 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:16.657102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc6497-5fc0-4879-af7f-4d98c1642542 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:16.657374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc6497-5fc0-4879-af7f-4d98c1642542 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:16.658017 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc6497-5fc0-4879-af7f-4d98c1642542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:16.660151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc6497-5fc0-4879-af7f-4d98c1642542 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:16.723717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37006a33-818a-41d5-b267-fb49afc89695 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:16.725084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37006a33-818a-41d5-b267-fb49afc89695 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:16.725612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37006a33-818a-41d5-b267-fb49afc89695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:16.757793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-37006a33-818a-41d5-b267-fb49afc89695 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:16.760428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-37006a33-818a-41d5-b267-fb49afc89695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:16.773246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 771/1543] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:56:16.782047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d8243-d8df-448c-9d38-9f9ac08c1f5e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:16.782344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d8243-d8df-448c-9d38-9f9ac08c1f5e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:16.782590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d8243-d8df-448c-9d38-9f9ac08c1f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:16.814326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-cb9d8243-d8df-448c-9d38-9f9ac08c1f5e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:16.815596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-cb9d8243-d8df-448c-9d38-9f9ac08c1f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:16.828192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 773/1544] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:16 2022] POST /identity/v3/projects => generated 393 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:16.830411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 772/1545] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:56:16.830530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3d8e5-f4bc-471f-84cf-a93e353cd970 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:16.830530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3d8e5-f4bc-471f-84cf-a93e353cd970 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:16.830530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3d8e5-f4bc-471f-84cf-a93e353cd970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:16.830777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c5ded-1809-49cd-9f3a-52ebd3620623 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:16.830866 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c5ded-1809-49cd-9f3a-52ebd3620623 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:16.831530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c5ded-1809-49cd-9f3a-52ebd3620623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:16.872743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-f6d3d8e5-f4bc-471f-84cf-a93e353cd970 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:16.874033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-048c5ded-1809-49cd-9f3a-52ebd3620623 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:16.875541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f6d3d8e5-f4bc-471f-84cf-a93e353cd970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:16.877489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-048c5ded-1809-49cd-9f3a-52ebd3620623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:16.976711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 774/1546] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:16.976711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3d8e5-f4bc-471f-84cf-a93e353cd970 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:16.986375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 773/1547] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:16.987792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c5ded-1809-49cd-9f3a-52ebd3620623 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:16.988615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3d8e5-f4bc-471f-84cf-a93e353cd970 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:16.993502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f6993-c05e-4de4-9a8b-a118a512babd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:16.994121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6993-c05e-4de4-9a8b-a118a512babd admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:16.994429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6993-c05e-4de4-9a8b-a118a512babd admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:16.994832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6993-c05e-4de4-9a8b-a118a512babd admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:16.995518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f6993-c05e-4de4-9a8b-a118a512babd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:16.995817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f6993-c05e-4de4-9a8b-a118a512babd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:16.996835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: WARNING py.warnings [None req-812f6993-c05e-4de4-9a8b-a118a512babd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:56:16.996835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: warnings.warn(msg) Aug 29 23:56:16.996835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: Aug 29 23:56:16.997717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c5ded-1809-49cd-9f3a-52ebd3620623 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:16.997836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f6993-c05e-4de4-9a8b-a118a512babd admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.002495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1c3c0-8aa1-496a-93d8-7e7a604df23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.003122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1c3c0-8aa1-496a-93d8-7e7a604df23b admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.003403 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1c3c0-8aa1-496a-93d8-7e7a604df23b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.003677 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1c3c0-8aa1-496a-93d8-7e7a604df23b admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.004299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1c3c0-8aa1-496a-93d8-7e7a604df23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.006755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1c3c0-8aa1-496a-93d8-7e7a604df23b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.010221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 775/1548] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:17.011468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edb0c2-44d1-475a-9f0f-6918455e5094 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.011750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edb0c2-44d1-475a-9f0f-6918455e5094 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.012022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edb0c2-44d1-475a-9f0f-6918455e5094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.032538 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-12edb0c2-44d1-475a-9f0f-6918455e5094 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:17.036259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-12edb0c2-44d1-475a-9f0f-6918455e5094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:17.041788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 776/1549] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:17.043057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2a58-fb62-4fa2-ad83-e1e644a6bba5 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.043338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2a58-fb62-4fa2-ad83-e1e644a6bba5 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.043684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2a58-fb62-4fa2-ad83-e1e644a6bba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.062426 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-7e6f2a58-fb62-4fa2-ad83-e1e644a6bba5 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:17.063646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7e6f2a58-fb62-4fa2-ad83-e1e644a6bba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:17.071954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 777/1550] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:17.073092 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481a6be-1a79-4a65-9c2c-8a39e3d48c0f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.073373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481a6be-1a79-4a65-9c2c-8a39e3d48c0f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.073642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481a6be-1a79-4a65-9c2c-8a39e3d48c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.093081 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a481a6be-1a79-4a65-9c2c-8a39e3d48c0f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:17.094258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a481a6be-1a79-4a65-9c2c-8a39e3d48c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:17.102114 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 778/1551] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:17.103303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f5cd1-95d1-4f3d-a732-2c49c54843e4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.103567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f5cd1-95d1-4f3d-a732-2c49c54843e4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.103840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f5cd1-95d1-4f3d-a732-2c49c54843e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.112728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 774/1552] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:16 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:17.114454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c7958-eed5-465c-9553-d926fa9205b4 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.115000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c7958-eed5-465c-9553-d926fa9205b4 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.115441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c7958-eed5-465c-9553-d926fa9205b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.124547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-f13f5cd1-95d1-4f3d-a732-2c49c54843e4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:17.128148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f13f5cd1-95d1-4f3d-a732-2c49c54843e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:17.134244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 779/1553] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:17.135469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb9e7-7c5a-4151-84ea-9c727632b63a None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.135680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-420c7958-eed5-465c-9553-d926fa9205b4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:17.135800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb9e7-7c5a-4151-84ea-9c727632b63a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.136043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb9e7-7c5a-4151-84ea-9c727632b63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.136824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-420c7958-eed5-465c-9553-d926fa9205b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:17.144909 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 775/1554] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:17.145742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c7958-eed5-465c-9553-d926fa9205b4 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.155863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c7958-eed5-465c-9553-d926fa9205b4 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.156128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-178fb9e7-7c5a-4151-84ea-9c727632b63a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:17.157332 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-178fb9e7-7c5a-4151-84ea-9c727632b63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:17.160428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467a084-9f90-4ab0-86af-167516b4e6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.161008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467a084-9f90-4ab0-86af-167516b4e6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.161282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467a084-9f90-4ab0-86af-167516b4e6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.161545 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467a084-9f90-4ab0-86af-167516b4e6d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.162205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467a084-9f90-4ab0-86af-167516b4e6d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.163230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: WARNING py.warnings [None req-a467a084-9f90-4ab0-86af-167516b4e6d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:56:17.163230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: warnings.warn(msg) Aug 29 23:56:17.163230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: Aug 29 23:56:17.165039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467a084-9f90-4ab0-86af-167516b4e6d6 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.165668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 780/1555] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:17.166697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28034d7f-ff61-4107-8286-b6a9ede9177a None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.167015 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28034d7f-ff61-4107-8286-b6a9ede9177a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.167291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28034d7f-ff61-4107-8286-b6a9ede9177a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.186487 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-28034d7f-ff61-4107-8286-b6a9ede9177a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:17.187714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-28034d7f-ff61-4107-8286-b6a9ede9177a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:17.196100 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 781/1556] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:17.197249 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c4661-933a-466e-a33b-cf1f4d21d23d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.197530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c4661-933a-466e-a33b-cf1f4d21d23d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.197805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c4661-933a-466e-a33b-cf1f4d21d23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.216663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-ea7c4661-933a-466e-a33b-cf1f4d21d23d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:17.217816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ea7c4661-933a-466e-a33b-cf1f4d21d23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:17.225826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 782/1557] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:17.227215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76028e79-c794-4c1d-a591-584d013bdcd8 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.227443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76028e79-c794-4c1d-a591-584d013bdcd8 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.227712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76028e79-c794-4c1d-a591-584d013bdcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.247183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-76028e79-c794-4c1d-a591-584d013bdcd8 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:17.248412 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-76028e79-c794-4c1d-a591-584d013bdcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:17.257067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 783/1558] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:17.257832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76028e79-c794-4c1d-a591-584d013bdcd8 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.267036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76028e79-c794-4c1d-a591-584d013bdcd8 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.269358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 776/1559] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:17.270497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df44cc0-0e38-4c56-961d-4d1e01950ab9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.271205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df44cc0-0e38-4c56-961d-4d1e01950ab9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.271492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df44cc0-0e38-4c56-961d-4d1e01950ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.291518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-0df44cc0-0e38-4c56-961d-4d1e01950ab9 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:17.292825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0df44cc0-0e38-4c56-961d-4d1e01950ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:17.320665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:17.326965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83331882-6209-4fb3-87f6-2c044587eb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.333795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83331882-6209-4fb3-87f6-2c044587eb9c admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.333795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83331882-6209-4fb3-87f6-2c044587eb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.333795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83331882-6209-4fb3-87f6-2c044587eb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.333795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83331882-6209-4fb3-87f6-2c044587eb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.333795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83331882-6209-4fb3-87f6-2c044587eb9c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.340957 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 784/1560] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:17.344757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83331882-6209-4fb3-87f6-2c044587eb9c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.353559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 777/1561] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:17.354410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df44cc0-0e38-4c56-961d-4d1e01950ab9 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.355000 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83331882-6209-4fb3-87f6-2c044587eb9c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.361286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7708e-5cba-4cfe-a00c-211a5efb9e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.365717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7708e-5cba-4cfe-a00c-211a5efb9e97 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.365717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7708e-5cba-4cfe-a00c-211a5efb9e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.365717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7708e-5cba-4cfe-a00c-211a5efb9e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.365717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7708e-5cba-4cfe-a00c-211a5efb9e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:17.365717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7708e-5cba-4cfe-a00c-211a5efb9e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.366159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df44cc0-0e38-4c56-961d-4d1e01950ab9 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.366255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7708e-5cba-4cfe-a00c-211a5efb9e97 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.368847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b416b1-617b-4857-81d7-fb0e5a7ead83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.369444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b416b1-617b-4857-81d7-fb0e5a7ead83 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.369728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b416b1-617b-4857-81d7-fb0e5a7ead83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.370005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b416b1-617b-4857-81d7-fb0e5a7ead83 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.370649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b416b1-617b-4857-81d7-fb0e5a7ead83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:17.370986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b416b1-617b-4857-81d7-fb0e5a7ead83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.372629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b416b1-617b-4857-81d7-fb0e5a7ead83 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.377568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 785/1562] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:17.378424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7708e-5cba-4cfe-a00c-211a5efb9e97 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.385830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 778/1563] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:17.386818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b416b1-617b-4857-81d7-fb0e5a7ead83 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.391116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7708e-5cba-4cfe-a00c-211a5efb9e97 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.396189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77c4f-f617-45ad-9a01-75ba505b01fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.396723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b416b1-617b-4857-81d7-fb0e5a7ead83 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.396834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77c4f-f617-45ad-9a01-75ba505b01fc admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.397093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77c4f-f617-45ad-9a01-75ba505b01fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.397368 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77c4f-f617-45ad-9a01-75ba505b01fc admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.398008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77c4f-f617-45ad-9a01-75ba505b01fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:17.398308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77c4f-f617-45ad-9a01-75ba505b01fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.399934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77c4f-f617-45ad-9a01-75ba505b01fc admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.401287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289df44-ea05-4287-9adf-c20b7ce5b635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.401863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289df44-ea05-4287-9adf-c20b7ce5b635 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.402140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289df44-ea05-4287-9adf-c20b7ce5b635 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.402412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289df44-ea05-4287-9adf-c20b7ce5b635 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.403084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289df44-ea05-4287-9adf-c20b7ce5b635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:17.403382 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289df44-ea05-4287-9adf-c20b7ce5b635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.404972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289df44-ea05-4287-9adf-c20b7ce5b635 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.407436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:17.413308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 786/1564] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:17.413308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77c4f-f617-45ad-9a01-75ba505b01fc admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.419384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 779/1565] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:17.419384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289df44-ea05-4287-9adf-c20b7ce5b635 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.431170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77c4f-f617-45ad-9a01-75ba505b01fc admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.431170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27630df4-9f2f-418e-ad97-b4cd19cddf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.431170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27630df4-9f2f-418e-ad97-b4cd19cddf10 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.431170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27630df4-9f2f-418e-ad97-b4cd19cddf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.431565 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27630df4-9f2f-418e-ad97-b4cd19cddf10 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.431663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289df44-ea05-4287-9adf-c20b7ce5b635 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.431765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27630df4-9f2f-418e-ad97-b4cd19cddf10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:17.431765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27630df4-9f2f-418e-ad97-b4cd19cddf10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.431765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27630df4-9f2f-418e-ad97-b4cd19cddf10 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.434328 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3afb83-0fca-4708-b35f-640a43e44a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.435117 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3afb83-0fca-4708-b35f-640a43e44a52 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.435400 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3afb83-0fca-4708-b35f-640a43e44a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.435671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3afb83-0fca-4708-b35f-640a43e44a52 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.436291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3afb83-0fca-4708-b35f-640a43e44a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.438222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3afb83-0fca-4708-b35f-640a43e44a52 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.444975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 787/1566] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:17.445648 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27630df4-9f2f-418e-ad97-b4cd19cddf10 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.455389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27630df4-9f2f-418e-ad97-b4cd19cddf10 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.460104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49437b6c-047e-42c6-b3e9-e4b75f1a7a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.460720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49437b6c-047e-42c6-b3e9-e4b75f1a7a94 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.461253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49437b6c-047e-42c6-b3e9-e4b75f1a7a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.461522 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49437b6c-047e-42c6-b3e9-e4b75f1a7a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.462148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49437b6c-047e-42c6-b3e9-e4b75f1a7a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.463869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49437b6c-047e-42c6-b3e9-e4b75f1a7a94 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.475132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 788/1567] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:17.475132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49437b6c-047e-42c6-b3e9-e4b75f1a7a94 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.484191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49437b6c-047e-42c6-b3e9-e4b75f1a7a94 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.488696 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a3c1a-e047-4b42-ba2c-f65274b19a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.489249 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a3c1a-e047-4b42-ba2c-f65274b19a96 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.489524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a3c1a-e047-4b42-ba2c-f65274b19a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.489794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a3c1a-e047-4b42-ba2c-f65274b19a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.490953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a3c1a-e047-4b42-ba2c-f65274b19a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:17.491255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a3c1a-e047-4b42-ba2c-f65274b19a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.492777 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a3c1a-e047-4b42-ba2c-f65274b19a96 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.504437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 789/1568] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:17.505169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a3c1a-e047-4b42-ba2c-f65274b19a96 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.515125 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a3c1a-e047-4b42-ba2c-f65274b19a96 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.519760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7030c-d196-4ca8-9f7c-5f24879494e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.520316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7030c-d196-4ca8-9f7c-5f24879494e0 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.520593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7030c-d196-4ca8-9f7c-5f24879494e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.520865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7030c-d196-4ca8-9f7c-5f24879494e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.521494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7030c-d196-4ca8-9f7c-5f24879494e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.523390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7030c-d196-4ca8-9f7c-5f24879494e0 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.561914 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 780/1569] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:17.562821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3afb83-0fca-4708-b35f-640a43e44a52 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.572169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3afb83-0fca-4708-b35f-640a43e44a52 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.576820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fba9d-f8c1-4934-aa04-2fa376aeede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.577408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fba9d-f8c1-4934-aa04-2fa376aeede3 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.577690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fba9d-f8c1-4934-aa04-2fa376aeede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.578096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fba9d-f8c1-4934-aa04-2fa376aeede3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.578724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fba9d-f8c1-4934-aa04-2fa376aeede3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.580666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fba9d-f8c1-4934-aa04-2fa376aeede3 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.624318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 790/1570] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:17.625263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7030c-d196-4ca8-9f7c-5f24879494e0 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.685695 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7030c-d196-4ca8-9f7c-5f24879494e0 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.690528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec63fcf-d8bc-4334-b378-12e4fb78a3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.691148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63fcf-d8bc-4334-b378-12e4fb78a3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.691431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63fcf-d8bc-4334-b378-12e4fb78a3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.691707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63fcf-d8bc-4334-b378-12e4fb78a3e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.692327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec63fcf-d8bc-4334-b378-12e4fb78a3e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.694256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec63fcf-d8bc-4334-b378-12e4fb78a3e6 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.715519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 781/1571] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:17.716334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fba9d-f8c1-4934-aa04-2fa376aeede3 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.780046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fba9d-f8c1-4934-aa04-2fa376aeede3 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.784837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46c626-8430-470d-8e49-8a472ca8031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.785441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46c626-8430-470d-8e49-8a472ca8031a admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.785751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46c626-8430-470d-8e49-8a472ca8031a admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.786028 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46c626-8430-470d-8e49-8a472ca8031a admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.786651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46c626-8430-470d-8e49-8a472ca8031a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.789089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46c626-8430-470d-8e49-8a472ca8031a admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.804275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 791/1572] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:17.804275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec63fcf-d8bc-4334-b378-12e4fb78a3e6 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.852747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:17.862937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec63fcf-d8bc-4334-b378-12e4fb78a3e6 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.868112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96d373-7d8b-479d-8d79-15b2144c69bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.868713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96d373-7d8b-479d-8d79-15b2144c69bc admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.869009 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96d373-7d8b-479d-8d79-15b2144c69bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.869324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96d373-7d8b-479d-8d79-15b2144c69bc admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.869949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96d373-7d8b-479d-8d79-15b2144c69bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.871907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96d373-7d8b-479d-8d79-15b2144c69bc admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.886848 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 782/1573] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:17.887698 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46c626-8430-470d-8e49-8a472ca8031a admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:17.948451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46c626-8430-470d-8e49-8a472ca8031a admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:17.953116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eabb81-aaa3-4d83-b5fa-9d04bda6088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:17.953770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eabb81-aaa3-4d83-b5fa-9d04bda6088b admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:17.954052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eabb81-aaa3-4d83-b5fa-9d04bda6088b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:17.954328 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eabb81-aaa3-4d83-b5fa-9d04bda6088b admin admin] PATH_INFO: `/v3/projects/c06df691218141cb9fe9fc7cb440628c/users/3810bf4e4ea043ca9f12340498bf51c2/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:17.969097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eabb81-aaa3-4d83-b5fa-9d04bda6088b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06df691218141cb9fe9fc7cb440628c, user_id=3810bf4e4ea043ca9f12340498bf51c2, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:17.970129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: WARNING py.warnings [None req-f0eabb81-aaa3-4d83-b5fa-9d04bda6088b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:56:17.970129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: warnings.warn(msg) Aug 29 23:56:17.970129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: Aug 29 23:56:17.972086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eabb81-aaa3-4d83-b5fa-9d04bda6088b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:17.983554 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 792/1574] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:17.984981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96d373-7d8b-479d-8d79-15b2144c69bc admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.040222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 783/1575] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:17 2022] PUT /identity/v3/projects/c06df691218141cb9fe9fc7cb440628c/users/3810bf4e4ea043ca9f12340498bf51c2/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:18.041125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eabb81-aaa3-4d83-b5fa-9d04bda6088b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.049049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96d373-7d8b-479d-8d79-15b2144c69bc admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.067833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:18.104546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eabb81-aaa3-4d83-b5fa-9d04bda6088b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.105426 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7108d-bcdb-4812-9138-c4e8c5e24bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.106030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7108d-bcdb-4812-9138-c4e8c5e24bfd admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.106307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7108d-bcdb-4812-9138-c4e8c5e24bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.106576 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7108d-bcdb-4812-9138-c4e8c5e24bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.107232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7108d-bcdb-4812-9138-c4e8c5e24bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.109152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7108d-bcdb-4812-9138-c4e8c5e24bfd admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.109397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91a5ad-dce0-45f6-8e36-177b11c7090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.109965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91a5ad-dce0-45f6-8e36-177b11c7090b admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.110251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91a5ad-dce0-45f6-8e36-177b11c7090b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.110529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91a5ad-dce0-45f6-8e36-177b11c7090b admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.111214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91a5ad-dce0-45f6-8e36-177b11c7090b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.116872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91a5ad-dce0-45f6-8e36-177b11c7090b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.122813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 784/1576] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.123738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91a5ad-dce0-45f6-8e36-177b11c7090b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.133196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91a5ad-dce0-45f6-8e36-177b11c7090b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.138493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8107adc-c3ea-4e41-9e4a-1892cb345aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.139107 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107adc-c3ea-4e41-9e4a-1892cb345aaf admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.139390 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107adc-c3ea-4e41-9e4a-1892cb345aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.139663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107adc-c3ea-4e41-9e4a-1892cb345aaf admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.140273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8107adc-c3ea-4e41-9e4a-1892cb345aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.142156 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8107adc-c3ea-4e41-9e4a-1892cb345aaf admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.231350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 793/1577] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:17 2022] POST /identity/v3/projects => generated 371 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:18.231350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7108d-bcdb-4812-9138-c4e8c5e24bfd admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.262678 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 785/1578] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:18 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:18.263528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8107adc-c3ea-4e41-9e4a-1892cb345aaf admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.273334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8107adc-c3ea-4e41-9e4a-1892cb345aaf admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.297264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7108d-bcdb-4812-9138-c4e8c5e24bfd admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.302550 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f1c98-ca8e-4d81-94a6-4377dbef3dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.303194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f1c98-ca8e-4d81-94a6-4377dbef3dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.303871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f1c98-ca8e-4d81-94a6-4377dbef3dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.304155 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f1c98-ca8e-4d81-94a6-4377dbef3dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.305050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f1c98-ca8e-4d81-94a6-4377dbef3dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.306563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: WARNING py.warnings [None req-0c6f1c98-ca8e-4d81-94a6-4377dbef3dd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:56:18.306563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: warnings.warn(msg) Aug 29 23:56:18.306563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: Aug 29 23:56:18.308354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f1c98-ca8e-4d81-94a6-4377dbef3dd9 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.335213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cf719-ab55-4912-bbfa-b0545c54958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.336096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cf719-ab55-4912-bbfa-b0545c54958a admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.336406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cf719-ab55-4912-bbfa-b0545c54958a admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.336683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cf719-ab55-4912-bbfa-b0545c54958a admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.337307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cf719-ab55-4912-bbfa-b0545c54958a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.339267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cf719-ab55-4912-bbfa-b0545c54958a admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.406463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:18.411720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 794/1579] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:18 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:18.412623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f1c98-ca8e-4d81-94a6-4377dbef3dd9 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.421951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f1c98-ca8e-4d81-94a6-4377dbef3dd9 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.422562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 786/1580] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:18 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:18.423529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cf719-ab55-4912-bbfa-b0545c54958a admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.428348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e9c56-9665-44bd-ab33-7d8ac11f6ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.429001 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9c56-9665-44bd-ab33-7d8ac11f6ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.429333 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9c56-9665-44bd-ab33-7d8ac11f6ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.429797 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9c56-9665-44bd-ab33-7d8ac11f6ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.430423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e9c56-9665-44bd-ab33-7d8ac11f6ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.433242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e9c56-9665-44bd-ab33-7d8ac11f6ee0 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.434497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cf719-ab55-4912-bbfa-b0545c54958a admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.439221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7dd32-d9cd-4fdb-809c-58db8ddd29e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.439810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7dd32-d9cd-4fdb-809c-58db8ddd29e9 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.440092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7dd32-d9cd-4fdb-809c-58db8ddd29e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.440365 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7dd32-d9cd-4fdb-809c-58db8ddd29e9 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.441003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7dd32-d9cd-4fdb-809c-58db8ddd29e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.443461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7dd32-d9cd-4fdb-809c-58db8ddd29e9 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.527958 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 795/1581] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:18 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:18.529172 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5a959-da66-4628-b4c4-1c95926e4fab None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.529461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5a959-da66-4628-b4c4-1c95926e4fab None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.529734 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5a959-da66-4628-b4c4-1c95926e4fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.547680 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-cdd5a959-da66-4628-b4c4-1c95926e4fab None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:18.548908 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cdd5a959-da66-4628-b4c4-1c95926e4fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:18.557324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 796/1582] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:18.558116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5a959-da66-4628-b4c4-1c95926e4fab None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.567492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5a959-da66-4628-b4c4-1c95926e4fab None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.570625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 787/1583] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:18 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:18.571940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7dd32-d9cd-4fdb-809c-58db8ddd29e9 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.573441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa4ef6-dd45-4a89-94cb-f434fde94866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.574044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa4ef6-dd45-4a89-94cb-f434fde94866 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.574321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa4ef6-dd45-4a89-94cb-f434fde94866 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.574599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa4ef6-dd45-4a89-94cb-f434fde94866 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.575275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa4ef6-dd45-4a89-94cb-f434fde94866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.576893 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa4ef6-dd45-4a89-94cb-f434fde94866 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.584425 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7dd32-d9cd-4fdb-809c-58db8ddd29e9 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.588386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 797/1584] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.589219 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa4ef6-dd45-4a89-94cb-f434fde94866 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.592913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6a134-1bb0-4edf-bb86-7f137d32668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.593528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6a134-1bb0-4edf-bb86-7f137d32668c admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.593813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6a134-1bb0-4edf-bb86-7f137d32668c admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.594087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6a134-1bb0-4edf-bb86-7f137d32668c admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.594744 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6a134-1bb0-4edf-bb86-7f137d32668c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.596666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6a134-1bb0-4edf-bb86-7f137d32668c admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.602165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa4ef6-dd45-4a89-94cb-f434fde94866 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.605215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9969a-ca7f-478d-9c9d-bb48f77d5c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.605799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9969a-ca7f-478d-9c9d-bb48f77d5c7f admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.606073 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9969a-ca7f-478d-9c9d-bb48f77d5c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.606342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9969a-ca7f-478d-9c9d-bb48f77d5c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.606996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9969a-ca7f-478d-9c9d-bb48f77d5c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.608583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9969a-ca7f-478d-9c9d-bb48f77d5c7f admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.618573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 798/1585] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.619477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9969a-ca7f-478d-9c9d-bb48f77d5c7f admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.629228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9969a-ca7f-478d-9c9d-bb48f77d5c7f admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.634348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3e6a2-f706-452f-9aa0-5f494e045ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.634935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3e6a2-f706-452f-9aa0-5f494e045ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.635214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3e6a2-f706-452f-9aa0-5f494e045ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.635481 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3e6a2-f706-452f-9aa0-5f494e045ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.636096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3e6a2-f706-452f-9aa0-5f494e045ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.637705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3e6a2-f706-452f-9aa0-5f494e045ae9 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.648257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 799/1586] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.649380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3e6a2-f706-452f-9aa0-5f494e045ae9 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.659106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3e6a2-f706-452f-9aa0-5f494e045ae9 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.663647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88ca00-4f62-4c97-9f46-0c662639541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.664280 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88ca00-4f62-4c97-9f46-0c662639541a admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.664552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88ca00-4f62-4c97-9f46-0c662639541a admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.664816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88ca00-4f62-4c97-9f46-0c662639541a admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.665412 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88ca00-4f62-4c97-9f46-0c662639541a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.666996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88ca00-4f62-4c97-9f46-0c662639541a admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.676475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 800/1587] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.677858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88ca00-4f62-4c97-9f46-0c662639541a admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.688827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 788/1588] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:18 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:18.688827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6a134-1bb0-4edf-bb86-7f137d32668c admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.689153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88ca00-4f62-4c97-9f46-0c662639541a admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.692371 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac9ffe-0186-4816-ba52-c26ef3349fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.693567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac9ffe-0186-4816-ba52-c26ef3349fea admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.694006 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac9ffe-0186-4816-ba52-c26ef3349fea admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.694289 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac9ffe-0186-4816-ba52-c26ef3349fea admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.694986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac9ffe-0186-4816-ba52-c26ef3349fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.700069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac9ffe-0186-4816-ba52-c26ef3349fea admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.707357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 801/1589] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.708305 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac9ffe-0186-4816-ba52-c26ef3349fea admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.718003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac9ffe-0186-4816-ba52-c26ef3349fea admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.722743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8371dab-db3e-4752-a009-24b179b7bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.723375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8371dab-db3e-4752-a009-24b179b7bea8 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.723658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8371dab-db3e-4752-a009-24b179b7bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.724648 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8371dab-db3e-4752-a009-24b179b7bea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.724648 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8371dab-db3e-4752-a009-24b179b7bea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.726081 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8371dab-db3e-4752-a009-24b179b7bea8 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.739365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 802/1590] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.739365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8371dab-db3e-4752-a009-24b179b7bea8 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.747731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8371dab-db3e-4752-a009-24b179b7bea8 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.752505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c042d0-a9e1-4a26-a5ec-83de97b4d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.753146 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c042d0-a9e1-4a26-a5ec-83de97b4d5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.753417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c042d0-a9e1-4a26-a5ec-83de97b4d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.753738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c042d0-a9e1-4a26-a5ec-83de97b4d5a4 admin admin] PATH_INFO: `/v3/projects/209fa05ffb6246509e5170a98dc3cc04/users/4723d895de724027881df3fc2c8edc2d/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.754056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6a134-1bb0-4edf-bb86-7f137d32668c admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.759423 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853fa32-4855-4bbc-b529-e426ba6fe0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.760060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853fa32-4855-4bbc-b529-e426ba6fe0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.760341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853fa32-4855-4bbc-b529-e426ba6fe0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.760619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853fa32-4855-4bbc-b529-e426ba6fe0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.768517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c042d0-a9e1-4a26-a5ec-83de97b4d5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209fa05ffb6246509e5170a98dc3cc04, user_id=4723d895de724027881df3fc2c8edc2d, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.770030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853fa32-4855-4bbc-b529-e426ba6fe0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.771248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c042d0-a9e1-4a26-a5ec-83de97b4d5a4 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.774286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853fa32-4855-4bbc-b529-e426ba6fe0e0 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.776515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:18.781492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 789/1591] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:18.782211 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853fa32-4855-4bbc-b529-e426ba6fe0e0 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.791297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853fa32-4855-4bbc-b529-e426ba6fe0e0 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.796186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74738c5-c903-48e2-a119-4b56c19e071b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.796799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74738c5-c903-48e2-a119-4b56c19e071b admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.797077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74738c5-c903-48e2-a119-4b56c19e071b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.797376 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74738c5-c903-48e2-a119-4b56c19e071b admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.797969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74738c5-c903-48e2-a119-4b56c19e071b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.799605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74738c5-c903-48e2-a119-4b56c19e071b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.809874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 790/1592] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.810660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74738c5-c903-48e2-a119-4b56c19e071b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.820292 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74738c5-c903-48e2-a119-4b56c19e071b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.825117 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f9d04-1f2c-4580-b739-90017197e0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.825682 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f9d04-1f2c-4580-b739-90017197e0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.826034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f9d04-1f2c-4580-b739-90017197e0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.826235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f9d04-1f2c-4580-b739-90017197e0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.826848 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f9d04-1f2c-4580-b739-90017197e0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.831601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f9d04-1f2c-4580-b739-90017197e0a4 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.838449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 791/1593] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.839411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f9d04-1f2c-4580-b739-90017197e0a4 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.848809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f9d04-1f2c-4580-b739-90017197e0a4 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.853617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1294c-4ab6-4b22-ae71-50a3537481ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.854179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1294c-4ab6-4b22-ae71-50a3537481ca admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.854468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1294c-4ab6-4b22-ae71-50a3537481ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.854740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1294c-4ab6-4b22-ae71-50a3537481ca admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.855385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1294c-4ab6-4b22-ae71-50a3537481ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.858423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 803/1594] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:18 2022] PUT /identity/v3/projects/209fa05ffb6246509e5170a98dc3cc04/users/4723d895de724027881df3fc2c8edc2d/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:18.858555 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1294c-4ab6-4b22-ae71-50a3537481ca admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.858649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c042d0-a9e1-4a26-a5ec-83de97b4d5a4 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.882179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 792/1595] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.883473 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1294c-4ab6-4b22-ae71-50a3537481ca admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.895645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1294c-4ab6-4b22-ae71-50a3537481ca admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.924802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c042d0-a9e1-4a26-a5ec-83de97b4d5a4 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.931390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0345c9-c840-48cd-bbdf-4730ba514e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.932008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0345c9-c840-48cd-bbdf-4730ba514e53 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.932300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0345c9-c840-48cd-bbdf-4730ba514e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.932574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0345c9-c840-48cd-bbdf-4730ba514e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.933198 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0345c9-c840-48cd-bbdf-4730ba514e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.934846 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0345c9-c840-48cd-bbdf-4730ba514e53 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.946531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 804/1596] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.950216 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0345c9-c840-48cd-bbdf-4730ba514e53 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.957515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c2584-9f5b-49c3-86e4-9080b1edd972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.958214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c2584-9f5b-49c3-86e4-9080b1edd972 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.958602 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c2584-9f5b-49c3-86e4-9080b1edd972 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.958976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c2584-9f5b-49c3-86e4-9080b1edd972 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.959689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c2584-9f5b-49c3-86e4-9080b1edd972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.961859 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0345c9-c840-48cd-bbdf-4730ba514e53 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.962007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c2584-9f5b-49c3-86e4-9080b1edd972 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.966375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da2db-ce08-4c4b-82e1-e0985d7a6ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.967028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da2db-ce08-4c4b-82e1-e0985d7a6ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.967309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da2db-ce08-4c4b-82e1-e0985d7a6ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.967582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da2db-ce08-4c4b-82e1-e0985d7a6ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:18.968221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da2db-ce08-4c4b-82e1-e0985d7a6ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:18.969812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da2db-ce08-4c4b-82e1-e0985d7a6ce5 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:18.976879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 793/1597] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.976879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c2584-9f5b-49c3-86e4-9080b1edd972 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.982581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 805/1598] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:18.983547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da2db-ce08-4c4b-82e1-e0985d7a6ce5 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:18.987663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c2584-9f5b-49c3-86e4-9080b1edd972 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.993760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b639195-340a-484b-872b-4be4a3c64a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:18.994405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da2db-ce08-4c4b-82e1-e0985d7a6ce5 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:18.994524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b639195-340a-484b-872b-4be4a3c64a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:18.994723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b639195-340a-484b-872b-4be4a3c64a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:18.995045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b639195-340a-484b-872b-4be4a3c64a47 admin admin] PATH_INFO: `/v3/projects/655020f06b4744eaa50236b46f195a8d/users/eb701d6c531545ac8c7ed76a87706dcd/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.000065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c51a14-a463-4df6-a167-4833befeafc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:19.000717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c51a14-a463-4df6-a167-4833befeafc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.000992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c51a14-a463-4df6-a167-4833befeafc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.001264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c51a14-a463-4df6-a167-4833befeafc9 admin admin] PATH_INFO: `/v3/projects/f04f2be160c74ddc8ea264447fbd1fe9/users/3c8d932499ee46cb9179ef5b49c3dae1/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.010989 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b639195-340a-484b-872b-4be4a3c64a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655020f06b4744eaa50236b46f195a8d, user_id=eb701d6c531545ac8c7ed76a87706dcd, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:19.013695 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b639195-340a-484b-872b-4be4a3c64a47 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:19.016784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c51a14-a463-4df6-a167-4833befeafc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04f2be160c74ddc8ea264447fbd1fe9, user_id=3c8d932499ee46cb9179ef5b49c3dae1, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:19.019470 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c51a14-a463-4df6-a167-4833befeafc9 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:19.101410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 806/1599] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:18 2022] PUT /identity/v3/projects/f04f2be160c74ddc8ea264447fbd1fe9/users/3c8d932499ee46cb9179ef5b49c3dae1/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:19.104845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43ef6d-e243-48dd-824a-40b2f77b1212 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.104845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43ef6d-e243-48dd-824a-40b2f77b1212 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.104845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43ef6d-e243-48dd-824a-40b2f77b1212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.109358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 794/1600] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:18 2022] PUT /identity/v3/projects/655020f06b4744eaa50236b46f195a8d/users/eb701d6c531545ac8c7ed76a87706dcd/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:19.113240 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b639195-340a-484b-872b-4be4a3c64a47 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:19.122840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:19.142967 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-2d43ef6d-e243-48dd-824a-40b2f77b1212 None None] MFA Rules not processed for user `4723d895de724027881df3fc2c8edc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:19.144694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2d43ef6d-e243-48dd-824a-40b2f77b1212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:19.189790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b639195-340a-484b-872b-4be4a3c64a47 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:19.215189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 807/1601] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:19.216031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43ef6d-e243-48dd-824a-40b2f77b1212 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:19.236723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:19.252549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b189295-2feb-44cc-8cc4-ac4e8faf2525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:19.257272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b189295-2feb-44cc-8cc4-ac4e8faf2525 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.257272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b189295-2feb-44cc-8cc4-ac4e8faf2525 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.257272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b189295-2feb-44cc-8cc4-ac4e8faf2525 admin admin] PATH_INFO: `/v3/projects/5e8b0fab7dc2445c8a8d1a382d9c5497/users/9632c00cf66d4d33a625617001e826b9/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.269920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b189295-2feb-44cc-8cc4-ac4e8faf2525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8b0fab7dc2445c8a8d1a382d9c5497, user_id=9632c00cf66d4d33a625617001e826b9, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:19.272771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b189295-2feb-44cc-8cc4-ac4e8faf2525 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:19.283090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43ef6d-e243-48dd-824a-40b2f77b1212 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:19.288476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf4721-1d16-4340-b41c-5ed3373e3d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:19.289094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf4721-1d16-4340-b41c-5ed3373e3d2b admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.289371 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf4721-1d16-4340-b41c-5ed3373e3d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.289640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf4721-1d16-4340-b41c-5ed3373e3d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.290302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf4721-1d16-4340-b41c-5ed3373e3d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:19.291995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf4721-1d16-4340-b41c-5ed3373e3d2b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:19.302361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 808/1602] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:19.306833 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf4721-1d16-4340-b41c-5ed3373e3d2b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:19.316495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf4721-1d16-4340-b41c-5ed3373e3d2b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:19.321141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f74ad-a290-4b66-a8b6-26b69e71c83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:19.321787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f74ad-a290-4b66-a8b6-26b69e71c83b admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.322074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f74ad-a290-4b66-a8b6-26b69e71c83b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.322352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f74ad-a290-4b66-a8b6-26b69e71c83b admin admin] PATH_INFO: `/v3/projects/1a4534f4beb049439c5d2713a9807116/users/5ac05fa239524544a05c183c5893acd0/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.338019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f74ad-a290-4b66-a8b6-26b69e71c83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a4534f4beb049439c5d2713a9807116, user_id=5ac05fa239524544a05c183c5893acd0, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:19.340723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f74ad-a290-4b66-a8b6-26b69e71c83b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:19.369081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 795/1603] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:19 2022] PUT /identity/v3/projects/5e8b0fab7dc2445c8a8d1a382d9c5497/users/9632c00cf66d4d33a625617001e826b9/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:19.372038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b189295-2feb-44cc-8cc4-ac4e8faf2525 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:19.433057 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b189295-2feb-44cc-8cc4-ac4e8faf2525 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:19.437911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279401e-a014-4f99-b5ff-10ed6a067bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:19.438580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279401e-a014-4f99-b5ff-10ed6a067bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.438861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279401e-a014-4f99-b5ff-10ed6a067bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.439171 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279401e-a014-4f99-b5ff-10ed6a067bf0 admin admin] PATH_INFO: `/v3/projects/0c7905da8a584914ada654260ee54d98/users/4ebb392ea86a4ce9b14b619ad59e16ac/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.453673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 809/1604] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:19 2022] PUT /identity/v3/projects/1a4534f4beb049439c5d2713a9807116/users/5ac05fa239524544a05c183c5893acd0/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:19.458262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279401e-a014-4f99-b5ff-10ed6a067bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7905da8a584914ada654260ee54d98, user_id=4ebb392ea86a4ce9b14b619ad59e16ac, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:19.458404 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebc83d-ef9d-4b6b-81c2-3a8765e52b1e None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.458404 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebc83d-ef9d-4b6b-81c2-3a8765e52b1e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.458404 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebc83d-ef9d-4b6b-81c2-3a8765e52b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.459248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279401e-a014-4f99-b5ff-10ed6a067bf0 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:19.477473 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-feebc83d-ef9d-4b6b-81c2-3a8765e52b1e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:19.478671 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-feebc83d-ef9d-4b6b-81c2-3a8765e52b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:19.538002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 810/1605] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:19.539285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a44c4-91c8-41ff-bd5a-baea26e5a661 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.539601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a44c4-91c8-41ff-bd5a-baea26e5a661 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.539880 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a44c4-91c8-41ff-bd5a-baea26e5a661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.559176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-673a44c4-91c8-41ff-bd5a-baea26e5a661 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:19.560394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-673a44c4-91c8-41ff-bd5a-baea26e5a661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:19.568179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 811/1606] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:19.569412 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701de002-54ca-4ccf-af03-b27879e75cf5 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.575252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701de002-54ca-4ccf-af03-b27879e75cf5 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.575775 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701de002-54ca-4ccf-af03-b27879e75cf5 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.578900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 812/1607] 10.222.0.73 () {54 vars in 962 bytes} [Mon Aug 29 23:56:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:56:19.580052 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701de002-54ca-4ccf-af03-b27879e75cf5 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:19.581179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 796/1608] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:19 2022] PUT /identity/v3/projects/0c7905da8a584914ada654260ee54d98/users/4ebb392ea86a4ce9b14b619ad59e16ac/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:19.583128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49120bf-ceae-4c2b-a4ed-d15268eec76e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.583418 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49120bf-ceae-4c2b-a4ed-d15268eec76e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.584223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49120bf-ceae-4c2b-a4ed-d15268eec76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.590228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:19.614315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d49120bf-ceae-4c2b-a4ed-d15268eec76e None None] MFA Rules not processed for user `9632c00cf66d4d33a625617001e826b9`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:19.617898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d49120bf-ceae-4c2b-a4ed-d15268eec76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:19.661206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701de002-54ca-4ccf-af03-b27879e75cf5 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:19.666684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860ca0e-6dcf-4518-8748-08ea4b8c76ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:19.667461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860ca0e-6dcf-4518-8748-08ea4b8c76ed admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.667821 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860ca0e-6dcf-4518-8748-08ea4b8c76ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.668324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860ca0e-6dcf-4518-8748-08ea4b8c76ed admin admin] PATH_INFO: `/v3/projects/dd1fd690350941c8be1f30a862a81502/users/0d4b64166c2645ec9bc3cc5a3cb9f7d1/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.684180 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860ca0e-6dcf-4518-8748-08ea4b8c76ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1fd690350941c8be1f30a862a81502, user_id=0d4b64166c2645ec9bc3cc5a3cb9f7d1, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:19.686908 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860ca0e-6dcf-4518-8748-08ea4b8c76ed admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:19.696523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 797/1609] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:19.696523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b07ecf-bafe-44ca-b6fa-4f3485b4270c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.696523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b07ecf-bafe-44ca-b6fa-4f3485b4270c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.696523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b07ecf-bafe-44ca-b6fa-4f3485b4270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.724119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-c0b07ecf-bafe-44ca-b6fa-4f3485b4270c None None] MFA Rules not processed for user `5ac05fa239524544a05c183c5893acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:19.727405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c0b07ecf-bafe-44ca-b6fa-4f3485b4270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:19.756147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 813/1610] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:19 2022] PUT /identity/v3/projects/dd1fd690350941c8be1f30a862a81502/users/0d4b64166c2645ec9bc3cc5a3cb9f7d1/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:19.766378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860ca0e-6dcf-4518-8748-08ea4b8c76ed admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:19.769110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6860ca0e-6dcf-4518-8748-08ea4b8c76ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:19.773018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:19.812597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 798/1611] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:19.813614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b07ecf-bafe-44ca-b6fa-4f3485b4270c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:19.815482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c0b07ecf-bafe-44ca-b6fa-4f3485b4270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:19.843603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860ca0e-6dcf-4518-8748-08ea4b8c76ed admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:19.848645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbab716-cd54-459c-82c1-6218731850bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:19.849585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbab716-cd54-459c-82c1-6218731850bd service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.850363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbab716-cd54-459c-82c1-6218731850bd service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.850716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbab716-cd54-459c-82c1-6218731850bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.883219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b07ecf-bafe-44ca-b6fa-4f3485b4270c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:19.887311 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee5c17-32f9-413e-9355-d1a806cc4863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:19.888033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee5c17-32f9-413e-9355-d1a806cc4863 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.888409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee5c17-32f9-413e-9355-d1a806cc4863 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.888603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee5c17-32f9-413e-9355-d1a806cc4863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.923120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbab716-cd54-459c-82c1-6218731850bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:19.924855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbab716-cd54-459c-82c1-6218731850bd service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:19.936555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 814/1612] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:19.938102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843049-e5f2-4dc2-adfe-9f9a6abc04fe None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.938377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843049-e5f2-4dc2-adfe-9f9a6abc04fe None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.946125 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843049-e5f2-4dc2-adfe-9f9a6abc04fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.978581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee5c17-32f9-413e-9355-d1a806cc4863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:19.980071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee5c17-32f9-413e-9355-d1a806cc4863 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:19.990291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 799/1613] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:19.991494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d1843049-e5f2-4dc2-adfe-9f9a6abc04fe None None] MFA Rules not processed for user `59a1b0b274294a288dbf07cd99f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:19.991620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b8ecc-a8a3-4539-a918-1f92ed4165bc None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:19.991994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b8ecc-a8a3-4539-a918-1f92ed4165bc None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:19.992235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b8ecc-a8a3-4539-a918-1f92ed4165bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:19.993156 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d1843049-e5f2-4dc2-adfe-9f9a6abc04fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:20.011940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4c6b8ecc-a8a3-4539-a918-1f92ed4165bc None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:20.013236 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4c6b8ecc-a8a3-4539-a918-1f92ed4165bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:20.014992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:20.022110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 800/1614] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:20.022932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b8ecc-a8a3-4539-a918-1f92ed4165bc None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:20.032456 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b8ecc-a8a3-4539-a918-1f92ed4165bc None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:20.037234 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df2052-ca54-4453-9cd4-ef74875bc0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:20.037835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df2052-ca54-4453-9cd4-ef74875bc0bd admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:20.038119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df2052-ca54-4453-9cd4-ef74875bc0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:20.038392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df2052-ca54-4453-9cd4-ef74875bc0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:20.039081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df2052-ca54-4453-9cd4-ef74875bc0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:20.041097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df2052-ca54-4453-9cd4-ef74875bc0bd admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:20.067294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 815/1615] 10.222.0.73 () {58 vars in 1059 bytes} [Mon Aug 29 23:56:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:20.069153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390cb25-a71c-4500-8b8b-ca7505ba66b9 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:20.069527 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390cb25-a71c-4500-8b8b-ca7505ba66b9 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:20.069881 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390cb25-a71c-4500-8b8b-ca7505ba66b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:20.100484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-7390cb25-a71c-4500-8b8b-ca7505ba66b9 None None] MFA Rules not processed for user `0d4b64166c2645ec9bc3cc5a3cb9f7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:20.101733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7390cb25-a71c-4500-8b8b-ca7505ba66b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:20.169886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 816/1616] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:20.171050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34157b9-c851-4f55-98f3-e10e5f2e51aa None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:20.171342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34157b9-c851-4f55-98f3-e10e5f2e51aa None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:20.171632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34157b9-c851-4f55-98f3-e10e5f2e51aa None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:20.173607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 817/1617] 10.222.0.73 () {54 vars in 962 bytes} [Mon Aug 29 23:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:56:20.174344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34157b9-c851-4f55-98f3-e10e5f2e51aa None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:20.188423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34157b9-c851-4f55-98f3-e10e5f2e51aa None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:20.194513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 801/1618] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:20 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:20.194513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df2052-ca54-4453-9cd4-ef74875bc0bd admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:20.266676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:20.268743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bf065-c9e2-4e9d-9d76-7213e0834870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:20.270027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bf065-c9e2-4e9d-9d76-7213e0834870 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:20.270838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bf065-c9e2-4e9d-9d76-7213e0834870 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:20.271396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bf065-c9e2-4e9d-9d76-7213e0834870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:20.295440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df2052-ca54-4453-9cd4-ef74875bc0bd admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:20.306098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f014637-de58-494b-8c4e-a8888c86e738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:20.307210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f014637-de58-494b-8c4e-a8888c86e738 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:20.308375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f014637-de58-494b-8c4e-a8888c86e738 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:20.308868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f014637-de58-494b-8c4e-a8888c86e738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:20.353312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:20.357709 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bf065-c9e2-4e9d-9d76-7213e0834870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:20.359741 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bf065-c9e2-4e9d-9d76-7213e0834870 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:20.375197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 818/1619] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:20.379138 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bf065-c9e2-4e9d-9d76-7213e0834870 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:20.386824 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bf065-c9e2-4e9d-9d76-7213e0834870 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:20.392039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db277eef-cfb6-4f73-b2f1-6d34a8e10dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:20.392760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db277eef-cfb6-4f73-b2f1-6d34a8e10dcb admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:20.393315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db277eef-cfb6-4f73-b2f1-6d34a8e10dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:20.393631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db277eef-cfb6-4f73-b2f1-6d34a8e10dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:20.394269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db277eef-cfb6-4f73-b2f1-6d34a8e10dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:20.396319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db277eef-cfb6-4f73-b2f1-6d34a8e10dcb admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:20.397724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f014637-de58-494b-8c4e-a8888c86e738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:20.400185 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f014637-de58-494b-8c4e-a8888c86e738 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:20.417030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 802/1620] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:20.429301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a310c7-a1c7-417e-9603-bedc5553eccf None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:20.432403 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a310c7-a1c7-417e-9603-bedc5553eccf None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:20.436482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a310c7-a1c7-417e-9603-bedc5553eccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:20.464207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-c2a310c7-a1c7-417e-9603-bedc5553eccf None None] MFA Rules not processed for user `59a1b0b274294a288dbf07cd99f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:20.466692 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c2a310c7-a1c7-417e-9603-bedc5553eccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:20.480994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 803/1621] 10.222.0.73 () {58 vars in 1059 bytes} [Mon Aug 29 23:56:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:20.482076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a310c7-a1c7-417e-9603-bedc5553eccf None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:20.496336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 819/1622] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:20 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:20.502556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db277eef-cfb6-4f73-b2f1-6d34a8e10dcb admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:20.516723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a310c7-a1c7-417e-9603-bedc5553eccf None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:20.649584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09018e0-210b-4e69-ae59-63caa9938286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:20.650262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09018e0-210b-4e69-ae59-63caa9938286 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:20.650535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09018e0-210b-4e69-ae59-63caa9938286 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:20.650818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09018e0-210b-4e69-ae59-63caa9938286 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:20.651492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09018e0-210b-4e69-ae59-63caa9938286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:20.653551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09018e0-210b-4e69-ae59-63caa9938286 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:20.716030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db277eef-cfb6-4f73-b2f1-6d34a8e10dcb admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:20.738295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188675f1-e47e-47ca-85ba-a98ef4a7990e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:20.738954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188675f1-e47e-47ca-85ba-a98ef4a7990e service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:20.739255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188675f1-e47e-47ca-85ba-a98ef4a7990e service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:20.739515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188675f1-e47e-47ca-85ba-a98ef4a7990e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:20.818229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 804/1623] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:20 2022] POST /identity/v3/users => generated 290 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:20.819480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09018e0-210b-4e69-ae59-63caa9938286 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:20.840399 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09018e0-210b-4e69-ae59-63caa9938286 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:20.855438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43e10b-8be4-49dc-9ad5-0d53f1abff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:20.855438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43e10b-8be4-49dc-9ad5-0d53f1abff48 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:20.855438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43e10b-8be4-49dc-9ad5-0d53f1abff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:20.855438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43e10b-8be4-49dc-9ad5-0d53f1abff48 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:20.856135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188675f1-e47e-47ca-85ba-a98ef4a7990e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:20.856243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43e10b-8be4-49dc-9ad5-0d53f1abff48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:20.857756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43e10b-8be4-49dc-9ad5-0d53f1abff48 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:20.859579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188675f1-e47e-47ca-85ba-a98ef4a7990e service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:20.895091 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 820/1624] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:20.896398 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188675f1-e47e-47ca-85ba-a98ef4a7990e service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:20.934726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188675f1-e47e-47ca-85ba-a98ef4a7990e service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:20.941987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ffed9-79aa-40a4-8001-ed90981b999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:20.943194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ffed9-79aa-40a4-8001-ed90981b999d admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:20.943870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ffed9-79aa-40a4-8001-ed90981b999d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:20.944303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ffed9-79aa-40a4-8001-ed90981b999d admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:20.945106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ffed9-79aa-40a4-8001-ed90981b999d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:20.947864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ffed9-79aa-40a4-8001-ed90981b999d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:20.966786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 821/1625] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:20.968799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb57f61-f2cd-4ce6-a90a-7ac054aea694 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:20.970286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb57f61-f2cd-4ce6-a90a-7ac054aea694 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:20.970728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb57f61-f2cd-4ce6-a90a-7ac054aea694 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:20.976452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 822/1626] 10.222.0.73 () {54 vars in 912 bytes} [Mon Aug 29 23:56:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:56:20.984888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb57f61-f2cd-4ce6-a90a-7ac054aea694 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:21.006541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb57f61-f2cd-4ce6-a90a-7ac054aea694 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:21.013109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fe5d2-4d7c-4143-aa31-acd26ac255a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:21.014211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fe5d2-4d7c-4143-aa31-acd26ac255a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.014577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 805/1627] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:20 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:21.018681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fe5d2-4d7c-4143-aa31-acd26ac255a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.018681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fe5d2-4d7c-4143-aa31-acd26ac255a4 admin admin] PATH_INFO: `/v3/projects/7adfaff56e6346689948ecee2208cfe3/users/7190dda77eee44f89aad6f37a1cfb35a/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.018972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfc154-1175-49d0-9f8a-d687a38943af None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.018972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfc154-1175-49d0-9f8a-d687a38943af None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.018972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfc154-1175-49d0-9f8a-d687a38943af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.043692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fe5d2-4d7c-4143-aa31-acd26ac255a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7adfaff56e6346689948ecee2208cfe3, user_id=7190dda77eee44f89aad6f37a1cfb35a, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:21.049585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fe5d2-4d7c-4143-aa31-acd26ac255a4 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:21.056085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-31dfc154-1175-49d0-9f8a-d687a38943af None None] MFA Rules not processed for user `59a1b0b274294a288dbf07cd99f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:21.058012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-31dfc154-1175-49d0-9f8a-d687a38943af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:21.116163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 806/1628] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Aug 29 23:56:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:21.119665 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfc154-1175-49d0-9f8a-d687a38943af None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:21.145258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfc154-1175-49d0-9f8a-d687a38943af None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:21.148318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 823/1629] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:20 2022] PUT /identity/v3/projects/7adfaff56e6346689948ecee2208cfe3/users/7190dda77eee44f89aad6f37a1cfb35a/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:21.149874 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fe5d2-4d7c-4143-aa31-acd26ac255a4 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:21.214576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:21.232595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac157f-c084-4d43-a4c8-db6ef6d6fc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:21.232873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:21.234123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac157f-c084-4d43-a4c8-db6ef6d6fc28 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.234508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac157f-c084-4d43-a4c8-db6ef6d6fc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.234921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac157f-c084-4d43-a4c8-db6ef6d6fc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.235687 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac157f-c084-4d43-a4c8-db6ef6d6fc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:21.237596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac157f-c084-4d43-a4c8-db6ef6d6fc28 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:21.258725 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 807/1630] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:21.259701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac157f-c084-4d43-a4c8-db6ef6d6fc28 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:21.270252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fe5d2-4d7c-4143-aa31-acd26ac255a4 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:21.272361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac157f-c084-4d43-a4c8-db6ef6d6fc28 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:21.274973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd39b4-b39b-4d03-a68e-724330030355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:21.275668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd39b4-b39b-4d03-a68e-724330030355 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.276016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd39b4-b39b-4d03-a68e-724330030355 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.276373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd39b4-b39b-4d03-a68e-724330030355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.277943 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc73f5e-aa4f-4d2c-8139-6caa1a8cf1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:21.278919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc73f5e-aa4f-4d2c-8139-6caa1a8cf1fd admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.278919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc73f5e-aa4f-4d2c-8139-6caa1a8cf1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.279336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc73f5e-aa4f-4d2c-8139-6caa1a8cf1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.280049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc73f5e-aa4f-4d2c-8139-6caa1a8cf1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:21.282169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc73f5e-aa4f-4d2c-8139-6caa1a8cf1fd admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:21.297874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 808/1631] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:21.297874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585482f0-fb2d-41ec-8e39-d92259e3ad81 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.297874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585482f0-fb2d-41ec-8e39-d92259e3ad81 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.297874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585482f0-fb2d-41ec-8e39-d92259e3ad81 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.298518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 809/1632] 10.222.0.73 () {54 vars in 912 bytes} [Mon Aug 29 23:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:56:21.301573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585482f0-fb2d-41ec-8e39-d92259e3ad81 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:21.317238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585482f0-fb2d-41ec-8e39-d92259e3ad81 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:21.324023 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf393a9-331f-4749-956f-d0f856c5e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:21.324842 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf393a9-331f-4749-956f-d0f856c5e2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.325129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf393a9-331f-4749-956f-d0f856c5e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.325459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf393a9-331f-4749-956f-d0f856c5e2a5 admin admin] PATH_INFO: `/v3/projects/d97bde3cbad74a57b05cfc62fa2a6054/users/88a2c92e776140d093e01d291e9dfa39/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.343664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf393a9-331f-4749-956f-d0f856c5e2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97bde3cbad74a57b05cfc62fa2a6054, user_id=88a2c92e776140d093e01d291e9dfa39, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:21.346343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf393a9-331f-4749-956f-d0f856c5e2a5 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:21.359081 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd39b4-b39b-4d03-a68e-724330030355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:21.360470 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd39b4-b39b-4d03-a68e-724330030355 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:21.371574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 824/1633] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:21.372390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd39b4-b39b-4d03-a68e-724330030355 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:21.382625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd39b4-b39b-4d03-a68e-724330030355 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:21.387821 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabeda2-7e82-4018-9aa6-902f5a85aa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:21.388485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabeda2-7e82-4018-9aa6-902f5a85aa14 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.388765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabeda2-7e82-4018-9aa6-902f5a85aa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.389368 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabeda2-7e82-4018-9aa6-902f5a85aa14 admin admin] PATH_INFO: `/v3/projects/7adfaff56e6346689948ecee2208cfe3/users/7190dda77eee44f89aad6f37a1cfb35a/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.391105 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabeda2-7e82-4018-9aa6-902f5a85aa14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7adfaff56e6346689948ecee2208cfe3, user_id=7190dda77eee44f89aad6f37a1cfb35a, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:21.393886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabeda2-7e82-4018-9aa6-902f5a85aa14 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:21.408492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 825/1634] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:21 2022] PUT /identity/v3/projects/7adfaff56e6346689948ecee2208cfe3/users/7190dda77eee44f89aad6f37a1cfb35a/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:21.411308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfb53d-121f-41cb-bdb8-66465bf6dce4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.411643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfb53d-121f-41cb-bdb8-66465bf6dce4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.411926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfb53d-121f-41cb-bdb8-66465bf6dce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.437201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-2fcfb53d-121f-41cb-bdb8-66465bf6dce4 None None] MFA Rules not processed for user `59a1b0b274294a288dbf07cd99f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:21.438434 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2fcfb53d-121f-41cb-bdb8-66465bf6dce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:21.450383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 810/1635] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:21 2022] PUT /identity/v3/projects/d97bde3cbad74a57b05cfc62fa2a6054/users/88a2c92e776140d093e01d291e9dfa39/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:21.455441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713b6ee-63fa-400e-9d7e-bb3cfa654f66 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.455441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713b6ee-63fa-400e-9d7e-bb3cfa654f66 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.455441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713b6ee-63fa-400e-9d7e-bb3cfa654f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.503603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5713b6ee-63fa-400e-9d7e-bb3cfa654f66 None None] MFA Rules not processed for user `7190dda77eee44f89aad6f37a1cfb35a`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:21.507063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5713b6ee-63fa-400e-9d7e-bb3cfa654f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:21.550399 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 826/1636] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Aug 29 23:56:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:21.551808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfb53d-121f-41cb-bdb8-66465bf6dce4 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:21.629654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 811/1637] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:21.629654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713b6ee-63fa-400e-9d7e-bb3cfa654f66 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:21.630205 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfb53d-121f-41cb-bdb8-66465bf6dce4 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:21.723591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9d75f-2db4-4fde-a4d7-439055f6e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:21.723591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9d75f-2db4-4fde-a4d7-439055f6e21e admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.723591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9d75f-2db4-4fde-a4d7-439055f6e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.723591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9d75f-2db4-4fde-a4d7-439055f6e21e admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.724475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9d75f-2db4-4fde-a4d7-439055f6e21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:21.724475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9d75f-2db4-4fde-a4d7-439055f6e21e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:21.742902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713b6ee-63fa-400e-9d7e-bb3cfa654f66 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:21.828946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525bbaf-0411-4c71-8827-a11875e53acc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:21.828946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525bbaf-0411-4c71-8827-a11875e53acc service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.828946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525bbaf-0411-4c71-8827-a11875e53acc service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.828946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525bbaf-0411-4c71-8827-a11875e53acc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.844286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 827/1638] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:21.844286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9d75f-2db4-4fde-a4d7-439055f6e21e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:21.844286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9d75f-2db4-4fde-a4d7-439055f6e21e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:21.844286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080f5c8-4c7e-47cd-ab81-d73ede880d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:21.845429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080f5c8-4c7e-47cd-ab81-d73ede880d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.845429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080f5c8-4c7e-47cd-ab81-d73ede880d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.845429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080f5c8-4c7e-47cd-ab81-d73ede880d6d admin admin] PATH_INFO: `/v3/projects/d97bde3cbad74a57b05cfc62fa2a6054/users/88a2c92e776140d093e01d291e9dfa39/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.850834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080f5c8-4c7e-47cd-ab81-d73ede880d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97bde3cbad74a57b05cfc62fa2a6054, user_id=88a2c92e776140d093e01d291e9dfa39, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:21.854438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080f5c8-4c7e-47cd-ab81-d73ede880d6d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:21.867247 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 828/1639] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:21 2022] PUT /identity/v3/projects/d97bde3cbad74a57b05cfc62fa2a6054/users/88a2c92e776140d093e01d291e9dfa39/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:21.887159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b03de-71e7-4295-b468-2bb5dc59addf None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:21.887468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b03de-71e7-4295-b468-2bb5dc59addf None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:21.887736 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b03de-71e7-4295-b468-2bb5dc59addf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:21.949999 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-875b03de-71e7-4295-b468-2bb5dc59addf None None] MFA Rules not processed for user `88a2c92e776140d093e01d291e9dfa39`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:21.950758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:21.955965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-875b03de-71e7-4295-b468-2bb5dc59addf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:21.979103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525bbaf-0411-4c71-8827-a11875e53acc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:21.981380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525bbaf-0411-4c71-8827-a11875e53acc service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:22.014304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 812/1640] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:22.070195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 829/1641] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:22.083662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:22.641953 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525bbaf-0411-4c71-8827-a11875e53acc service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:22.651510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525bbaf-0411-4c71-8827-a11875e53acc service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:22.723057 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752450c-6574-435f-bdf8-dda8983b41dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:22.723866 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752450c-6574-435f-bdf8-dda8983b41dc service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:22.724698 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752450c-6574-435f-bdf8-dda8983b41dc service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:22.724981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752450c-6574-435f-bdf8-dda8983b41dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:23.042606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752450c-6574-435f-bdf8-dda8983b41dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:23.042606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752450c-6574-435f-bdf8-dda8983b41dc service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:23.042606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 813/1642] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:23.190754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b03de-71e7-4295-b468-2bb5dc59addf None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:23.204544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b03de-71e7-4295-b468-2bb5dc59addf None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:23.209086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada58482-e93a-4878-bb48-51c5441577fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:23.210653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada58482-e93a-4878-bb48-51c5441577fe service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:23.211413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada58482-e93a-4878-bb48-51c5441577fe service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:23.212090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada58482-e93a-4878-bb48-51c5441577fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:23.224981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada58482-e93a-4878-bb48-51c5441577fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:23.226805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada58482-e93a-4878-bb48-51c5441577fe service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:23.251303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 830/1643] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:23.611967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752450c-6574-435f-bdf8-dda8983b41dc service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:23.647080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752450c-6574-435f-bdf8-dda8983b41dc service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:23.651284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5397d8-7f58-47ed-81ff-b9e0a50f2af2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:23.651981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5397d8-7f58-47ed-81ff-b9e0a50f2af2 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:23.652266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5397d8-7f58-47ed-81ff-b9e0a50f2af2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:23.652543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5397d8-7f58-47ed-81ff-b9e0a50f2af2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:23.825698 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5397d8-7f58-47ed-81ff-b9e0a50f2af2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:23.827210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5397d8-7f58-47ed-81ff-b9e0a50f2af2 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:23.850454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 814/1644] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:25.603956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada58482-e93a-4878-bb48-51c5441577fe service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:25.733393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:25.746187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada58482-e93a-4878-bb48-51c5441577fe service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:25.757593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:25.758904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:25.759570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:25.760211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] PATH_INFO: `/v3/users/0d4b64166c2645ec9bc3cc5a3cb9f7d1` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:25.761993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4b64166c2645ec9bc3cc5a3cb9f7d1)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:25.764787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:26.117922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4b64166c2645ec9bc3cc5a3cb9f7d1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:26.145044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4b64166c2645ec9bc3cc5a3cb9f7d1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:26.167345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4b64166c2645ec9bc3cc5a3cb9f7d1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:26.169438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4b64166c2645ec9bc3cc5a3cb9f7d1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:26.170478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4b64166c2645ec9bc3cc5a3cb9f7d1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:26.287392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 831/1645] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:25 2022] DELETE /identity/v3/users/0d4b64166c2645ec9bc3cc5a3cb9f7d1 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:26.302115 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8d2ce-a51b-4ffc-97e7-40cad405eb4a None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:26.302115 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8d2ce-a51b-4ffc-97e7-40cad405eb4a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:26.302115 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8d2ce-a51b-4ffc-97e7-40cad405eb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:26.372730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d2b8d2ce-a51b-4ffc-97e7-40cad405eb4a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:26.374259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d2b8d2ce-a51b-4ffc-97e7-40cad405eb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:26.419373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:26.613357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 815/1646] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:26.689461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:26.699163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:26.840043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44335fde-3ef6-49da-8487-5a91d8d961a8 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:26.845445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8b2b6-82f1-44f3-8885-f82d996c752a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:26.846735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8b2b6-82f1-44f3-8885-f82d996c752a service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:26.847242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8b2b6-82f1-44f3-8885-f82d996c752a service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:26.847854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8b2b6-82f1-44f3-8885-f82d996c752a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:26.865085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8b2b6-82f1-44f3-8885-f82d996c752a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:26.866806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8b2b6-82f1-44f3-8885-f82d996c752a service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:26.881887 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 832/1647] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:27.275080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8d2ce-a51b-4ffc-97e7-40cad405eb4a None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:27.276840 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d2b8d2ce-a51b-4ffc-97e7-40cad405eb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:27.324128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8d2ce-a51b-4ffc-97e7-40cad405eb4a None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:27.345429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:27.346106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:27.346380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:27.347707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] PATH_INFO: `/v3/users/5ac05fa239524544a05c183c5893acd0` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:27.349678 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac05fa239524544a05c183c5893acd0)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:27.352776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: WARNING py.warnings [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:56:27.352776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: warnings.warn(msg) Aug 29 23:56:27.352776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: Aug 29 23:56:27.355065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:27.647438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac05fa239524544a05c183c5893acd0'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:27.746372 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac05fa239524544a05c183c5893acd0'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:27.763573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac05fa239524544a05c183c5893acd0'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:27.768049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac05fa239524544a05c183c5893acd0'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:27.834898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac05fa239524544a05c183c5893acd0'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:27.861238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 816/1648] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:27 2022] DELETE /identity/v3/users/5ac05fa239524544a05c183c5893acd0 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:27.869366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74440b9-0bc8-47a0-96a5-1899ea736176 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:27.872166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74440b9-0bc8-47a0-96a5-1899ea736176 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:27.873349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74440b9-0bc8-47a0-96a5-1899ea736176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:27.965454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a74440b9-0bc8-47a0-96a5-1899ea736176 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:27.969273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a74440b9-0bc8-47a0-96a5-1899ea736176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:28.230179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 833/1649] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:28.256016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:28.257529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:28.430841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c249f0-255d-4469-90fc-0b5a2963db37 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:28.438097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b065e-fdd5-4166-bd1d-ee8af988da87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:28.439154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b065e-fdd5-4166-bd1d-ee8af988da87 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:28.439656 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b065e-fdd5-4166-bd1d-ee8af988da87 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:28.440130 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b065e-fdd5-4166-bd1d-ee8af988da87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:28.467887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b065e-fdd5-4166-bd1d-ee8af988da87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:28.469828 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b065e-fdd5-4166-bd1d-ee8af988da87 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:28.494095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 817/1650] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:29.125630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74440b9-0bc8-47a0-96a5-1899ea736176 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:29.127188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a74440b9-0bc8-47a0-96a5-1899ea736176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:29.164291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74440b9-0bc8-47a0-96a5-1899ea736176 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:29.179439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:29.180304 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:29.180726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:29.181170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] PATH_INFO: `/v3/projects/dd1fd690350941c8be1f30a862a81502` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:29.195740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1fd690350941c8be1f30a862a81502)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:29.196984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: WARNING py.warnings [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:56:29.196984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: warnings.warn(msg) Aug 29 23:56:29.196984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: Aug 29 23:56:29.200699 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:29.242191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:29.443323 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1fd690350941c8be1f30a862a81502', 'request_id': 'req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:29.465891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1fd690350941c8be1f30a862a81502', 'request_id': 'req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:29.533283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1fd690350941c8be1f30a862a81502', 'request_id': 'req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:29.576306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] The token cache is being invalidate because project dd1fd690350941c8be1f30a862a81502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:56:29.576306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:29.576306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8d1b1e91-5f22-4cc6-b084-3e320af1b5cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:29.576306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 834/1651] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:56:29 2022] DELETE /identity/v3/projects/dd1fd690350941c8be1f30a862a81502 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:29.577377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b065e-fdd5-4166-bd1d-ee8af988da87 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:29.589148 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b065e-fdd5-4166-bd1d-ee8af988da87 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:29.745868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:29.814996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b6cab-e804-4604-aebc-2549defc29a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:29.815732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6cab-e804-4604-aebc-2549defc29a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:29.816005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6cab-e804-4604-aebc-2549defc29a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:29.816278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6cab-e804-4604-aebc-2549defc29a6 admin admin] PATH_INFO: `/v3/users/88a2c92e776140d093e01d291e9dfa39` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:29.818047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b6cab-e804-4604-aebc-2549defc29a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a2c92e776140d093e01d291e9dfa39)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:29.820007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b6cab-e804-4604-aebc-2549defc29a6 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:30.095150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fe6b6cab-e804-4604-aebc-2549defc29a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a2c92e776140d093e01d291e9dfa39'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:30.135990 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef75a5-1385-44e7-a5d5-4b58ef274165 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:30.139173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef75a5-1385-44e7-a5d5-4b58ef274165 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:30.139173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef75a5-1385-44e7-a5d5-4b58ef274165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:30.160698 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fe6b6cab-e804-4604-aebc-2549defc29a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a2c92e776140d093e01d291e9dfa39'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:30.185216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fe6b6cab-e804-4604-aebc-2549defc29a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a2c92e776140d093e01d291e9dfa39'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:30.186468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fe6b6cab-e804-4604-aebc-2549defc29a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a2c92e776140d093e01d291e9dfa39'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:30.204829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fe6b6cab-e804-4604-aebc-2549defc29a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a2c92e776140d093e01d291e9dfa39'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:30.214358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-f4ef75a5-1385-44e7-a5d5-4b58ef274165 None None] MFA Rules not processed for user `3810bf4e4ea043ca9f12340498bf51c2`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:30.215855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f4ef75a5-1385-44e7-a5d5-4b58ef274165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:30.229874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 818/1652] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:29 2022] DELETE /identity/v3/users/88a2c92e776140d093e01d291e9dfa39 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:30.335098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 835/1653] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:30.345402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10017a41-b883-475d-8bcd-636a322e10ed None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:30.345788 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10017a41-b883-475d-8bcd-636a322e10ed None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:30.346148 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10017a41-b883-475d-8bcd-636a322e10ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:30.368429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-10017a41-b883-475d-8bcd-636a322e10ed None None] MFA Rules not processed for user `3810bf4e4ea043ca9f12340498bf51c2`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:30.370660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-10017a41-b883-475d-8bcd-636a322e10ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:30.469189 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 819/1654] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:30.477352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef75a5-1385-44e7-a5d5-4b58ef274165 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:30.479149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f4ef75a5-1385-44e7-a5d5-4b58ef274165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:30.610147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10017a41-b883-475d-8bcd-636a322e10ed None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:30.612770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-10017a41-b883-475d-8bcd-636a322e10ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:30.763638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef75a5-1385-44e7-a5d5-4b58ef274165 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:30.784379 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10017a41-b883-475d-8bcd-636a322e10ed None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:30.796368 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:30.797273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:30.797791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:30.798370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] PATH_INFO: `/v3/projects/1a4534f4beb049439c5d2713a9807116` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:30.801588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a4534f4beb049439c5d2713a9807116)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:30.804607 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:30.963774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bf7ba-dcc2-4181-8049-213dfec473ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:30.964695 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf7ba-dcc2-4181-8049-213dfec473ab service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:30.965146 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf7ba-dcc2-4181-8049-213dfec473ab service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:30.965681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf7ba-dcc2-4181-8049-213dfec473ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:31.011656 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bf7ba-dcc2-4181-8049-213dfec473ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:31.013596 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bf7ba-dcc2-4181-8049-213dfec473ab service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:31.043953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 836/1655] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:31.047544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bf7ba-dcc2-4181-8049-213dfec473ab service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:31.053331 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f21bf7ba-dcc2-4181-8049-213dfec473ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:31.059620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a4534f4beb049439c5d2713a9807116', 'request_id': 'req-9367e9be-50ff-426e-a63e-fcdb23cbacbb'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.079842 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a4534f4beb049439c5d2713a9807116', 'request_id': 'req-9367e9be-50ff-426e-a63e-fcdb23cbacbb'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.094393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bf7ba-dcc2-4181-8049-213dfec473ab service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:31.119880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a4534f4beb049439c5d2713a9807116', 'request_id': 'req-9367e9be-50ff-426e-a63e-fcdb23cbacbb'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.240184 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58593270-769c-4294-a11e-3d556d37e600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:31.240939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58593270-769c-4294-a11e-3d556d37e600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:31.241287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58593270-769c-4294-a11e-3d556d37e600 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:31.241785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58593270-769c-4294-a11e-3d556d37e600 admin admin] PATH_INFO: `/v3/users/9632c00cf66d4d33a625617001e826b9` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:31.244511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58593270-769c-4294-a11e-3d556d37e600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9632c00cf66d4d33a625617001e826b9)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:31.248066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58593270-769c-4294-a11e-3d556d37e600 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:31.256031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] The token cache is being invalidate because project 1a4534f4beb049439c5d2713a9807116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:56:31.256327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.257079 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.261912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 820/1656] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:56:30 2022] DELETE /identity/v3/projects/1a4534f4beb049439c5d2713a9807116 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:31.263058 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:31.268202 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:31.316615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367e9be-50ff-426e-a63e-fcdb23cbacbb admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:31.332457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ade24c-f9bf-423b-ac96-4c9cb80d541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:31.333283 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ade24c-f9bf-423b-ac96-4c9cb80d541f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:31.333658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ade24c-f9bf-423b-ac96-4c9cb80d541f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:31.334187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ade24c-f9bf-423b-ac96-4c9cb80d541f admin admin] PATH_INFO: `/v3/users/4723d895de724027881df3fc2c8edc2d` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:31.336187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ade24c-f9bf-423b-ac96-4c9cb80d541f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4723d895de724027881df3fc2c8edc2d)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:31.342779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ade24c-f9bf-423b-ac96-4c9cb80d541f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:31.498031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-58593270-769c-4294-a11e-3d556d37e600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9632c00cf66d4d33a625617001e826b9'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.530588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-58593270-769c-4294-a11e-3d556d37e600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9632c00cf66d4d33a625617001e826b9'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.539153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-58593270-769c-4294-a11e-3d556d37e600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9632c00cf66d4d33a625617001e826b9'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.540131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-58593270-769c-4294-a11e-3d556d37e600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9632c00cf66d4d33a625617001e826b9'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.541050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-58593270-769c-4294-a11e-3d556d37e600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9632c00cf66d4d33a625617001e826b9'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.596507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:31.622676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 837/1657] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:31 2022] DELETE /identity/v3/users/9632c00cf66d4d33a625617001e826b9 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:31.624341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2959d38-2ab5-45c3-8dda-68bd9a02bcf4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:31.624791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2959d38-2ab5-45c3-8dda-68bd9a02bcf4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:31.627982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2959d38-2ab5-45c3-8dda-68bd9a02bcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:31.645883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f1ade24c-f9bf-423b-ac96-4c9cb80d541f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4723d895de724027881df3fc2c8edc2d'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.696470 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a2959d38-2ab5-45c3-8dda-68bd9a02bcf4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:31.698525 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a2959d38-2ab5-45c3-8dda-68bd9a02bcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:31.750982 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f1ade24c-f9bf-423b-ac96-4c9cb80d541f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4723d895de724027881df3fc2c8edc2d'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.762509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f1ade24c-f9bf-423b-ac96-4c9cb80d541f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4723d895de724027881df3fc2c8edc2d'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.762509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f1ade24c-f9bf-423b-ac96-4c9cb80d541f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4723d895de724027881df3fc2c8edc2d'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.829324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f1ade24c-f9bf-423b-ac96-4c9cb80d541f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4723d895de724027881df3fc2c8edc2d'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:31.852870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 821/1658] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:31 2022] DELETE /identity/v3/users/4723d895de724027881df3fc2c8edc2d => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:31.857613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3028796-e4b7-4770-a936-8c9b2bf26644 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:31.862188 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3028796-e4b7-4770-a936-8c9b2bf26644 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:31.864179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3028796-e4b7-4770-a936-8c9b2bf26644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:31.942492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a3028796-e4b7-4770-a936-8c9b2bf26644 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:31.943785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a3028796-e4b7-4770-a936-8c9b2bf26644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:31.975699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:31.976196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 838/1659] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:31.981545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3d7ae-dfbb-46d5-bcc5-6ac682dbff48 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:31.982094 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3d7ae-dfbb-46d5-bcc5-6ac682dbff48 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:31.986339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3d7ae-dfbb-46d5-bcc5-6ac682dbff48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:32.041411 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-42d3d7ae-dfbb-46d5-bcc5-6ac682dbff48 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:32.045720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-42d3d7ae-dfbb-46d5-bcc5-6ac682dbff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:32.100580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 822/1660] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:32.107388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5a51d-904a-41df-a113-3fe9d5e487a2 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:32.107388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5a51d-904a-41df-a113-3fe9d5e487a2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:32.107388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5a51d-904a-41df-a113-3fe9d5e487a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:32.154447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-bdd5a51d-904a-41df-a113-3fe9d5e487a2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:32.155990 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-bdd5a51d-904a-41df-a113-3fe9d5e487a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:32.185045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 823/1661] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:32.190588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5a51d-904a-41df-a113-3fe9d5e487a2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:32.194700 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-bdd5a51d-904a-41df-a113-3fe9d5e487a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:32.225173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 839/1662] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:32.227838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3d7ae-dfbb-46d5-bcc5-6ac682dbff48 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:32.247692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3d7ae-dfbb-46d5-bcc5-6ac682dbff48 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:32.288101 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e035f24-e26f-488e-b293-66f91ea9e35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:32.289418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e035f24-e26f-488e-b293-66f91ea9e35f admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:32.289800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e035f24-e26f-488e-b293-66f91ea9e35f admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:32.290511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e035f24-e26f-488e-b293-66f91ea9e35f admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:32.291132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e035f24-e26f-488e-b293-66f91ea9e35f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:32.291658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e035f24-e26f-488e-b293-66f91ea9e35f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:32.301773 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e035f24-e26f-488e-b293-66f91ea9e35f admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:32.328441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 840/1663] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:32.338808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e035f24-e26f-488e-b293-66f91ea9e35f admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:32.360953 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5a51d-904a-41df-a113-3fe9d5e487a2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:32.370615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e035f24-e26f-488e-b293-66f91ea9e35f admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:32.374553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9df9f0-2daf-45f2-af6e-987fecf7f271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:32.375527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9df9f0-2daf-45f2-af6e-987fecf7f271 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:32.375919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9df9f0-2daf-45f2-af6e-987fecf7f271 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:32.377276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9df9f0-2daf-45f2-af6e-987fecf7f271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:32.378687 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebd14d-a67d-4b2e-b673-c8276c0b434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:32.381023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebd14d-a67d-4b2e-b673-c8276c0b434a admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:32.382589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebd14d-a67d-4b2e-b673-c8276c0b434a admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:32.383122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebd14d-a67d-4b2e-b673-c8276c0b434a admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:32.384051 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebd14d-a67d-4b2e-b673-c8276c0b434a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:32.387366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebd14d-a67d-4b2e-b673-c8276c0b434a admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:32.421221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9df9f0-2daf-45f2-af6e-987fecf7f271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:32.422684 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9df9f0-2daf-45f2-af6e-987fecf7f271 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:32.455807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 824/1664] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:32.459588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482261ca-a67d-4406-9981-8b5d05656f21 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:32.460803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482261ca-a67d-4406-9981-8b5d05656f21 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:32.463190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482261ca-a67d-4406-9981-8b5d05656f21 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:32.466608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 825/1665] 10.222.0.73 () {54 vars in 912 bytes} [Mon Aug 29 23:56:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:56:32.468122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482261ca-a67d-4406-9981-8b5d05656f21 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:32.473610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-482261ca-a67d-4406-9981-8b5d05656f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:32.500456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 841/1666] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:32 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:32.500456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebd14d-a67d-4b2e-b673-c8276c0b434a admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:32.503793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-30ebd14d-a67d-4b2e-b673-c8276c0b434a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:32.519719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482261ca-a67d-4406-9981-8b5d05656f21 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:32.733188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebd14d-a67d-4b2e-b673-c8276c0b434a admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:32.746238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a0f0f-63a9-45d0-9a15-3c34e9994825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:32.746821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:32.747573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a0f0f-63a9-45d0-9a15-3c34e9994825 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:32.749101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:32.749101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:32.749101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] PATH_INFO: `/v3/projects/d97bde3cbad74a57b05cfc62fa2a6054` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:32.749588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a0f0f-63a9-45d0-9a15-3c34e9994825 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:32.750096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a0f0f-63a9-45d0-9a15-3c34e9994825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:32.753179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97bde3cbad74a57b05cfc62fa2a6054)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:32.757747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:32.787581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a0f0f-63a9-45d0-9a15-3c34e9994825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:32.790515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a0f0f-63a9-45d0-9a15-3c34e9994825 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:32.813088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 842/1667] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:32.815107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f3d63-aa50-4725-9ad4-4bd9fba4ed26 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:32.822606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f3d63-aa50-4725-9ad4-4bd9fba4ed26 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:32.823166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f3d63-aa50-4725-9ad4-4bd9fba4ed26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:32.901168 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-c39f3d63-aa50-4725-9ad4-4bd9fba4ed26 None None] MFA Rules not processed for user `707518bbe380425aa793f005548bc9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:32.903137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c39f3d63-aa50-4725-9ad4-4bd9fba4ed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:32.922555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 843/1668] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Aug 29 23:56:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:32.925306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f3d63-aa50-4725-9ad4-4bd9fba4ed26 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:32.944228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97bde3cbad74a57b05cfc62fa2a6054', 'request_id': 'req-8989f1a0-ad5e-47de-a035-879b0bbb0713'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:32.945551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f3d63-aa50-4725-9ad4-4bd9fba4ed26 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:32.962620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97bde3cbad74a57b05cfc62fa2a6054', 'request_id': 'req-8989f1a0-ad5e-47de-a035-879b0bbb0713'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:32.976677 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97bde3cbad74a57b05cfc62fa2a6054', 'request_id': 'req-8989f1a0-ad5e-47de-a035-879b0bbb0713'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:33.059599 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] The token cache is being invalidate because project d97bde3cbad74a57b05cfc62fa2a6054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:56:33.059992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d336f7-e84d-4a46-83b7-5701da9c4a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:33.060485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:33.060657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d336f7-e84d-4a46-83b7-5701da9c4a36 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:33.060998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d336f7-e84d-4a46-83b7-5701da9c4a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:33.061282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d336f7-e84d-4a46-83b7-5701da9c4a36 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:33.061923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:33.063678 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d336f7-e84d-4a46-83b7-5701da9c4a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:33.064613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 826/1669] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:56:32 2022] DELETE /identity/v3/projects/d97bde3cbad74a57b05cfc62fa2a6054 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:33.065685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:33.072396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d336f7-e84d-4a46-83b7-5701da9c4a36 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:33.073757 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:33.159617 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:33.200111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 844/1670] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:32 2022] POST /identity/v3/users => generated 291 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:33.200111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ab56-4a26-4299-913b-ad2e209e40ef None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:33.200111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ab56-4a26-4299-913b-ad2e209e40ef None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:33.200369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ab56-4a26-4299-913b-ad2e209e40ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:33.210001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989f1a0-ad5e-47de-a035-879b0bbb0713 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:33.224224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02b775-fc5f-4709-a598-20033c062b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:33.224224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02b775-fc5f-4709-a598-20033c062b75 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:33.224916 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02b775-fc5f-4709-a598-20033c062b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:33.225391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02b775-fc5f-4709-a598-20033c062b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:33.229001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9f02b775-fc5f-4709-a598-20033c062b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:33.248960 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-34f9ab56-4a26-4299-913b-ad2e209e40ef None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:33.254041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-34f9ab56-4a26-4299-913b-ad2e209e40ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:33.255379 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02b775-fc5f-4709-a598-20033c062b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:33.259658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02b775-fc5f-4709-a598-20033c062b75 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:33.273654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 845/1671] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:33.276104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ab56-4a26-4299-913b-ad2e209e40ef None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:33.277934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 827/1672] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:33.279612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-34f9ab56-4a26-4299-913b-ad2e209e40ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:33.284120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e9690-f4dc-4a4d-acde-497c1a7ca61e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:33.284482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e9690-f4dc-4a4d-acde-497c1a7ca61e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:33.284837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e9690-f4dc-4a4d-acde-497c1a7ca61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:33.301089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ab56-4a26-4299-913b-ad2e209e40ef None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:33.317924 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc17b1-19ad-4c86-aa16-aeacc5be89e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:33.319213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc17b1-19ad-4c86-aa16-aeacc5be89e6 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:33.319497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc17b1-19ad-4c86-aa16-aeacc5be89e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:33.319772 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc17b1-19ad-4c86-aa16-aeacc5be89e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:33.322426 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc17b1-19ad-4c86-aa16-aeacc5be89e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:33.326148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc17b1-19ad-4c86-aa16-aeacc5be89e6 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:33.327081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-926e9690-f4dc-4a4d-acde-497c1a7ca61e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:33.328432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-926e9690-f4dc-4a4d-acde-497c1a7ca61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:33.345216 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 846/1673] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:33.351006 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc17b1-19ad-4c86-aa16-aeacc5be89e6 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:33.353823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 828/1674] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:33.359483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e9690-f4dc-4a4d-acde-497c1a7ca61e None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:33.380750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e9690-f4dc-4a4d-acde-497c1a7ca61e None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:33.381061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc17b1-19ad-4c86-aa16-aeacc5be89e6 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:33.389201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001ec34-7d61-49ec-885f-ac720b9ab8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:33.390174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236dc62-2853-47fc-b7eb-62592399ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:33.390856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ec34-7d61-49ec-885f-ac720b9ab8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:33.391357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236dc62-2853-47fc-b7eb-62592399ccf3 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:33.391765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ec34-7d61-49ec-885f-ac720b9ab8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:33.392130 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236dc62-2853-47fc-b7eb-62592399ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:33.392455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ec34-7d61-49ec-885f-ac720b9ab8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:33.392808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236dc62-2853-47fc-b7eb-62592399ccf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:33.393530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001ec34-7d61-49ec-885f-ac720b9ab8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:33.394659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236dc62-2853-47fc-b7eb-62592399ccf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:33.394785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236dc62-2853-47fc-b7eb-62592399ccf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:33.398918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236dc62-2853-47fc-b7eb-62592399ccf3 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:33.399628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001ec34-7d61-49ec-885f-ac720b9ab8f6 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:33.422186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 847/1675] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:33.428900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001ec34-7d61-49ec-885f-ac720b9ab8f6 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:33.433337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 829/1676] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:33.434620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236dc62-2853-47fc-b7eb-62592399ccf3 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:33.449730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001ec34-7d61-49ec-885f-ac720b9ab8f6 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:33.453754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236dc62-2853-47fc-b7eb-62592399ccf3 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:33.460749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061680e-346b-4dd2-a208-095bf3bd248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:33.467428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061680e-346b-4dd2-a208-095bf3bd248b admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:33.467701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061680e-346b-4dd2-a208-095bf3bd248b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:33.468576 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061680e-346b-4dd2-a208-095bf3bd248b admin admin] PATH_INFO: `/v3/projects/30a38a7ba68c47909a94b6fb787b80dc/users/1517c7f5e8f641d28df4e67d0cba8ce5/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:33.469017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5120b-a97c-4df8-8b3b-feab3cd737aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:33.470139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5120b-a97c-4df8-8b3b-feab3cd737aa admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:33.470139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5120b-a97c-4df8-8b3b-feab3cd737aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:33.470333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5120b-a97c-4df8-8b3b-feab3cd737aa admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:33.471083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5120b-a97c-4df8-8b3b-feab3cd737aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:33.473106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5120b-a97c-4df8-8b3b-feab3cd737aa admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:33.498005 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061680e-346b-4dd2-a208-095bf3bd248b admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a38a7ba68c47909a94b6fb787b80dc, user_id=1517c7f5e8f641d28df4e67d0cba8ce5, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:33.500720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061680e-346b-4dd2-a208-095bf3bd248b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:33.619433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 848/1677] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:33 2022] PUT /identity/v3/projects/30a38a7ba68c47909a94b6fb787b80dc/users/1517c7f5e8f641d28df4e67d0cba8ce5/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:33.621250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cdacf-9b61-4dd9-ae21-7de85e7bf2c0 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:33.621865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cdacf-9b61-4dd9-ae21-7de85e7bf2c0 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:33.621976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cdacf-9b61-4dd9-ae21-7de85e7bf2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:33.622720 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 830/1678] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:33 2022] POST /identity/v3/projects => generated 393 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:33.632199 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5120b-a97c-4df8-8b3b-feab3cd737aa admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:33.686523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a02cdacf-9b61-4dd9-ae21-7de85e7bf2c0 None None] MFA Rules not processed for user `1517c7f5e8f641d28df4e67d0cba8ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:33.689646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a02cdacf-9b61-4dd9-ae21-7de85e7bf2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:33.698860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:33.799354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5120b-a97c-4df8-8b3b-feab3cd737aa admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:33.814588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82b524-6a11-40d8-9b8d-abaf8cf28570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:33.815268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82b524-6a11-40d8-9b8d-abaf8cf28570 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:33.815543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82b524-6a11-40d8-9b8d-abaf8cf28570 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:33.815818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82b524-6a11-40d8-9b8d-abaf8cf28570 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:33.816651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82b524-6a11-40d8-9b8d-abaf8cf28570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:33.818616 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82b524-6a11-40d8-9b8d-abaf8cf28570 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:33.867878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 849/1679] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:33.872225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cdacf-9b61-4dd9-ae21-7de85e7bf2c0 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:33.893809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cdacf-9b61-4dd9-ae21-7de85e7bf2c0 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:33.911529 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e313506-e24e-48d5-9dd0-d02ca03c2154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:33.912330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e313506-e24e-48d5-9dd0-d02ca03c2154 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:33.912826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e313506-e24e-48d5-9dd0-d02ca03c2154 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:33.913196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e313506-e24e-48d5-9dd0-d02ca03c2154 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:33.913936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e313506-e24e-48d5-9dd0-d02ca03c2154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:33.919403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e313506-e24e-48d5-9dd0-d02ca03c2154 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:33.979271 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 831/1680] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:33 2022] POST /identity/v3/users => generated 297 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:33.982506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82b524-6a11-40d8-9b8d-abaf8cf28570 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:34.007577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82b524-6a11-40d8-9b8d-abaf8cf28570 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:34.024393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0427e6d-cde2-4ea0-8ec5-77893ade243d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:34.025298 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0427e6d-cde2-4ea0-8ec5-77893ade243d admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:34.025714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0427e6d-cde2-4ea0-8ec5-77893ade243d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:34.026122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0427e6d-cde2-4ea0-8ec5-77893ade243d admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:34.028782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0427e6d-cde2-4ea0-8ec5-77893ade243d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:34.032311 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0427e6d-cde2-4ea0-8ec5-77893ade243d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:34.070204 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 850/1681] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:33 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:34.070204 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e313506-e24e-48d5-9dd0-d02ca03c2154 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:34.070357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 832/1682] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:34.070357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0427e6d-cde2-4ea0-8ec5-77893ade243d admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:34.107167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0427e6d-cde2-4ea0-8ec5-77893ade243d admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:34.246419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e313506-e24e-48d5-9dd0-d02ca03c2154 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:34.267910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb3358-2b57-4d31-ae8b-5a8a7950d8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:34.267910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb3358-2b57-4d31-ae8b-5a8a7950d8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:34.267910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb3358-2b57-4d31-ae8b-5a8a7950d8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:34.267910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb3358-2b57-4d31-ae8b-5a8a7950d8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:34.268789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb3358-2b57-4d31-ae8b-5a8a7950d8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:34.272909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb3358-2b57-4d31-ae8b-5a8a7950d8b7 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:34.313498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c1be2-e019-46a4-8354-6d2d201d4543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:34.316013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c1be2-e019-46a4-8354-6d2d201d4543 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:34.316783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c1be2-e019-46a4-8354-6d2d201d4543 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:34.317069 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c1be2-e019-46a4-8354-6d2d201d4543 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:34.318277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c1be2-e019-46a4-8354-6d2d201d4543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:34.324999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c1be2-e019-46a4-8354-6d2d201d4543 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:34.353530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 833/1683] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:34.360682 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c1be2-e019-46a4-8354-6d2d201d4543 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:34.384468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c1be2-e019-46a4-8354-6d2d201d4543 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:34.385346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 851/1684] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:34 2022] POST /identity/v3/users => generated 295 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:56:34.397361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb3358-2b57-4d31-ae8b-5a8a7950d8b7 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:34.406753 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7f144-87c0-40ef-b9a8-91b12045a97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:34.407495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f144-87c0-40ef-b9a8-91b12045a97e admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:34.408127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f144-87c0-40ef-b9a8-91b12045a97e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:34.408327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f144-87c0-40ef-b9a8-91b12045a97e admin admin] PATH_INFO: `/v3/projects/fb727c9af4d04fbbab4e240f60e0c843/users/e56f4db6fa3c4db28953b59a15e09334/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:34.414802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb3358-2b57-4d31-ae8b-5a8a7950d8b7 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:34.428482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1dc87-7d23-452f-831e-ec921dcb97c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:34.429241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1dc87-7d23-452f-831e-ec921dcb97c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:34.429590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1dc87-7d23-452f-831e-ec921dcb97c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:34.429937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1dc87-7d23-452f-831e-ec921dcb97c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:34.430722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1dc87-7d23-452f-831e-ec921dcb97c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:34.438594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1dc87-7d23-452f-831e-ec921dcb97c0 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:34.456444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7f144-87c0-40ef-b9a8-91b12045a97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb727c9af4d04fbbab4e240f60e0c843, user_id=e56f4db6fa3c4db28953b59a15e09334, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:34.464852 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7f144-87c0-40ef-b9a8-91b12045a97e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:34.470754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 852/1685] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:34.473842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1dc87-7d23-452f-831e-ec921dcb97c0 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:34.477728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6ee1dc87-7d23-452f-831e-ec921dcb97c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:34.521403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1dc87-7d23-452f-831e-ec921dcb97c0 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:34.549017 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:34.549942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:34.550372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:34.550933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] PATH_INFO: `/v3/projects/5e8b0fab7dc2445c8a8d1a382d9c5497` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:34.553865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8b0fab7dc2445c8a8d1a382d9c5497)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:34.555987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:34.576034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 834/1686] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:34 2022] PUT /identity/v3/projects/fb727c9af4d04fbbab4e240f60e0c843/users/e56f4db6fa3c4db28953b59a15e09334/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:34.577055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7f144-87c0-40ef-b9a8-91b12045a97e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:34.673762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7f144-87c0-40ef-b9a8-91b12045a97e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:34.692769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4371f-8bab-4b2c-a934-3a2e15a49863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:34.693817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4371f-8bab-4b2c-a934-3a2e15a49863 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:34.694241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4371f-8bab-4b2c-a934-3a2e15a49863 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:34.694657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4371f-8bab-4b2c-a934-3a2e15a49863 admin admin] PATH_INFO: `/v3/projects/564387840e8b404592092e3c6aa2c3d9/users/78648d8656f8460c8de19924768f3a5f/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:34.769066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8b0fab7dc2445c8a8d1a382d9c5497', 'request_id': 'req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:34.775234 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4371f-8bab-4b2c-a934-3a2e15a49863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=564387840e8b404592092e3c6aa2c3d9, user_id=78648d8656f8460c8de19924768f3a5f, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:34.786646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4371f-8bab-4b2c-a934-3a2e15a49863 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:34.789633 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8b0fab7dc2445c8a8d1a382d9c5497', 'request_id': 'req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:34.879004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8b0fab7dc2445c8a8d1a382d9c5497', 'request_id': 'req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:34.886556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 835/1687] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:34 2022] PUT /identity/v3/projects/564387840e8b404592092e3c6aa2c3d9/users/78648d8656f8460c8de19924768f3a5f/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:34.888176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02e6b1-0519-4ae3-b405-43cec46b8e6b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:34.888632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02e6b1-0519-4ae3-b405-43cec46b8e6b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:34.892407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02e6b1-0519-4ae3-b405-43cec46b8e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:34.913425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] The token cache is being invalidate because project 5e8b0fab7dc2445c8a8d1a382d9c5497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:56:34.913729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:34.915589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:34.924888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 853/1688] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:56:34 2022] DELETE /identity/v3/projects/5e8b0fab7dc2445c8a8d1a382d9c5497 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:34.934349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:34.938055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:35.003737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-7c02e6b1-0519-4ae3-b405-43cec46b8e6b None None] MFA Rules not processed for user `e56f4db6fa3c4db28953b59a15e09334`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:35.006710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7c02e6b1-0519-4ae3-b405-43cec46b8e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:35.194002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864a60-0ed3-4fa1-b68a-1f4a806f560c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:35.205685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 836/1689] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:35.208949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02e6b1-0519-4ae3-b405-43cec46b8e6b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:35.209368 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7c02e6b1-0519-4ae3-b405-43cec46b8e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:35.265691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:35.428775 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c5a8e-760d-462f-9d2c-c6257a17fa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:35.429476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c5a8e-760d-462f-9d2c-c6257a17fa25 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:35.429767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c5a8e-760d-462f-9d2c-c6257a17fa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:35.430043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c5a8e-760d-462f-9d2c-c6257a17fa25 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:35.430914 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c5a8e-760d-462f-9d2c-c6257a17fa25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:35.432621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c5a8e-760d-462f-9d2c-c6257a17fa25 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:35.443581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02e6b1-0519-4ae3-b405-43cec46b8e6b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:35.456449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 854/1690] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 531 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:35.457521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:35.459298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c5a8e-760d-462f-9d2c-c6257a17fa25 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:35.460049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:35.460338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:35.460872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] PATH_INFO: `/v3/users/7190dda77eee44f89aad6f37a1cfb35a` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:35.463084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7190dda77eee44f89aad6f37a1cfb35a)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:35.464764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-560c5a8e-760d-462f-9d2c-c6257a17fa25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:35.468900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:35.619202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c5a8e-760d-462f-9d2c-c6257a17fa25 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:35.631810 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a466b8e-979a-496c-b8c9-0bb2584b56af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:35.632523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466b8e-979a-496c-b8c9-0bb2584b56af service placement] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:35.632897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466b8e-979a-496c-b8c9-0bb2584b56af service placement] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:35.633265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466b8e-979a-496c-b8c9-0bb2584b56af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:35.641536 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1a466b8e-979a-496c-b8c9-0bb2584b56af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:35.676139 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a466b8e-979a-496c-b8c9-0bb2584b56af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:35.685497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a466b8e-979a-496c-b8c9-0bb2584b56af service placement] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:35.705773 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 855/1691] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:35.706795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a466b8e-979a-496c-b8c9-0bb2584b56af service placement] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:35.711512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:35.712043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1a466b8e-979a-496c-b8c9-0bb2584b56af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:35.741019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a466b8e-979a-496c-b8c9-0bb2584b56af service placement] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:35.761730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360f521-1492-430b-b82b-3935ab6fbe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:35.762364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360f521-1492-430b-b82b-3935ab6fbe96 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:35.762644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360f521-1492-430b-b82b-3935ab6fbe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:35.766641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360f521-1492-430b-b82b-3935ab6fbe96 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:35.775529 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360f521-1492-430b-b82b-3935ab6fbe96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:35.777492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360f521-1492-430b-b82b-3935ab6fbe96 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:35.796610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7190dda77eee44f89aad6f37a1cfb35a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:35.887808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7190dda77eee44f89aad6f37a1cfb35a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:35.903637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7190dda77eee44f89aad6f37a1cfb35a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:35.909728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7190dda77eee44f89aad6f37a1cfb35a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:35.931919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 856/1692] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:35 2022] POST /identity/v3/projects => generated 393 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:35.933236 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270b2cf-afa7-47d3-a32f-f7467ffd0248 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:35.936290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270b2cf-afa7-47d3-a32f-f7467ffd0248 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:35.936290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270b2cf-afa7-47d3-a32f-f7467ffd0248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:35.952040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7190dda77eee44f89aad6f37a1cfb35a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:35.972705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 837/1693] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:35 2022] DELETE /identity/v3/users/7190dda77eee44f89aad6f37a1cfb35a => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:35.972705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:35.989489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:35.995595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-9270b2cf-afa7-47d3-a32f-f7467ffd0248 None None] MFA Rules not processed for user `3810bf4e4ea043ca9f12340498bf51c2`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:35.996785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9270b2cf-afa7-47d3-a32f-f7467ffd0248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:36.130844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 857/1694] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:36.130844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270b2cf-afa7-47d3-a32f-f7467ffd0248 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:36.130844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9270b2cf-afa7-47d3-a32f-f7467ffd0248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:36.147315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08b2e-e5d9-4a05-8cae-f718594fd597 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:36.157475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf16104-98f8-4a80-90b4-b793f726d2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:36.158086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf16104-98f8-4a80-90b4-b793f726d2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:36.161995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf16104-98f8-4a80-90b4-b793f726d2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:36.162437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf16104-98f8-4a80-90b4-b793f726d2cc admin admin] PATH_INFO: `/v3/projects/564387840e8b404592092e3c6aa2c3d9/users/78648d8656f8460c8de19924768f3a5f/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:36.164320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270b2cf-afa7-47d3-a32f-f7467ffd0248 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:36.165882 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf16104-98f8-4a80-90b4-b793f726d2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=564387840e8b404592092e3c6aa2c3d9, user_id=78648d8656f8460c8de19924768f3a5f, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:36.170324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf16104-98f8-4a80-90b4-b793f726d2cc admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:36.171682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:36.177262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:36.177262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:36.177262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0 admin admin] PATH_INFO: `/v3/projects/209fa05ffb6246509e5170a98dc3cc04` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:36.183778 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209fa05ffb6246509e5170a98dc3cc04)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:36.184523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 838/1695] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:35 2022] PUT /identity/v3/projects/564387840e8b404592092e3c6aa2c3d9/users/78648d8656f8460c8de19924768f3a5f/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:36.186385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58079f5-50f4-4500-99ab-5691064c5eb8 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:36.187070 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58079f5-50f4-4500-99ab-5691064c5eb8 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:36.187606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58079f5-50f4-4500-99ab-5691064c5eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:36.195214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:36.247897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a58079f5-50f4-4500-99ab-5691064c5eb8 None None] MFA Rules not processed for user `4ebb392ea86a4ce9b14b619ad59e16ac`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:36.251987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a58079f5-50f4-4500-99ab-5691064c5eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:36.367694 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 839/1696] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:36.380748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58079f5-50f4-4500-99ab-5691064c5eb8 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:36.381414 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209fa05ffb6246509e5170a98dc3cc04', 'request_id': 'req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:36.383601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a58079f5-50f4-4500-99ab-5691064c5eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:36.404007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209fa05ffb6246509e5170a98dc3cc04', 'request_id': 'req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:36.415774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:36.484523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58079f5-50f4-4500-99ab-5691064c5eb8 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:36.496273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209fa05ffb6246509e5170a98dc3cc04', 'request_id': 'req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:36.521802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0 admin admin] The token cache is being invalidate because project 209fa05ffb6246509e5170a98dc3cc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:56:36.522102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:36.523595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ce7a1378-9ad4-41d0-84b8-8b8775f4b4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:36.529839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 858/1697] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:56:36 2022] DELETE /identity/v3/projects/209fa05ffb6246509e5170a98dc3cc04 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:36.535523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66221a-4d86-45fa-a845-5082509c01f3 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:36.535897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66221a-4d86-45fa-a845-5082509c01f3 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:36.536184 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66221a-4d86-45fa-a845-5082509c01f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:36.608581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-eb66221a-4d86-45fa-a845-5082509c01f3 None None] MFA Rules not processed for user `78648d8656f8460c8de19924768f3a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:36.613811 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-eb66221a-4d86-45fa-a845-5082509c01f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:36.653468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ff3b6-8f07-46f8-bed3-b26f096ff408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:36.658833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ff3b6-8f07-46f8-bed3-b26f096ff408 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:36.660871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ff3b6-8f07-46f8-bed3-b26f096ff408 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:36.661160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ff3b6-8f07-46f8-bed3-b26f096ff408 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:36.661921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ff3b6-8f07-46f8-bed3-b26f096ff408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:36.672840 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ff3b6-8f07-46f8-bed3-b26f096ff408 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:36.810090 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 840/1698] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:36 2022] POST /identity/v3/users => generated 303 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:36.811252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09032c0c-88ba-456b-ab0e-0e7036154d76 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:36.811549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09032c0c-88ba-456b-ab0e-0e7036154d76 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:36.811831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09032c0c-88ba-456b-ab0e-0e7036154d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:36.872165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-09032c0c-88ba-456b-ab0e-0e7036154d76 None None] MFA Rules not processed for user `3c8d932499ee46cb9179ef5b49c3dae1`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:36.873538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-09032c0c-88ba-456b-ab0e-0e7036154d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:36.920005 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 859/1699] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:36.921418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66221a-4d86-45fa-a845-5082509c01f3 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:36.928047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-eb66221a-4d86-45fa-a845-5082509c01f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:37.055229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 841/1700] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:37.056366 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96371c9e-5871-49e3-b463-def2abc1584b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:37.061502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96371c9e-5871-49e3-b463-def2abc1584b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:37.062171 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96371c9e-5871-49e3-b463-def2abc1584b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:37.125524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-96371c9e-5871-49e3-b463-def2abc1584b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:37.137503 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-96371c9e-5871-49e3-b463-def2abc1584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:37.160652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66221a-4d86-45fa-a845-5082509c01f3 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:37.176684 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 842/1701] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:37.180027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd1608-c7da-4d43-ad96-784897251a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:37.180151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96371c9e-5871-49e3-b463-def2abc1584b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:37.180225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd1608-c7da-4d43-ad96-784897251a76 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:37.180225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd1608-c7da-4d43-ad96-784897251a76 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:37.180225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd1608-c7da-4d43-ad96-784897251a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:37.180411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-96371c9e-5871-49e3-b463-def2abc1584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:37.186446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-fdfd1608-c7da-4d43-ad96-784897251a76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:37.197051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96371c9e-5871-49e3-b463-def2abc1584b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:37.204222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4f725-b7d6-4bbb-8c46-d6f0b7e6cdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:37.205280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4f725-b7d6-4bbb-8c46-d6f0b7e6cdca admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:37.205786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4f725-b7d6-4bbb-8c46-d6f0b7e6cdca admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:37.206329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4f725-b7d6-4bbb-8c46-d6f0b7e6cdca admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:37.208321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4f725-b7d6-4bbb-8c46-d6f0b7e6cdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:37.210752 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4f725-b7d6-4bbb-8c46-d6f0b7e6cdca admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:37.224329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 843/1702] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:37.225575 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4f725-b7d6-4bbb-8c46-d6f0b7e6cdca admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:37.229135 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-62f4f725-b7d6-4bbb-8c46-d6f0b7e6cdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:37.259986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd1608-c7da-4d43-ad96-784897251a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:37.263417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd1608-c7da-4d43-ad96-784897251a76 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:37.278378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 860/1703] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:37.279287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd1608-c7da-4d43-ad96-784897251a76 service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:37.280661 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-fdfd1608-c7da-4d43-ad96-784897251a76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:37.285531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:37.300782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd1608-c7da-4d43-ad96-784897251a76 service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:37.313223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:37.314398 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:37.314978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:37.315392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] PATH_INFO: `/v3/projects/7adfaff56e6346689948ecee2208cfe3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:37.316711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7adfaff56e6346689948ecee2208cfe3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:37.320620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:37.333814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4f725-b7d6-4bbb-8c46-d6f0b7e6cdca admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:37.341655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:37.344257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7c80c-c320-4c6b-be32-431b3a98dd07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:37.346320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7c80c-c320-4c6b-be32-431b3a98dd07 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:37.346320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7c80c-c320-4c6b-be32-431b3a98dd07 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:37.346320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7c80c-c320-4c6b-be32-431b3a98dd07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:37.357166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7c80c-c320-4c6b-be32-431b3a98dd07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:37.359019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7c80c-c320-4c6b-be32-431b3a98dd07 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:37.377513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 844/1704] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:37.378515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5c63d-570a-406a-828b-033253fccc09 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:37.384304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5c63d-570a-406a-828b-033253fccc09 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:37.384304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5c63d-570a-406a-828b-033253fccc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:37.423327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-aad5c63d-570a-406a-828b-033253fccc09 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:37.424605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-aad5c63d-570a-406a-828b-033253fccc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:37.447777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 845/1705] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:37.448632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5c63d-570a-406a-828b-033253fccc09 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:37.465826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7adfaff56e6346689948ecee2208cfe3', 'request_id': 'req-0c1db904-c729-463f-9617-4342a08594f6'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:37.470528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5c63d-570a-406a-828b-033253fccc09 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:37.480747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7adfaff56e6346689948ecee2208cfe3', 'request_id': 'req-0c1db904-c729-463f-9617-4342a08594f6'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:37.619167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884c825-9cff-4d4d-8c06-accbcf922352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:37.619307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7adfaff56e6346689948ecee2208cfe3', 'request_id': 'req-0c1db904-c729-463f-9617-4342a08594f6'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:37.619875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c825-9cff-4d4d-8c06-accbcf922352 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:37.620162 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c825-9cff-4d4d-8c06-accbcf922352 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:37.620442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c825-9cff-4d4d-8c06-accbcf922352 admin admin] PATH_INFO: `/v3/projects/ec251423636e4a65bcf3eb7a7d7ae670/users/cdf37e63b61f45199338adf932915cec/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:37.636254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] The token cache is being invalidate because project 7adfaff56e6346689948ecee2208cfe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:56:37.636550 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:37.640801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:37.644495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 861/1706] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:56:37 2022] DELETE /identity/v3/projects/7adfaff56e6346689948ecee2208cfe3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:37.645382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:37.655234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:37.671041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884c825-9cff-4d4d-8c06-accbcf922352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec251423636e4a65bcf3eb7a7d7ae670, user_id=cdf37e63b61f45199338adf932915cec, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:37.673948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884c825-9cff-4d4d-8c06-accbcf922352 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:37.685121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1db904-c729-463f-9617-4342a08594f6 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:37.709807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef289832-4964-4fae-8167-76a9dcca72e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:37.710692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef289832-4964-4fae-8167-76a9dcca72e8 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:37.711158 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef289832-4964-4fae-8167-76a9dcca72e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:37.711570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef289832-4964-4fae-8167-76a9dcca72e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:37.712568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef289832-4964-4fae-8167-76a9dcca72e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:37.713010 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef289832-4964-4fae-8167-76a9dcca72e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:37.715097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef289832-4964-4fae-8167-76a9dcca72e8 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:37.741553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 862/1707] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:37.743134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf980f-3fad-4a77-bb9c-bbf6d52c330d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:37.743547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf980f-3fad-4a77-bb9c-bbf6d52c330d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:37.743940 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf980f-3fad-4a77-bb9c-bbf6d52c330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:37.786478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-6cdf980f-3fad-4a77-bb9c-bbf6d52c330d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:37.801805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 846/1708] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:37 2022] PUT /identity/v3/projects/ec251423636e4a65bcf3eb7a7d7ae670/users/cdf37e63b61f45199338adf932915cec/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:37.801805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884c825-9cff-4d4d-8c06-accbcf922352 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:37.804725 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4884c825-9cff-4d4d-8c06-accbcf922352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:37.808830 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6cdf980f-3fad-4a77-bb9c-bbf6d52c330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:37.992041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884c825-9cff-4d4d-8c06-accbcf922352 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:38.017045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dbbe4-af80-433a-892b-88629638e38e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:38.017685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dbbe4-af80-433a-892b-88629638e38e service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:38.017967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dbbe4-af80-433a-892b-88629638e38e service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:38.018242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dbbe4-af80-433a-892b-88629638e38e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:38.021056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-dd2dbbe4-af80-433a-892b-88629638e38e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:38.034839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 863/1709] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:38.036037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf980f-3fad-4a77-bb9c-bbf6d52c330d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:38.077965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf980f-3fad-4a77-bb9c-bbf6d52c330d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:38.116697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1579fd-2965-4b19-b2d6-468ab0e09f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:38.119102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1579fd-2965-4b19-b2d6-468ab0e09f98 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:38.126450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1579fd-2965-4b19-b2d6-468ab0e09f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:38.131282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1579fd-2965-4b19-b2d6-468ab0e09f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:38.131282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1579fd-2965-4b19-b2d6-468ab0e09f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:38.134220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dbbe4-af80-433a-892b-88629638e38e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:38.136037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1579fd-2965-4b19-b2d6-468ab0e09f98 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:38.136273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dbbe4-af80-433a-892b-88629638e38e service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:38.160345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 847/1710] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:38.162753 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dbbe4-af80-433a-892b-88629638e38e service nova] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:38.166570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-dd2dbbe4-af80-433a-892b-88629638e38e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:38.271492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dbbe4-af80-433a-892b-88629638e38e service nova] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:38.275820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c851e-b82f-4737-938a-1f76f160c162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:38.276792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c851e-b82f-4737-938a-1f76f160c162 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:38.277170 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c851e-b82f-4737-938a-1f76f160c162 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:38.285324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c851e-b82f-4737-938a-1f76f160c162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:38.285324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-384c851e-b82f-4737-938a-1f76f160c162 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:38.316716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 864/1711] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:38 2022] POST /identity/v3/projects => generated 363 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:38.318009 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1579fd-2965-4b19-b2d6-468ab0e09f98 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:38.332126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9b1579fd-2965-4b19-b2d6-468ab0e09f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:38.453412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c851e-b82f-4737-938a-1f76f160c162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:38.455466 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c851e-b82f-4737-938a-1f76f160c162 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:38.468643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1579fd-2965-4b19-b2d6-468ab0e09f98 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:38.471924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 848/1712] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:38.473234 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304181-9b45-4d5d-a38a-e5722323c320 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:38.473509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304181-9b45-4d5d-a38a-e5722323c320 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:38.473859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304181-9b45-4d5d-a38a-e5722323c320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:38.490753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf96809-25a0-4950-896a-142c4d39e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:38.491589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf96809-25a0-4950-896a-142c4d39e909 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:38.492041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf96809-25a0-4950-896a-142c4d39e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:38.492483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf96809-25a0-4950-896a-142c4d39e909 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:38.493129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf96809-25a0-4950-896a-142c4d39e909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:38.494752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf96809-25a0-4950-896a-142c4d39e909 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:38.517010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f4304181-9b45-4d5d-a38a-e5722323c320 None None] MFA Rules not processed for user `eb701d6c531545ac8c7ed76a87706dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:38.523122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 865/1713] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:38.524413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469b2e5-00e3-4c84-ba76-03a2919d232d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:38.524697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469b2e5-00e3-4c84-ba76-03a2919d232d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:38.524972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469b2e5-00e3-4c84-ba76-03a2919d232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:38.538807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f4304181-9b45-4d5d-a38a-e5722323c320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:38.584035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-2469b2e5-00e3-4c84-ba76-03a2919d232d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:38.586586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2469b2e5-00e3-4c84-ba76-03a2919d232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:38.607311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 866/1714] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:38.610686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469b2e5-00e3-4c84-ba76-03a2919d232d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:38.620796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469b2e5-00e3-4c84-ba76-03a2919d232d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:38.633161 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a0a0a-f241-4e8e-a43d-190231837cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:38.634484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a0a0a-f241-4e8e-a43d-190231837cab admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:38.634484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a0a0a-f241-4e8e-a43d-190231837cab admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:38.640259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a0a0a-f241-4e8e-a43d-190231837cab admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:38.641013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a0a0a-f241-4e8e-a43d-190231837cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:38.643027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a0a0a-f241-4e8e-a43d-190231837cab admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:38.693972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:38.755932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 849/1715] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:38.755932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304181-9b45-4d5d-a38a-e5722323c320 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:38.758627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 867/1716] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:38 2022] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:38.758627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a0a0a-f241-4e8e-a43d-190231837cab admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:38.793629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a0a0a-f241-4e8e-a43d-190231837cab admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:38.806099 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304181-9b45-4d5d-a38a-e5722323c320 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:38.811785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0436f7-6566-4601-8a1c-a0c42e008ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:38.814116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0436f7-6566-4601-8a1c-a0c42e008ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:38.815258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0436f7-6566-4601-8a1c-a0c42e008ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:38.815555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0436f7-6566-4601-8a1c-a0c42e008ad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:38.816243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0436f7-6566-4601-8a1c-a0c42e008ad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:38.824259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0436f7-6566-4601-8a1c-a0c42e008ad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:38.824345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8339e4-3b97-4e1a-822e-af645135a1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:38.824345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8339e4-3b97-4e1a-822e-af645135a1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:38.824510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0436f7-6566-4601-8a1c-a0c42e008ad9 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:38.824584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8339e4-3b97-4e1a-822e-af645135a1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:38.824584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8339e4-3b97-4e1a-822e-af645135a1f2 admin admin] PATH_INFO: `/v3/projects/ec251423636e4a65bcf3eb7a7d7ae670/users/cdf37e63b61f45199338adf932915cec/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:38.828092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8339e4-3b97-4e1a-822e-af645135a1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec251423636e4a65bcf3eb7a7d7ae670, user_id=cdf37e63b61f45199338adf932915cec, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:38.830820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8339e4-3b97-4e1a-822e-af645135a1f2 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:38.846942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 868/1717] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:38.851328 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ad520-0b77-49cc-9bf7-bab22dc6a238 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:38.851622 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ad520-0b77-49cc-9bf7-bab22dc6a238 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:38.851900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ad520-0b77-49cc-9bf7-bab22dc6a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:38.865902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 850/1718] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:38 2022] PUT /identity/v3/projects/ec251423636e4a65bcf3eb7a7d7ae670/users/cdf37e63b61f45199338adf932915cec/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:38.867038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8339e4-3b97-4e1a-822e-af645135a1f2 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:38.894914 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-4d5ad520-0b77-49cc-9bf7-bab22dc6a238 None None] MFA Rules not processed for user `eb701d6c531545ac8c7ed76a87706dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:38.897828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4d5ad520-0b77-49cc-9bf7-bab22dc6a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:39.082461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 869/1719] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:39.086938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ad520-0b77-49cc-9bf7-bab22dc6a238 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:39.165207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8339e4-3b97-4e1a-822e-af645135a1f2 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:39.181402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c6c84-328b-422c-b63b-c04f418b1f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:39.183428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c6c84-328b-422c-b63b-c04f418b1f32 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:39.183715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c6c84-328b-422c-b63b-c04f418b1f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:39.183991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c6c84-328b-422c-b63b-c04f418b1f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:39.184657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c6c84-328b-422c-b63b-c04f418b1f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:39.197975 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c6c84-328b-422c-b63b-c04f418b1f32 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:39.230936 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 851/1720] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:39.235986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46535f-de89-45c2-b8f9-5d6def7959a2 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:39.236283 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46535f-de89-45c2-b8f9-5d6def7959a2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:39.236562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46535f-de89-45c2-b8f9-5d6def7959a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:39.345290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ad520-0b77-49cc-9bf7-bab22dc6a238 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:39.348665 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5d46535f-de89-45c2-b8f9-5d6def7959a2 None None] MFA Rules not processed for user `cdf37e63b61f45199338adf932915cec`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:39.353160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5d46535f-de89-45c2-b8f9-5d6def7959a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:39.360176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daebd0-6470-49e4-a7f1-aea2e56e4086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:39.360813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daebd0-6470-49e4-a7f1-aea2e56e4086 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:39.361149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daebd0-6470-49e4-a7f1-aea2e56e4086 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:39.361461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daebd0-6470-49e4-a7f1-aea2e56e4086 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:39.362280 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3daebd0-6470-49e4-a7f1-aea2e56e4086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:39.365851 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3daebd0-6470-49e4-a7f1-aea2e56e4086 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:39.483012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 852/1721] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:39.483775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46535f-de89-45c2-b8f9-5d6def7959a2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:39.492220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 870/1722] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:39 2022] POST /identity/v3/projects => generated 365 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:39.498348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daebd0-6470-49e4-a7f1-aea2e56e4086 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:39.656135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:39.662042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46535f-de89-45c2-b8f9-5d6def7959a2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:39.711369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daebd0-6470-49e4-a7f1-aea2e56e4086 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:39.732553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b84c6-460a-4e1c-a23c-950685a5fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:39.733207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b84c6-460a-4e1c-a23c-950685a5fe83 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:39.733492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b84c6-460a-4e1c-a23c-950685a5fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:39.733769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b84c6-460a-4e1c-a23c-950685a5fe83 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:39.734436 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b84c6-460a-4e1c-a23c-950685a5fe83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:39.736253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b84c6-460a-4e1c-a23c-950685a5fe83 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:39.762558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ab36a-442d-40da-976e-f3f30b7b7192 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:39.764060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ab36a-442d-40da-976e-f3f30b7b7192 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:39.764483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ab36a-442d-40da-976e-f3f30b7b7192 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:39.764896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ab36a-442d-40da-976e-f3f30b7b7192 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:39.766447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 871/1723] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:39.767537 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b84c6-460a-4e1c-a23c-950685a5fe83 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:39.875094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ab36a-442d-40da-976e-f3f30b7b7192 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:39.877721 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ab36a-442d-40da-976e-f3f30b7b7192 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:39.904833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 853/1724] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:39.906086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ab36a-442d-40da-976e-f3f30b7b7192 service nova] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:39.922455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b84c6-460a-4e1c-a23c-950685a5fe83 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:39.933354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe519ff-175f-4f4f-9d44-ba7d19ec6b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:39.933558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ab36a-442d-40da-976e-f3f30b7b7192 service nova] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:39.935428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe519ff-175f-4f4f-9d44-ba7d19ec6b86 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:39.936978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe519ff-175f-4f4f-9d44-ba7d19ec6b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:39.937856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe519ff-175f-4f4f-9d44-ba7d19ec6b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:39.957064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd566f05-16d6-4cf3-92f1-b0aca12ff7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:39.957739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd566f05-16d6-4cf3-92f1-b0aca12ff7fa admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:39.958022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd566f05-16d6-4cf3-92f1-b0aca12ff7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:39.958295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd566f05-16d6-4cf3-92f1-b0aca12ff7fa admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:39.958941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd566f05-16d6-4cf3-92f1-b0aca12ff7fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:39.973249 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd566f05-16d6-4cf3-92f1-b0aca12ff7fa admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:40.113285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe519ff-175f-4f4f-9d44-ba7d19ec6b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:40.128882 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe519ff-175f-4f4f-9d44-ba7d19ec6b86 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:40.143747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 854/1725] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:39 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:40.147974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd566f05-16d6-4cf3-92f1-b0aca12ff7fa admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:40.172736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd566f05-16d6-4cf3-92f1-b0aca12ff7fa admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:40.189301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 872/1726] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:39 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:40.191416 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe519ff-175f-4f4f-9d44-ba7d19ec6b86 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:40.210782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777172b2-c786-488a-8b19-c7818b2782b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:40.212458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777172b2-c786-488a-8b19-c7818b2782b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:40.214023 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777172b2-c786-488a-8b19-c7818b2782b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:40.214530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777172b2-c786-488a-8b19-c7818b2782b1 admin admin] PATH_INFO: `/v3/projects/9706f6fd03c1425db24cfe9c8729a6e7/users/1c64c25aec9e4248ac0add674d0dd1d2/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:40.257580 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe519ff-175f-4f4f-9d44-ba7d19ec6b86 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:40.273153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a362702-9481-446d-b7f8-945353066d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:40.274217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a362702-9481-446d-b7f8-945353066d18 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:40.277060 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a362702-9481-446d-b7f8-945353066d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:40.277482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a362702-9481-446d-b7f8-945353066d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:40.279625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a362702-9481-446d-b7f8-945353066d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:40.287839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a362702-9481-446d-b7f8-945353066d18 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:40.289666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777172b2-c786-488a-8b19-c7818b2782b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9706f6fd03c1425db24cfe9c8729a6e7, user_id=1c64c25aec9e4248ac0add674d0dd1d2, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:40.297834 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777172b2-c786-488a-8b19-c7818b2782b1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:40.327315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 873/1727] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:40.340071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a362702-9481-446d-b7f8-945353066d18 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:40.387561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a362702-9481-446d-b7f8-945353066d18 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:40.403784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849c263-56a5-457e-97e3-44d419351770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:40.404725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849c263-56a5-457e-97e3-44d419351770 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:40.406681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849c263-56a5-457e-97e3-44d419351770 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:40.408781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849c263-56a5-457e-97e3-44d419351770 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:40.411427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849c263-56a5-457e-97e3-44d419351770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:40.415438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849c263-56a5-457e-97e3-44d419351770 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:40.445820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 874/1728] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:40.445820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849c263-56a5-457e-97e3-44d419351770 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:40.450143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e849c263-56a5-457e-97e3-44d419351770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:40.454860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 855/1729] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:40 2022] PUT /identity/v3/projects/9706f6fd03c1425db24cfe9c8729a6e7/users/1c64c25aec9e4248ac0add674d0dd1d2/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:40.456059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777172b2-c786-488a-8b19-c7818b2782b1 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:40.486357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849c263-56a5-457e-97e3-44d419351770 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:40.518818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:40.647602 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0559f-269a-495c-9121-b0c750c4a4b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:40.649373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0559f-269a-495c-9121-b0c750c4a4b0 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:40.649373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0559f-269a-495c-9121-b0c750c4a4b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:40.655650 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0559f-269a-495c-9121-b0c750c4a4b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:40.665272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-47e0559f-269a-495c-9121-b0c750c4a4b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:40.740081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777172b2-c786-488a-8b19-c7818b2782b1 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:40.767539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2219e-94e5-46b3-adb6-540e47873e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:40.768830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2219e-94e5-46b3-adb6-540e47873e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:40.768830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2219e-94e5-46b3-adb6-540e47873e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:40.769141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2219e-94e5-46b3-adb6-540e47873e12 admin admin] PATH_INFO: `/v3/projects/fd09993292d244ce978a62eb70250857/users/86272fcae4d248afbaf149d9764e04bc/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:40.802122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2219e-94e5-46b3-adb6-540e47873e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd09993292d244ce978a62eb70250857, user_id=86272fcae4d248afbaf149d9764e04bc, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:40.805039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2219e-94e5-46b3-adb6-540e47873e12 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:40.858201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0559f-269a-495c-9121-b0c750c4a4b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:40.859835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0559f-269a-495c-9121-b0c750c4a4b0 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:40.881370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 875/1730] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:40.895361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c808dfd-b697-4bb1-93a9-ac3993792ad9 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:40.902798 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c808dfd-b697-4bb1-93a9-ac3993792ad9 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:40.903178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c808dfd-b697-4bb1-93a9-ac3993792ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:40.922265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 856/1731] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:40 2022] PUT /identity/v3/projects/fd09993292d244ce978a62eb70250857/users/86272fcae4d248afbaf149d9764e04bc/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:40.931758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec24c5-a3d1-4cb2-ba06-88118fcb9dd9 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:40.931758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec24c5-a3d1-4cb2-ba06-88118fcb9dd9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:40.931758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec24c5-a3d1-4cb2-ba06-88118fcb9dd9 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:40.943738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 857/1732] 10.222.0.73 () {54 vars in 912 bytes} [Mon Aug 29 23:56:40 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:56:40.953915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb79be6-1693-4049-a8d3-5993df53cde0 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:40.954395 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb79be6-1693-4049-a8d3-5993df53cde0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:40.954744 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb79be6-1693-4049-a8d3-5993df53cde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:41.009978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-1c808dfd-b697-4bb1-93a9-ac3993792ad9 None None] MFA Rules not processed for user `1c64c25aec9e4248ac0add674d0dd1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:41.015651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1c808dfd-b697-4bb1-93a9-ac3993792ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:41.060097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-cbb79be6-1693-4049-a8d3-5993df53cde0 None None] MFA Rules not processed for user `86272fcae4d248afbaf149d9764e04bc`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:41.062333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-cbb79be6-1693-4049-a8d3-5993df53cde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:41.223075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 876/1733] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:41.227889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f3dd-9acd-4fb6-bd73-5936135a1894 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:41.229919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f3dd-9acd-4fb6-bd73-5936135a1894 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:41.230396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f3dd-9acd-4fb6-bd73-5936135a1894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:41.296187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-7c86f3dd-9acd-4fb6-bd73-5936135a1894 None None] MFA Rules not processed for user `707518bbe380425aa793f005548bc9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:41.298273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7c86f3dd-9acd-4fb6-bd73-5936135a1894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:41.343509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 858/1734] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:41.345731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888f0cd-6440-47f7-a5ab-53794a05feb2 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:41.345731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888f0cd-6440-47f7-a5ab-53794a05feb2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:41.345927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888f0cd-6440-47f7-a5ab-53794a05feb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:41.431036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 877/1735] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Aug 29 23:56:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:41.432246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f3dd-9acd-4fb6-bd73-5936135a1894 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:41.466214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d888f0cd-6440-47f7-a5ab-53794a05feb2 None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:41.468373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d888f0cd-6440-47f7-a5ab-53794a05feb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:41.576998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 859/1736] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Aug 29 23:56:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:41.577830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888f0cd-6440-47f7-a5ab-53794a05feb2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:41.585590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f3dd-9acd-4fb6-bd73-5936135a1894 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:41.590243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d888f0cd-6440-47f7-a5ab-53794a05feb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:41.592548 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece7f08-9b31-4846-848f-ec641bd86468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:41.593939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece7f08-9b31-4846-848f-ec641bd86468 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:41.594631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece7f08-9b31-4846-848f-ec641bd86468 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:41.595111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece7f08-9b31-4846-848f-ec641bd86468 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:41.596530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece7f08-9b31-4846-848f-ec641bd86468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:41.599743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece7f08-9b31-4846-848f-ec641bd86468 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:41.605825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888f0cd-6440-47f7-a5ab-53794a05feb2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:41.611481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d610e35-2c9d-48c4-9a1c-867d638b2b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:41.612208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d610e35-2c9d-48c4-9a1c-867d638b2b0c service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:41.612560 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d610e35-2c9d-48c4-9a1c-867d638b2b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:41.612896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d610e35-2c9d-48c4-9a1c-867d638b2b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:41.624347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d610e35-2c9d-48c4-9a1c-867d638b2b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:41.626037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d610e35-2c9d-48c4-9a1c-867d638b2b0c service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:41.636488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 860/1737] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:41.795547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 878/1738] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:41 2022] POST /identity/v3/projects => generated 367 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:41.796040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d610e35-2c9d-48c4-9a1c-867d638b2b0c service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:41.798424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece7f08-9b31-4846-848f-ec641bd86468 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:41.904786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d610e35-2c9d-48c4-9a1c-867d638b2b0c service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:42.026595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece7f08-9b31-4846-848f-ec641bd86468 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:42.038006 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cc927-502f-4b21-825b-1336a39c1dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:42.038954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cc927-502f-4b21-825b-1336a39c1dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:42.039239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cc927-502f-4b21-825b-1336a39c1dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:42.039518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cc927-502f-4b21-825b-1336a39c1dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:42.042771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cc927-502f-4b21-825b-1336a39c1dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:42.046003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cc927-502f-4b21-825b-1336a39c1dc4 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:42.081626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f72ce-cfdc-463d-9ede-e0105c5f2cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:42.082511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f72ce-cfdc-463d-9ede-e0105c5f2cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:42.108434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f72ce-cfdc-463d-9ede-e0105c5f2cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:42.109632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f72ce-cfdc-463d-9ede-e0105c5f2cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:42.185893 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 879/1739] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:41 2022] POST /identity/v3/users => generated 290 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:42.190761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cc927-502f-4b21-825b-1336a39c1dc4 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:42.195192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-050cc927-502f-4b21-825b-1336a39c1dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:42.233247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f72ce-cfdc-463d-9ede-e0105c5f2cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:42.237009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f72ce-cfdc-463d-9ede-e0105c5f2cd8 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:42.279913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 861/1740] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:42.303636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f72ce-cfdc-463d-9ede-e0105c5f2cd8 service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:42.357731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f72ce-cfdc-463d-9ede-e0105c5f2cd8 service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:42.386328 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8540f9-e848-4ae3-a7f7-b4c4f83842f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:42.386992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8540f9-e848-4ae3-a7f7-b4c4f83842f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:42.387277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8540f9-e848-4ae3-a7f7-b4c4f83842f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:42.387553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8540f9-e848-4ae3-a7f7-b4c4f83842f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:42.388214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8540f9-e848-4ae3-a7f7-b4c4f83842f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:42.389836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8540f9-e848-4ae3-a7f7-b4c4f83842f0 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:42.450649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 862/1741] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:42.464007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8540f9-e848-4ae3-a7f7-b4c4f83842f0 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:42.469126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:42.498137 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8540f9-e848-4ae3-a7f7-b4c4f83842f0 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:42.516595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7d06a-5199-41c7-92bb-71cfa84f967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:42.517252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7d06a-5199-41c7-92bb-71cfa84f967d admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:42.517538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7d06a-5199-41c7-92bb-71cfa84f967d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:42.517821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7d06a-5199-41c7-92bb-71cfa84f967d admin admin] PATH_INFO: `/v3/projects/5880890d56704cc7986a635b697046cd/users/98f0b4b5d53a4f72a1f1e7a378145ade/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:42.556394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cc927-502f-4b21-825b-1336a39c1dc4 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:42.575482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7d06a-5199-41c7-92bb-71cfa84f967d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5880890d56704cc7986a635b697046cd, user_id=98f0b4b5d53a4f72a1f1e7a378145ade, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:42.577858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb74632-227d-4184-a634-a91af58d729a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:42.578665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb74632-227d-4184-a634-a91af58d729a service swift] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:42.579449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb74632-227d-4184-a634-a91af58d729a service swift] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:42.579736 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb74632-227d-4184-a634-a91af58d729a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:42.585804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7d06a-5199-41c7-92bb-71cfa84f967d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:42.704214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 863/1742] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:42 2022] PUT /identity/v3/projects/5880890d56704cc7986a635b697046cd/users/98f0b4b5d53a4f72a1f1e7a378145ade/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:42.711580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7d06a-5199-41c7-92bb-71cfa84f967d admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:42.779662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb74632-227d-4184-a634-a91af58d729a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:42.782430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb74632-227d-4184-a634-a91af58d729a service swift] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:42.807386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 880/1743] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Aug 29 23:56:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:56:42.841474 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7d06a-5199-41c7-92bb-71cfa84f967d admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:42.863038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0b288-0bc5-4307-9c56-ee6a367e9ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:42.865323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0b288-0bc5-4307-9c56-ee6a367e9ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:42.867288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0b288-0bc5-4307-9c56-ee6a367e9ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:42.867880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0b288-0bc5-4307-9c56-ee6a367e9ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:42.869168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0b288-0bc5-4307-9c56-ee6a367e9ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:42.872792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0b288-0bc5-4307-9c56-ee6a367e9ba4 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:42.911772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 864/1744] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:56:42.915016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb74632-227d-4184-a634-a91af58d729a service swift] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:42.933569 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb74632-227d-4184-a634-a91af58d729a service swift] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:42.947178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287979a-db13-40fa-b864-d0c5b15ad10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:42.948658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287979a-db13-40fa-b864-d0c5b15ad10d admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:42.948658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287979a-db13-40fa-b864-d0c5b15ad10d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:42.948658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287979a-db13-40fa-b864-d0c5b15ad10d admin admin] PATH_INFO: `/v3/projects/5880890d56704cc7986a635b697046cd/users/98f0b4b5d53a4f72a1f1e7a378145ade/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:42.957987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287979a-db13-40fa-b864-d0c5b15ad10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5880890d56704cc7986a635b697046cd, user_id=98f0b4b5d53a4f72a1f1e7a378145ade, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:42.965499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287979a-db13-40fa-b864-d0c5b15ad10d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:43.005504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 881/1745] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:42 2022] PUT /identity/v3/projects/5880890d56704cc7986a635b697046cd/users/98f0b4b5d53a4f72a1f1e7a378145ade/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:43.016391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dca76-9dfd-477b-a127-176920a44c9e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:43.016637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dca76-9dfd-477b-a127-176920a44c9e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:43.016965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dca76-9dfd-477b-a127-176920a44c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:43.060816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-eb7dca76-9dfd-477b-a127-176920a44c9e None None] MFA Rules not processed for user `98f0b4b5d53a4f72a1f1e7a378145ade`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:43.062554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-eb7dca76-9dfd-477b-a127-176920a44c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:43.208884 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 865/1746] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:43.222721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287979a-db13-40fa-b864-d0c5b15ad10d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:43.360239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:43.417147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287979a-db13-40fa-b864-d0c5b15ad10d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:43.433356 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c86e29-0306-4f05-95ec-b9a13eb7f72c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:43.433999 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c86e29-0306-4f05-95ec-b9a13eb7f72c service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:43.434541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c86e29-0306-4f05-95ec-b9a13eb7f72c service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:43.435001 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c86e29-0306-4f05-95ec-b9a13eb7f72c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:43.459303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c86e29-0306-4f05-95ec-b9a13eb7f72c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:43.474903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c86e29-0306-4f05-95ec-b9a13eb7f72c service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:43.512676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 882/1747] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:44.932701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dca76-9dfd-477b-a127-176920a44c9e None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:44.944406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dca76-9dfd-477b-a127-176920a44c9e None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:44.976523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92552c-291f-465b-8360-663a0320e5f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:44.977382 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92552c-291f-465b-8360-663a0320e5f5 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:44.977819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92552c-291f-465b-8360-663a0320e5f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:44.978261 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92552c-291f-465b-8360-663a0320e5f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:45.130181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92552c-291f-465b-8360-663a0320e5f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:45.132913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92552c-291f-465b-8360-663a0320e5f5 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:45.147258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052ec2e-9e2c-427b-886e-7c56a8d78055 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:45.148227 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052ec2e-9e2c-427b-886e-7c56a8d78055 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:45.148722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052ec2e-9e2c-427b-886e-7c56a8d78055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:45.150383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 866/1748] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:45.214654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-3052ec2e-9e2c-427b-886e-7c56a8d78055 None None] MFA Rules not processed for user `707518bbe380425aa793f005548bc9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:45.214968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-3052ec2e-9e2c-427b-886e-7c56a8d78055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:45.353230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 883/1749] 10.222.0.79 () {58 vars in 1015 bytes} [Mon Aug 29 23:56:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:45.766740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:45.826752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052ec2e-9e2c-427b-886e-7c56a8d78055 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:45.828354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-3052ec2e-9e2c-427b-886e-7c56a8d78055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:45.832672 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac212aa-d6d7-48d1-adf2-507caa1bee0e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:45.832973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac212aa-d6d7-48d1-adf2-507caa1bee0e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:45.833930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac212aa-d6d7-48d1-adf2-507caa1bee0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:45.852460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052ec2e-9e2c-427b-886e-7c56a8d78055 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:45.877806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04635004-7087-49ff-9c6a-2da953fc1ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:45.891322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04635004-7087-49ff-9c6a-2da953fc1ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:45.891762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04635004-7087-49ff-9c6a-2da953fc1ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:45.896419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:45.897135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04635004-7087-49ff-9c6a-2da953fc1ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:45.897964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-6ac212aa-d6d7-48d1-adf2-507caa1bee0e None None] MFA Rules not processed for user `4ebb392ea86a4ce9b14b619ad59e16ac`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:45.906383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6ac212aa-d6d7-48d1-adf2-507caa1bee0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:45.918978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04635004-7087-49ff-9c6a-2da953fc1ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:45.924864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04635004-7087-49ff-9c6a-2da953fc1ca9 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:45.955124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 884/1750] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:46.124596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 867/1751] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:47.052760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c205e-de09-4f73-b864-38e9cfd1b55e None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:47.053277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c205e-de09-4f73-b864-38e9cfd1b55e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:47.053359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c205e-de09-4f73-b864-38e9cfd1b55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:47.117101 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e41c205e-de09-4f73-b864-38e9cfd1b55e None None] MFA Rules not processed for user `3c8d932499ee46cb9179ef5b49c3dae1`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:47.118439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e41c205e-de09-4f73-b864-38e9cfd1b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:47.376840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 885/1752] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:47.661098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:48.647332 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:49.055213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b779f-d6a9-491d-a927-9fcdc5dc1e88 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:49.056117 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b779f-d6a9-491d-a927-9fcdc5dc1e88 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:49.056537 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b779f-d6a9-491d-a927-9fcdc5dc1e88 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:49.059193 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 868/1753] 10.222.0.73 () {54 vars in 921 bytes} [Mon Aug 29 23:56:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:56:49.079978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edcd7b-47f4-40b5-97cc-62816c21ccc8 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:49.080721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edcd7b-47f4-40b5-97cc-62816c21ccc8 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:49.081144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edcd7b-47f4-40b5-97cc-62816c21ccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:49.129230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-29edcd7b-47f4-40b5-97cc-62816c21ccc8 None None] MFA Rules not processed for user `59a1b0b274294a288dbf07cd99f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:49.133782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-29edcd7b-47f4-40b5-97cc-62816c21ccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:49.239705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 886/1754] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Aug 29 23:56:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:49.259003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:50.283512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d304aef-ca21-428f-8c38-9a017ffe945a None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:50.284690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d304aef-ca21-428f-8c38-9a017ffe945a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:50.285195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d304aef-ca21-428f-8c38-9a017ffe945a None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:50.287156 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 869/1755] 10.222.0.73 () {54 vars in 921 bytes} [Mon Aug 29 23:56:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:56:50.312844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:50.348438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351404bf-bea3-436f-a8a9-4f972185998a None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:50.349744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351404bf-bea3-436f-a8a9-4f972185998a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:50.350272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351404bf-bea3-436f-a8a9-4f972185998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:50.379868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d304aef-ca21-428f-8c38-9a017ffe945a None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:50.431019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-351404bf-bea3-436f-a8a9-4f972185998a None None] MFA Rules not processed for user `59a1b0b274294a288dbf07cd99f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:50.436354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-351404bf-bea3-436f-a8a9-4f972185998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:50.462325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 887/1756] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Aug 29 23:56:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:50.528901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d304aef-ca21-428f-8c38-9a017ffe945a None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:50.541979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee0496-bf38-47ad-ab4c-e4fe65331922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:50.542851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee0496-bf38-47ad-ab4c-e4fe65331922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:50.543367 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee0496-bf38-47ad-ab4c-e4fe65331922 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:50.543724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee0496-bf38-47ad-ab4c-e4fe65331922 admin admin] PATH_INFO: `/v3/users/e56f4db6fa3c4db28953b59a15e09334` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:50.545117 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee0496-bf38-47ad-ab4c-e4fe65331922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56f4db6fa3c4db28953b59a15e09334)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:50.548141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee0496-bf38-47ad-ab4c-e4fe65331922 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:50.642086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:50.909062 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-30ee0496-bf38-47ad-ab4c-e4fe65331922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56f4db6fa3c4db28953b59a15e09334'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:51.013169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351404bf-bea3-436f-a8a9-4f972185998a None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:51.014975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-351404bf-bea3-436f-a8a9-4f972185998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:51.027488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-30ee0496-bf38-47ad-ab4c-e4fe65331922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56f4db6fa3c4db28953b59a15e09334'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:51.038384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-30ee0496-bf38-47ad-ab4c-e4fe65331922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56f4db6fa3c4db28953b59a15e09334'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:51.040704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-30ee0496-bf38-47ad-ab4c-e4fe65331922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56f4db6fa3c4db28953b59a15e09334'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:51.055242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351404bf-bea3-436f-a8a9-4f972185998a None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:51.070907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c843e1d-c88b-4bd1-b45c-390b0e332b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:51.071804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c843e1d-c88b-4bd1-b45c-390b0e332b97 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:51.090211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c843e1d-c88b-4bd1-b45c-390b0e332b97 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:51.090211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c843e1d-c88b-4bd1-b45c-390b0e332b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:51.099134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9c843e1d-c88b-4bd1-b45c-390b0e332b97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:51.099476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-30ee0496-bf38-47ad-ab4c-e4fe65331922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56f4db6fa3c4db28953b59a15e09334'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:51.113820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c843e1d-c88b-4bd1-b45c-390b0e332b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:51.116581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 870/1757] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:50 2022] DELETE /identity/v3/users/e56f4db6fa3c4db28953b59a15e09334 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:51.116708 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c843e1d-c88b-4bd1-b45c-390b0e332b97 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:51.120408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bb2ef-f112-48e2-9261-6dd3e4a3f2a2 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:51.120987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bb2ef-f112-48e2-9261-6dd3e4a3f2a2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:51.121876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bb2ef-f112-48e2-9261-6dd3e4a3f2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:51.141405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 888/1758] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:51.200754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-1e2bb2ef-f112-48e2-9261-6dd3e4a3f2a2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:51.200754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1e2bb2ef-f112-48e2-9261-6dd3e4a3f2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:51.417814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 871/1759] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:56:51.469945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c843e1d-c88b-4bd1-b45c-390b0e332b97 service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:51.469945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9c843e1d-c88b-4bd1-b45c-390b0e332b97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:51.513468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bb2ef-f112-48e2-9261-6dd3e4a3f2a2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:51.515420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1e2bb2ef-f112-48e2-9261-6dd3e4a3f2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:51.521472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c843e1d-c88b-4bd1-b45c-390b0e332b97 service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:51.687486 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547c6c3-b524-49ac-b802-9ca52496d955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:51.688341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547c6c3-b524-49ac-b802-9ca52496d955 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:51.688771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547c6c3-b524-49ac-b802-9ca52496d955 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:51.689187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547c6c3-b524-49ac-b802-9ca52496d955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:51.712498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547c6c3-b524-49ac-b802-9ca52496d955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:51.719637 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547c6c3-b524-49ac-b802-9ca52496d955 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:51.741079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 889/1760] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:51.818824 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:51.844530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bb2ef-f112-48e2-9261-6dd3e4a3f2a2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:51.864118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f93ef-ecbd-4c7d-a7ef-7e7ab72e05db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:51.875709 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f93ef-ecbd-4c7d-a7ef-7e7ab72e05db service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:51.878051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f93ef-ecbd-4c7d-a7ef-7e7ab72e05db service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:51.882007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f93ef-ecbd-4c7d-a7ef-7e7ab72e05db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:51.888235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-006f93ef-ecbd-4c7d-a7ef-7e7ab72e05db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:51.945892 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f93ef-ecbd-4c7d-a7ef-7e7ab72e05db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:51.947727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f93ef-ecbd-4c7d-a7ef-7e7ab72e05db service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:51.988785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 872/1761] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:56:52.561179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:53.042279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547c6c3-b524-49ac-b802-9ca52496d955 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:53.042279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6547c6c3-b524-49ac-b802-9ca52496d955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:53.060056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547c6c3-b524-49ac-b802-9ca52496d955 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:53.084150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:53.088685 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:53.088983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:53.089631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:53.089921 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] PATH_INFO: `/v3/projects/fb727c9af4d04fbbab4e240f60e0c843` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:53.099753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb727c9af4d04fbbab4e240f60e0c843)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:53.101844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:53.191470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f93ef-ecbd-4c7d-a7ef-7e7ab72e05db service nova] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:53.192924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-006f93ef-ecbd-4c7d-a7ef-7e7ab72e05db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:53.238177 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f93ef-ecbd-4c7d-a7ef-7e7ab72e05db service nova] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:53.243551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d40915-db6e-4aa0-a2d8-103b0102b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:53.244403 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d40915-db6e-4aa0-a2d8-103b0102b6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:53.244967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d40915-db6e-4aa0-a2d8-103b0102b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:53.245345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d40915-db6e-4aa0-a2d8-103b0102b6a0 admin admin] PATH_INFO: `/v3/users/1517c7f5e8f641d28df4e67d0cba8ce5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:53.250650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d40915-db6e-4aa0-a2d8-103b0102b6a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1517c7f5e8f641d28df4e67d0cba8ce5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:53.252860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d40915-db6e-4aa0-a2d8-103b0102b6a0 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:53.318593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb727c9af4d04fbbab4e240f60e0c843', 'request_id': 'req-4d22985f-a41a-4fbb-b429-4f6f486222e6'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:53.328763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb727c9af4d04fbbab4e240f60e0c843', 'request_id': 'req-4d22985f-a41a-4fbb-b429-4f6f486222e6'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:53.470841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb727c9af4d04fbbab4e240f60e0c843', 'request_id': 'req-4d22985f-a41a-4fbb-b429-4f6f486222e6'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:53.503153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] The token cache is being invalidate because project fb727c9af4d04fbbab4e240f60e0c843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:56:53.503153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:53.507332 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:53.516632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 890/1762] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:56:53 2022] DELETE /identity/v3/projects/fb727c9af4d04fbbab4e240f60e0c843 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:53.520857 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:53.531035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:53.600958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-44d40915-db6e-4aa0-a2d8-103b0102b6a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1517c7f5e8f641d28df4e67d0cba8ce5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:53.723194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-44d40915-db6e-4aa0-a2d8-103b0102b6a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1517c7f5e8f641d28df4e67d0cba8ce5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:53.735193 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22985f-a41a-4fbb-b429-4f6f486222e6 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:53.746623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-44d40915-db6e-4aa0-a2d8-103b0102b6a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1517c7f5e8f641d28df4e67d0cba8ce5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:53.747962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-44d40915-db6e-4aa0-a2d8-103b0102b6a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1517c7f5e8f641d28df4e67d0cba8ce5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:53.757864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:53.758913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:53.759735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:53.760398 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] PATH_INFO: `/v3/users/cdf37e63b61f45199338adf932915cec` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:53.764320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf37e63b61f45199338adf932915cec)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:53.766563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:53.776499 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-44d40915-db6e-4aa0-a2d8-103b0102b6a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1517c7f5e8f641d28df4e67d0cba8ce5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:53.791948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 873/1763] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:53 2022] DELETE /identity/v3/users/1517c7f5e8f641d28df4e67d0cba8ce5 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:53.796787 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b7a44-34d3-4752-afe3-a71d2102cf72 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:53.797447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b7a44-34d3-4752-afe3-a71d2102cf72 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:53.798039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b7a44-34d3-4752-afe3-a71d2102cf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:53.828739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5f5b7a44-34d3-4752-afe3-a71d2102cf72 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:53.839512 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5f5b7a44-34d3-4752-afe3-a71d2102cf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:53.955629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 874/1764] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:53.971171 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b7a44-34d3-4752-afe3-a71d2102cf72 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:53.981612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5f5b7a44-34d3-4752-afe3-a71d2102cf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:53.989628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf37e63b61f45199338adf932915cec'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:54.010126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf37e63b61f45199338adf932915cec'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:54.019135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf37e63b61f45199338adf932915cec'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:54.020339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf37e63b61f45199338adf932915cec'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:54.021188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf37e63b61f45199338adf932915cec'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:54.116183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 891/1765] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:53 2022] DELETE /identity/v3/users/cdf37e63b61f45199338adf932915cec => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:54.120776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b7a44-34d3-4752-afe3-a71d2102cf72 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:54.207225 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f1de9-919c-4e4f-a4ae-f1da6af4d9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:54.209275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f1de9-919c-4e4f-a4ae-f1da6af4d9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:54.209558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f1de9-919c-4e4f-a4ae-f1da6af4d9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:54.211226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f1de9-919c-4e4f-a4ae-f1da6af4d9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:54.214799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a37f1de9-919c-4e4f-a4ae-f1da6af4d9b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:54.364623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f1de9-919c-4e4f-a4ae-f1da6af4d9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:54.366847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f1de9-919c-4e4f-a4ae-f1da6af4d9b1 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:54.379766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 875/1766] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:56:54.548054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:54.793090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:56.293907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:56.293907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:56.302725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8615d8-a1a1-4c3d-8364-6e36e19a3e4b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:56.314109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:56.314786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:56.315165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:56.315452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] PATH_INFO: `/v3/projects/ec251423636e4a65bcf3eb7a7d7ae670` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:56.317158 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec251423636e4a65bcf3eb7a7d7ae670)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:56.319142 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:56.561301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f1de9-919c-4e4f-a4ae-f1da6af4d9b1 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:56.562854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a37f1de9-919c-4e4f-a4ae-f1da6af4d9b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:56.577933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f1de9-919c-4e4f-a4ae-f1da6af4d9b1 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:56.590624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90560b8-f1fe-4dd6-b173-814f026de0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:56.591433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90560b8-f1fe-4dd6-b173-814f026de0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:56.591782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90560b8-f1fe-4dd6-b173-814f026de0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:56.592940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90560b8-f1fe-4dd6-b173-814f026de0c2 admin admin] PATH_INFO: `/v3/projects/30a38a7ba68c47909a94b6fb787b80dc` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:56.593819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90560b8-f1fe-4dd6-b173-814f026de0c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a38a7ba68c47909a94b6fb787b80dc)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:56.595777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90560b8-f1fe-4dd6-b173-814f026de0c2 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:56.639030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec251423636e4a65bcf3eb7a7d7ae670', 'request_id': 'req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:56.646394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec251423636e4a65bcf3eb7a7d7ae670', 'request_id': 'req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:56.786606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec251423636e4a65bcf3eb7a7d7ae670', 'request_id': 'req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:56.800791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] The token cache is being invalidate because project ec251423636e4a65bcf3eb7a7d7ae670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:56:56.801119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:56.801815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:56.803373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 892/1767] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:56:56 2022] DELETE /identity/v3/projects/ec251423636e4a65bcf3eb7a7d7ae670 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:56.804139 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:56.805761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:56.814669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e90560b8-f1fe-4dd6-b173-814f026de0c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a38a7ba68c47909a94b6fb787b80dc', 'request_id': 'req-e90560b8-f1fe-4dd6-b173-814f026de0c2'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:56.821610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e90560b8-f1fe-4dd6-b173-814f026de0c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a38a7ba68c47909a94b6fb787b80dc', 'request_id': 'req-e90560b8-f1fe-4dd6-b173-814f026de0c2'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:56.829283 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e90560b8-f1fe-4dd6-b173-814f026de0c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a38a7ba68c47909a94b6fb787b80dc', 'request_id': 'req-e90560b8-f1fe-4dd6-b173-814f026de0c2'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:56.880656 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae0706-e8ca-42ff-9bf8-3239ff7fdfe6 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:56.947590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e90560b8-f1fe-4dd6-b173-814f026de0c2 admin admin] The token cache is being invalidate because project 30a38a7ba68c47909a94b6fb787b80dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:56:56.947828 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e90560b8-f1fe-4dd6-b173-814f026de0c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:56.948602 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e90560b8-f1fe-4dd6-b173-814f026de0c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:56.951082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 876/1768] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:56:56 2022] DELETE /identity/v3/projects/30a38a7ba68c47909a94b6fb787b80dc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:56.953514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d7ffa-a1d8-4b15-9509-43354f003bd2 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:56.954055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d7ffa-a1d8-4b15-9509-43354f003bd2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:56.954488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d7ffa-a1d8-4b15-9509-43354f003bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:56.957127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05607fa9-1d3a-42a6-91bd-82b4e5a24445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:56.957845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05607fa9-1d3a-42a6-91bd-82b4e5a24445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:56.958198 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05607fa9-1d3a-42a6-91bd-82b4e5a24445 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:56.958561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05607fa9-1d3a-42a6-91bd-82b4e5a24445 admin admin] PATH_INFO: `/v3/users/86272fcae4d248afbaf149d9764e04bc` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:56.959827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05607fa9-1d3a-42a6-91bd-82b4e5a24445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86272fcae4d248afbaf149d9764e04bc)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:56.962283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05607fa9-1d3a-42a6-91bd-82b4e5a24445 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:56.997627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-2f3d7ffa-a1d8-4b15-9509-43354f003bd2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:56.999163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2f3d7ffa-a1d8-4b15-9509-43354f003bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:57.007955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 877/1769] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:57.013833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d7ffa-a1d8-4b15-9509-43354f003bd2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:57.013833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2f3d7ffa-a1d8-4b15-9509-43354f003bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:57.022029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d7ffa-a1d8-4b15-9509-43354f003bd2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:57.026639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:57.027275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:57.027549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:57.027816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] PATH_INFO: `/v3/users/78648d8656f8460c8de19924768f3a5f` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:57.028910 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78648d8656f8460c8de19924768f3a5f)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:57.031108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:57.296454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-05607fa9-1d3a-42a6-91bd-82b4e5a24445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86272fcae4d248afbaf149d9764e04bc'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:57.310118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-05607fa9-1d3a-42a6-91bd-82b4e5a24445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86272fcae4d248afbaf149d9764e04bc'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:57.314870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:57.317693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-05607fa9-1d3a-42a6-91bd-82b4e5a24445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86272fcae4d248afbaf149d9764e04bc'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:57.318461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-05607fa9-1d3a-42a6-91bd-82b4e5a24445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86272fcae4d248afbaf149d9764e04bc'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:57.319087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-05607fa9-1d3a-42a6-91bd-82b4e5a24445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86272fcae4d248afbaf149d9764e04bc'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:57.390742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78648d8656f8460c8de19924768f3a5f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:57.403765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 893/1770] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:56 2022] DELETE /identity/v3/users/86272fcae4d248afbaf149d9764e04bc => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:57.403765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123c70-5f87-451f-8fe0-ba3e5bdbc756 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:57.403765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123c70-5f87-451f-8fe0-ba3e5bdbc756 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:57.403765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123c70-5f87-451f-8fe0-ba3e5bdbc756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:57.426072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-2e123c70-5f87-451f-8fe0-ba3e5bdbc756 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:57.427348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2e123c70-5f87-451f-8fe0-ba3e5bdbc756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:57.500633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78648d8656f8460c8de19924768f3a5f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:57.504764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 894/1771] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:57.508085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e101ce-5d2e-4b55-917b-7d70ac51342c None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:57.508085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e101ce-5d2e-4b55-917b-7d70ac51342c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:57.508085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e101ce-5d2e-4b55-917b-7d70ac51342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:57.512725 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78648d8656f8460c8de19924768f3a5f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:57.513521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78648d8656f8460c8de19924768f3a5f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:57.528945 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78648d8656f8460c8de19924768f3a5f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:57.529146 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a0e101ce-5d2e-4b55-917b-7d70ac51342c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:57.530211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a0e101ce-5d2e-4b55-917b-7d70ac51342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:57.540039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 878/1772] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:57 2022] DELETE /identity/v3/users/78648d8656f8460c8de19924768f3a5f => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:57.540039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:57.540039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:57.544990 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 895/1773] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:57.564793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e101ce-5d2e-4b55-917b-7d70ac51342c None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:57.566774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a0e101ce-5d2e-4b55-917b-7d70ac51342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:57.576636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:57.624664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d572e-afa5-4bbe-a0c3-f1971253ed63 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:57.631991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d02683-df61-4e0c-a000-b37059d65b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:57.632979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d02683-df61-4e0c-a000-b37059d65b7a admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:57.633273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d02683-df61-4e0c-a000-b37059d65b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:57.633661 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d02683-df61-4e0c-a000-b37059d65b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:57.634675 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d02683-df61-4e0c-a000-b37059d65b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:57.635141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d02683-df61-4e0c-a000-b37059d65b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:57.638217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d02683-df61-4e0c-a000-b37059d65b7a admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:57.656190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 879/1774] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:57.661128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d02683-df61-4e0c-a000-b37059d65b7a admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:57.673268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e101ce-5d2e-4b55-917b-7d70ac51342c None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:57.675283 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d02683-df61-4e0c-a000-b37059d65b7a admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:57.682680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f070f72-8f7a-4bcb-b324-e85541a7c718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:57.684219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f070f72-8f7a-4bcb-b324-e85541a7c718 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:57.684513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f070f72-8f7a-4bcb-b324-e85541a7c718 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:57.685205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f070f72-8f7a-4bcb-b324-e85541a7c718 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:57.685594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f070f72-8f7a-4bcb-b324-e85541a7c718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:57.687676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f070f72-8f7a-4bcb-b324-e85541a7c718 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:57.779345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80042800-b59f-447c-bcf0-432fe5f1f8c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:57.780377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80042800-b59f-447c-bcf0-432fe5f1f8c9 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:57.780665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80042800-b59f-447c-bcf0-432fe5f1f8c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:57.781008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80042800-b59f-447c-bcf0-432fe5f1f8c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:57.787364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 880/1775] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:57 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:56:57.793517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f070f72-8f7a-4bcb-b324-e85541a7c718 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:57.796165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80042800-b59f-447c-bcf0-432fe5f1f8c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:57.798122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80042800-b59f-447c-bcf0-432fe5f1f8c9 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:57.812982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 896/1776] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:56:57.880256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f070f72-8f7a-4bcb-b324-e85541a7c718 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:57.885459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b45d06-351b-4e7f-ace9-96bcff161984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:57.886081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45d06-351b-4e7f-ace9-96bcff161984 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:57.886345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45d06-351b-4e7f-ace9-96bcff161984 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:57.886918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45d06-351b-4e7f-ace9-96bcff161984 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:57.887276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b45d06-351b-4e7f-ace9-96bcff161984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:57.889309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b45d06-351b-4e7f-ace9-96bcff161984 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:58.006587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:58.018355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 881/1777] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:57 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:58.022893 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80042800-b59f-447c-bcf0-432fe5f1f8c9 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:58.032408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80042800-b59f-447c-bcf0-432fe5f1f8c9 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:58.037589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773b1c8-75c5-436c-bf31-4b1974068fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:58.038186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773b1c8-75c5-436c-bf31-4b1974068fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.038461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773b1c8-75c5-436c-bf31-4b1974068fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.038734 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773b1c8-75c5-436c-bf31-4b1974068fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.039428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773b1c8-75c5-436c-bf31-4b1974068fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:58.041070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773b1c8-75c5-436c-bf31-4b1974068fb7 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:58.051291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 897/1778] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:58.055443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b45d06-351b-4e7f-ace9-96bcff161984 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:58.065413 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b45d06-351b-4e7f-ace9-96bcff161984 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:58.070560 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2f0f7-f093-4418-9703-67bb16a5c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:58.071199 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2f0f7-f093-4418-9703-67bb16a5c12e admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.071475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2f0f7-f093-4418-9703-67bb16a5c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.071748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2f0f7-f093-4418-9703-67bb16a5c12e admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.072386 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2f0f7-f093-4418-9703-67bb16a5c12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:58.073969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2f0f7-f093-4418-9703-67bb16a5c12e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:58.085520 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 882/1779] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:58.090144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773b1c8-75c5-436c-bf31-4b1974068fb7 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:58.106770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773b1c8-75c5-436c-bf31-4b1974068fb7 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:58.149076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c064d5-556e-4403-8a86-87f0bc8de01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:58.149076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c064d5-556e-4403-8a86-87f0bc8de01d admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.149076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c064d5-556e-4403-8a86-87f0bc8de01d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.149076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c064d5-556e-4403-8a86-87f0bc8de01d admin admin] PATH_INFO: `/v3/projects/667e5c676da940d3b3507cac4759a772/users/653ccf51c0fe4292b9fbe73836cbdd15/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.149378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c064d5-556e-4403-8a86-87f0bc8de01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=667e5c676da940d3b3507cac4759a772, user_id=653ccf51c0fe4292b9fbe73836cbdd15, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:58.149378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c064d5-556e-4403-8a86-87f0bc8de01d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:58.151745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2f0f7-f093-4418-9703-67bb16a5c12e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:58.163493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e0b2f0f7-f093-4418-9703-67bb16a5c12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:58.187319 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2f0f7-f093-4418-9703-67bb16a5c12e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:58.192876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:58.193729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.194470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.194944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] PATH_INFO: `/v3/projects/564387840e8b404592092e3c6aa2c3d9` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.196145 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=564387840e8b404592092e3c6aa2c3d9)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:58.198086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:58.230733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 898/1780] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:58 2022] PUT /identity/v3/projects/667e5c676da940d3b3507cac4759a772/users/653ccf51c0fe4292b9fbe73836cbdd15/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:58.244109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb926333-f0c4-44a9-b0d5-ce6b4071b177 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.244575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb926333-f0c4-44a9-b0d5-ce6b4071b177 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.244938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb926333-f0c4-44a9-b0d5-ce6b4071b177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.287870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-bb926333-f0c4-44a9-b0d5-ce6b4071b177 None None] MFA Rules not processed for user `653ccf51c0fe4292b9fbe73836cbdd15`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:58.289244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bb926333-f0c4-44a9-b0d5-ce6b4071b177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:58.347032 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '564387840e8b404592092e3c6aa2c3d9', 'request_id': 'req-d528deb4-eb86-4e84-ab92-33315b85ee3a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:58.352857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '564387840e8b404592092e3c6aa2c3d9', 'request_id': 'req-d528deb4-eb86-4e84-ab92-33315b85ee3a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:58.360670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '564387840e8b404592092e3c6aa2c3d9', 'request_id': 'req-d528deb4-eb86-4e84-ab92-33315b85ee3a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:58.368651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 899/1781] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:56:58.378062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb926333-f0c4-44a9-b0d5-ce6b4071b177 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:58.444639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb926333-f0c4-44a9-b0d5-ce6b4071b177 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:58.461134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] The token cache is being invalidate because project 564387840e8b404592092e3c6aa2c3d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:56:58.461649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:58.462481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:58.464339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 883/1782] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:56:58 2022] DELETE /identity/v3/projects/564387840e8b404592092e3c6aa2c3d9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:56:58.465208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:58.467863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:58.532801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2c438-4dab-4dea-a2cb-d083fab5934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:58.533354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2c438-4dab-4dea-a2cb-d083fab5934c admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.533636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2c438-4dab-4dea-a2cb-d083fab5934c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.534054 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2c438-4dab-4dea-a2cb-d083fab5934c admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.534731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2c438-4dab-4dea-a2cb-d083fab5934c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:58.536936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2c438-4dab-4dea-a2cb-d083fab5934c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:58.547428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528deb4-eb86-4e84-ab92-33315b85ee3a admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:58.553150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:58.553410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.553589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.553863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d admin admin] PATH_INFO: `/v3/projects/fd09993292d244ce978a62eb70250857` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.555094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd09993292d244ce978a62eb70250857)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:58.557004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:58.642294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 900/1783] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:58 2022] POST /identity/v3/projects => generated 383 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:56:58.642294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458720bf-32a0-4085-ae55-fbb320027a29 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.642294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458720bf-32a0-4085-ae55-fbb320027a29 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.642294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458720bf-32a0-4085-ae55-fbb320027a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.665320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-458720bf-32a0-4085-ae55-fbb320027a29 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:58.666539 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-458720bf-32a0-4085-ae55-fbb320027a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:58.689972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd09993292d244ce978a62eb70250857', 'request_id': 'req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:58.696200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd09993292d244ce978a62eb70250857', 'request_id': 'req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:58.702526 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd09993292d244ce978a62eb70250857', 'request_id': 'req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:58.726895 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 901/1784] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:58.727763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458720bf-32a0-4085-ae55-fbb320027a29 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:58.728980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-458720bf-32a0-4085-ae55-fbb320027a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:58.742610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458720bf-32a0-4085-ae55-fbb320027a29 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:58.787900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d admin admin] The token cache is being invalidate because project fd09993292d244ce978a62eb70250857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:56:58.788113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:58.788754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b75cf3e9-bedb-4d73-af9e-8bc8715ca03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:58.790273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 884/1785] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:56:58 2022] DELETE /identity/v3/projects/fd09993292d244ce978a62eb70250857 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:58.793214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e4c7-dc84-477b-878a-64993fb209e7 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.793214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e4c7-dc84-477b-878a-64993fb209e7 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.793214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e4c7-dc84-477b-878a-64993fb209e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.803183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce093559-b736-4f58-a3d0-50767628930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:58.803807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce093559-b736-4f58-a3d0-50767628930c admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.804120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce093559-b736-4f58-a3d0-50767628930c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.804401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce093559-b736-4f58-a3d0-50767628930c admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.805039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce093559-b736-4f58-a3d0-50767628930c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:58.807085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce093559-b736-4f58-a3d0-50767628930c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:58.812727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5ae0e4c7-dc84-477b-878a-64993fb209e7 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:56:58.814069 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5ae0e4c7-dc84-477b-878a-64993fb209e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:58.824640 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 885/1786] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:56:58.825067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0e4c7-dc84-477b-878a-64993fb209e7 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:58.826317 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5ae0e4c7-dc84-477b-878a-64993fb209e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:58.839137 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0e4c7-dc84-477b-878a-64993fb209e7 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:58.843976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:58.844602 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.844880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.845180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] PATH_INFO: `/v3/users/98f0b4b5d53a4f72a1f1e7a378145ade` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.846366 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f0b4b5d53a4f72a1f1e7a378145ade)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:58.848908 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:58.900970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 902/1787] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:58 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:58.900970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce093559-b736-4f58-a3d0-50767628930c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:58.909300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce093559-b736-4f58-a3d0-50767628930c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:58.914425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe46b4-252d-44f2-84a0-ad97c856b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:58.915061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe46b4-252d-44f2-84a0-ad97c856b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.915348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe46b4-252d-44f2-84a0-ad97c856b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.915618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe46b4-252d-44f2-84a0-ad97c856b9eb admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.916260 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe46b4-252d-44f2-84a0-ad97c856b9eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:56:58.916561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe46b4-252d-44f2-84a0-ad97c856b9eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:58.918156 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe46b4-252d-44f2-84a0-ad97c856b9eb admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:58.935517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 903/1788] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:56:58.935517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe46b4-252d-44f2-84a0-ad97c856b9eb admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:58.935517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-50fe46b4-252d-44f2-84a0-ad97c856b9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:58.947758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe46b4-252d-44f2-84a0-ad97c856b9eb admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:58.953293 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94c89f-bbe6-4387-aa61-1df3ea2c961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:58.953909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94c89f-bbe6-4387-aa61-1df3ea2c961e admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.954186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94c89f-bbe6-4387-aa61-1df3ea2c961e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.954456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94c89f-bbe6-4387-aa61-1df3ea2c961e admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.955187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94c89f-bbe6-4387-aa61-1df3ea2c961e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:58.956919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94c89f-bbe6-4387-aa61-1df3ea2c961e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:58.967707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 904/1789] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:58.968520 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94c89f-bbe6-4387-aa61-1df3ea2c961e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:58.981495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94c89f-bbe6-4387-aa61-1df3ea2c961e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:58.988784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac35a9-3e79-49f0-951d-1b87bd5e0168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:58.989484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac35a9-3e79-49f0-951d-1b87bd5e0168 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:58.989916 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac35a9-3e79-49f0-951d-1b87bd5e0168 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:58.990204 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac35a9-3e79-49f0-951d-1b87bd5e0168 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:58.990930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac35a9-3e79-49f0-951d-1b87bd5e0168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:58.993903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac35a9-3e79-49f0-951d-1b87bd5e0168 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:59.092037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f0b4b5d53a4f72a1f1e7a378145ade'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:59.154285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 905/1790] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:56:58 2022] POST /identity/v3/projects => generated 363 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:59.155686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac35a9-3e79-49f0-951d-1b87bd5e0168 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:59.174753 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f0b4b5d53a4f72a1f1e7a378145ade'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:59.183433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f0b4b5d53a4f72a1f1e7a378145ade'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:59.184170 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f0b4b5d53a4f72a1f1e7a378145ade'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:59.199097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f0b4b5d53a4f72a1f1e7a378145ade'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:59.208756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 886/1791] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:58 2022] DELETE /identity/v3/users/98f0b4b5d53a4f72a1f1e7a378145ade => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:59.208756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:59.208756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:59.238859 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac35a9-3e79-49f0-951d-1b87bd5e0168 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:59.283450 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c81489-8113-42f9-9682-f57162aac164 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:59.289111 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb66e4-d03a-4f50-9b04-51703aff45df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:59.289811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb66e4-d03a-4f50-9b04-51703aff45df admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:59.290173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb66e4-d03a-4f50-9b04-51703aff45df admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:59.290594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb66e4-d03a-4f50-9b04-51703aff45df admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:59.291785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb66e4-d03a-4f50-9b04-51703aff45df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:59.294015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb66e4-d03a-4f50-9b04-51703aff45df admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:59.312186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531490a-93b5-4fb9-84f1-ac65546e0a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:59.312954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531490a-93b5-4fb9-84f1-ac65546e0a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:59.313413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531490a-93b5-4fb9-84f1-ac65546e0a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:59.313696 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531490a-93b5-4fb9-84f1-ac65546e0a76 admin admin] PATH_INFO: `/v3/projects/1657c0a9b2154aa3968cdc569cb3ff59/users/1c629207015b46fd81c411a211e18560/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:59.329913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531490a-93b5-4fb9-84f1-ac65546e0a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1657c0a9b2154aa3968cdc569cb3ff59, user_id=1c629207015b46fd81c411a211e18560, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:59.332649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531490a-93b5-4fb9-84f1-ac65546e0a76 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:59.407981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 887/1792] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:56:59 2022] POST /identity/v3/users => generated 282 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:56:59.409295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb66e4-d03a-4f50-9b04-51703aff45df admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:59.409603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 906/1793] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:59 2022] PUT /identity/v3/projects/1657c0a9b2154aa3968cdc569cb3ff59/users/1c629207015b46fd81c411a211e18560/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:59.410613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531490a-93b5-4fb9-84f1-ac65546e0a76 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:59.412845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-cabb66e4-d03a-4f50-9b04-51703aff45df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:59.433391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb66e4-d03a-4f50-9b04-51703aff45df admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:59.520384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7e0aa-4335-4c02-bf98-213202ec5d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:59.522786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7e0aa-4335-4c02-bf98-213202ec5d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:59.527238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7e0aa-4335-4c02-bf98-213202ec5d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:59.528022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7e0aa-4335-4c02-bf98-213202ec5d22 admin admin] PATH_INFO: `/v3/users/1c64c25aec9e4248ac0add674d0dd1d2` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:59.530323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7e0aa-4335-4c02-bf98-213202ec5d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c64c25aec9e4248ac0add674d0dd1d2)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:59.536046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7e0aa-4335-4c02-bf98-213202ec5d22 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:59.543061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531490a-93b5-4fb9-84f1-ac65546e0a76 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:59.555716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42197997-920b-4ce0-8c1a-a66087b42526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:59.557145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42197997-920b-4ce0-8c1a-a66087b42526 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:59.557700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42197997-920b-4ce0-8c1a-a66087b42526 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:59.558397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42197997-920b-4ce0-8c1a-a66087b42526 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:59.559756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42197997-920b-4ce0-8c1a-a66087b42526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:59.569042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42197997-920b-4ce0-8c1a-a66087b42526 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:59.579036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 907/1794] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:59.580509 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42197997-920b-4ce0-8c1a-a66087b42526 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:59.582470 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-42197997-920b-4ce0-8c1a-a66087b42526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:56:59.598457 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42197997-920b-4ce0-8c1a-a66087b42526 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:59.606667 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f6225-601c-4eb9-83c4-5d87cc585fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:59.607835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f6225-601c-4eb9-83c4-5d87cc585fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:59.609129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f6225-601c-4eb9-83c4-5d87cc585fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:59.609584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f6225-601c-4eb9-83c4-5d87cc585fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:59.610737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f6225-601c-4eb9-83c4-5d87cc585fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:59.612631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f6225-601c-4eb9-83c4-5d87cc585fc9 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:59.625901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 908/1795] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:59.627186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f6225-601c-4eb9-83c4-5d87cc585fc9 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:59.642223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f6225-601c-4eb9-83c4-5d87cc585fc9 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:59.657113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f009-c74a-4414-9ef8-91909cc79cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:59.664705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f009-c74a-4414-9ef8-91909cc79cdf admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:59.664705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f009-c74a-4414-9ef8-91909cc79cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:59.664705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f009-c74a-4414-9ef8-91909cc79cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:59.664705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601f009-c74a-4414-9ef8-91909cc79cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:59.664705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601f009-c74a-4414-9ef8-91909cc79cdf admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:59.676834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 909/1796] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:56:59.677799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f009-c74a-4414-9ef8-91909cc79cdf admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:59.690067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f009-c74a-4414-9ef8-91909cc79cdf admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:59.696289 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045615e-cb6c-4714-b469-bc099dc08737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:59.697281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045615e-cb6c-4714-b469-bc099dc08737 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:59.697573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045615e-cb6c-4714-b469-bc099dc08737 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:59.697951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045615e-cb6c-4714-b469-bc099dc08737 admin admin] PATH_INFO: `/v3/projects/1657c0a9b2154aa3968cdc569cb3ff59/users/1c629207015b46fd81c411a211e18560/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:59.700173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045615e-cb6c-4714-b469-bc099dc08737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1657c0a9b2154aa3968cdc569cb3ff59, user_id=1c629207015b46fd81c411a211e18560, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:59.702953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045615e-cb6c-4714-b469-bc099dc08737 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:59.715079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 910/1797] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:59 2022] PUT /identity/v3/projects/1657c0a9b2154aa3968cdc569cb3ff59/users/1c629207015b46fd81c411a211e18560/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:59.725149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045615e-cb6c-4714-b469-bc099dc08737 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:59.807617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3ff7e0aa-4335-4c02-bf98-213202ec5d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c64c25aec9e4248ac0add674d0dd1d2'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:59.819488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045615e-cb6c-4714-b469-bc099dc08737 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:56:59.827103 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca5ad-0d84-4997-bc82-07767e70fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:56:59.827721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca5ad-0d84-4997-bc82-07767e70fc99 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:59.828135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca5ad-0d84-4997-bc82-07767e70fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:59.828419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca5ad-0d84-4997-bc82-07767e70fc99 admin admin] PATH_INFO: `/v3/projects/ff58569d3d00482da2033b1607049c05/users/9dd1bfe2e942442890b7c059d048ea55/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:59.846038 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ca5ad-0d84-4997-bc82-07767e70fc99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff58569d3d00482da2033b1607049c05, user_id=9dd1bfe2e942442890b7c059d048ea55, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:56:59.849469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ca5ad-0d84-4997-bc82-07767e70fc99 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:56:59.885634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3ff7e0aa-4335-4c02-bf98-213202ec5d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c64c25aec9e4248ac0add674d0dd1d2'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:59.895733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3ff7e0aa-4335-4c02-bf98-213202ec5d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c64c25aec9e4248ac0add674d0dd1d2'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:59.896655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3ff7e0aa-4335-4c02-bf98-213202ec5d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c64c25aec9e4248ac0add674d0dd1d2'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:59.918680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3ff7e0aa-4335-4c02-bf98-213202ec5d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c64c25aec9e4248ac0add674d0dd1d2'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:56:59.930928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 888/1798] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:56:59 2022] DELETE /identity/v3/users/1c64c25aec9e4248ac0add674d0dd1d2 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:59.933548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6039d5-82fe-4d7a-b5b7-e6d80cb75bc0 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:56:59.934323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6039d5-82fe-4d7a-b5b7-e6d80cb75bc0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:56:59.934774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6039d5-82fe-4d7a-b5b7-e6d80cb75bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:56:59.974996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 911/1799] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:56:59 2022] PUT /identity/v3/projects/ff58569d3d00482da2033b1607049c05/users/9dd1bfe2e942442890b7c059d048ea55/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:56:59.974996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca5ad-0d84-4997-bc82-07767e70fc99 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:56:59.974996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-126ca5ad-0d84-4997-bc82-07767e70fc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:00.000620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-dd6039d5-82fe-4d7a-b5b7-e6d80cb75bc0 None None] MFA Rules not processed for user `1c629207015b46fd81c411a211e18560`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:00.001850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-dd6039d5-82fe-4d7a-b5b7-e6d80cb75bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:00.091982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca5ad-0d84-4997-bc82-07767e70fc99 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:00.102632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:00.103462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:00.103841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:00.104212 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] PATH_INFO: `/v3/projects/5880890d56704cc7986a635b697046cd` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:00.105501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5880890d56704cc7986a635b697046cd)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:00.107786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:00.141390 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 889/1800] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:56:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:00.143478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69da943-1650-49ed-ace0-75afabf5bb96 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:00.144823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69da943-1650-49ed-ace0-75afabf5bb96 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:00.145272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69da943-1650-49ed-ace0-75afabf5bb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:00.172181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-c69da943-1650-49ed-ace0-75afabf5bb96 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:00.173710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c69da943-1650-49ed-ace0-75afabf5bb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:00.190052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 890/1801] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:00.191559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b6a2-9e26-4014-a856-1642b6642a89 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:00.191850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b6a2-9e26-4014-a856-1642b6642a89 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:00.192529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b6a2-9e26-4014-a856-1642b6642a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:00.236019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-1aa3b6a2-9e26-4014-a856-1642b6642a89 None None] MFA Rules not processed for user `9dd1bfe2e942442890b7c059d048ea55`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:00.239943 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1aa3b6a2-9e26-4014-a856-1642b6642a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:00.241085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:00.264111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5880890d56704cc7986a635b697046cd', 'request_id': 'req-5c509593-a58e-4dc1-8cd4-31b9803d938e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:00.273367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5880890d56704cc7986a635b697046cd', 'request_id': 'req-5c509593-a58e-4dc1-8cd4-31b9803d938e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:00.346087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 891/1802] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:00.347226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b6a2-9e26-4014-a856-1642b6642a89 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:00.352680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1aa3b6a2-9e26-4014-a856-1642b6642a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:00.411318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b6a2-9e26-4014-a856-1642b6642a89 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:00.416080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc90ffa-e5b3-4d43-8d35-e3ee5b7cc04e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:00.416715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc90ffa-e5b3-4d43-8d35-e3ee5b7cc04e service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:00.417061 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc90ffa-e5b3-4d43-8d35-e3ee5b7cc04e service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:00.417327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc90ffa-e5b3-4d43-8d35-e3ee5b7cc04e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:00.418459 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5880890d56704cc7986a635b697046cd', 'request_id': 'req-5c509593-a58e-4dc1-8cd4-31b9803d938e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:00.439517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] The token cache is being invalidate because project 5880890d56704cc7986a635b697046cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:00.440456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:00.442060 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:00.464784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 912/1803] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:56:59 2022] DELETE /identity/v3/projects/5880890d56704cc7986a635b697046cd => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:00.466669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:00.469738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:00.543076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc90ffa-e5b3-4d43-8d35-e3ee5b7cc04e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:00.546731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc90ffa-e5b3-4d43-8d35-e3ee5b7cc04e service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:00.559535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 892/1804] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:00.560490 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc90ffa-e5b3-4d43-8d35-e3ee5b7cc04e service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:00.562061 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9dc90ffa-e5b3-4d43-8d35-e3ee5b7cc04e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:00.590763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c509593-a58e-4dc1-8cd4-31b9803d938e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:00.594800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2117-812c-4016-b231-e6aac256ff47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:00.595467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2117-812c-4016-b231-e6aac256ff47 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:00.595749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2117-812c-4016-b231-e6aac256ff47 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:00.596023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2117-812c-4016-b231-e6aac256ff47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:00.600111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-510b2117-812c-4016-b231-e6aac256ff47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:00.676694 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc90ffa-e5b3-4d43-8d35-e3ee5b7cc04e service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:00.689184 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3ce3e-87fc-4611-ade4-f7a6812642cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:00.690009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ce3e-87fc-4611-ade4-f7a6812642cd admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:00.691429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ce3e-87fc-4611-ade4-f7a6812642cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:00.691429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ce3e-87fc-4611-ade4-f7a6812642cd admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:00.691778 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3ce3e-87fc-4611-ade4-f7a6812642cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:00.704857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3ce3e-87fc-4611-ade4-f7a6812642cd admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:00.743359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:00.749368 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2117-812c-4016-b231-e6aac256ff47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:00.758778 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2117-812c-4016-b231-e6aac256ff47 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:00.775119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 913/1805] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:00.776895 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3d133-db7a-45b5-9b89-7ed345a48efa None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:00.777160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3d133-db7a-45b5-9b89-7ed345a48efa None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:00.777500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3d133-db7a-45b5-9b89-7ed345a48efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:00.808320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a4b3d133-db7a-45b5-9b89-7ed345a48efa None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:00.809720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a4b3d133-db7a-45b5-9b89-7ed345a48efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:00.823988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 914/1806] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:00.825070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3d133-db7a-45b5-9b89-7ed345a48efa None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:00.833547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a4b3d133-db7a-45b5-9b89-7ed345a48efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:00.843073 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 893/1807] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:00 2022] POST /identity/v3/projects => generated 363 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:00.845468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d548be-0871-48a4-98c8-976705d2e51b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:00.846855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d548be-0871-48a4-98c8-976705d2e51b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:00.847349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d548be-0871-48a4-98c8-976705d2e51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:00.860447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3d133-db7a-45b5-9b89-7ed345a48efa None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:00.891655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-56d548be-0871-48a4-98c8-976705d2e51b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:00.893196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-56d548be-0871-48a4-98c8-976705d2e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:00.936604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8bc33-ee2f-49a5-822e-414c5f7125f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:00.937142 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8bc33-ee2f-49a5-822e-414c5f7125f4 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:00.937502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8bc33-ee2f-49a5-822e-414c5f7125f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:00.937777 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8bc33-ee2f-49a5-822e-414c5f7125f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:00.939752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9bc8bc33-ee2f-49a5-822e-414c5f7125f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:01.017904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8bc33-ee2f-49a5-822e-414c5f7125f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:01.017904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8bc33-ee2f-49a5-822e-414c5f7125f4 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:01.019307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 894/1808] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:01.020349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d548be-0871-48a4-98c8-976705d2e51b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:01.022906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-56d548be-0871-48a4-98c8-976705d2e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:01.031090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 915/1809] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:01.032095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8bc33-ee2f-49a5-822e-414c5f7125f4 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:01.039738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d548be-0871-48a4-98c8-976705d2e51b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:01.046821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61699b23-9a1e-44fe-a716-eda6666a7ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:01.047611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61699b23-9a1e-44fe-a716-eda6666a7ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:01.047994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61699b23-9a1e-44fe-a716-eda6666a7ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:01.048570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61699b23-9a1e-44fe-a716-eda6666a7ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:01.049310 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8bc33-ee2f-49a5-822e-414c5f7125f4 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:01.049898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61699b23-9a1e-44fe-a716-eda6666a7ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:01.052914 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61699b23-9a1e-44fe-a716-eda6666a7ef8 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:01.056057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b8c5c-6bd8-4d3c-919b-f378ced835db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:01.056682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b8c5c-6bd8-4d3c-919b-f378ced835db admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:01.056956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b8c5c-6bd8-4d3c-919b-f378ced835db admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:01.057294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b8c5c-6bd8-4d3c-919b-f378ced835db admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:01.058154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b8c5c-6bd8-4d3c-919b-f378ced835db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:01.058452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b8c5c-6bd8-4d3c-919b-f378ced835db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:01.060401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b8c5c-6bd8-4d3c-919b-f378ced835db admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:01.083531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 916/1810] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:57:01.088285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b8c5c-6bd8-4d3c-919b-f378ced835db admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:01.102012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b8c5c-6bd8-4d3c-919b-f378ced835db admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:01.110032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f335ea-bb7f-4f11-b297-fc63227e172b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:01.110032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f335ea-bb7f-4f11-b297-fc63227e172b admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:01.110032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f335ea-bb7f-4f11-b297-fc63227e172b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:01.110032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f335ea-bb7f-4f11-b297-fc63227e172b admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:01.110538 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f335ea-bb7f-4f11-b297-fc63227e172b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:01.111883 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f335ea-bb7f-4f11-b297-fc63227e172b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:01.190768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 895/1811] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:01 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:01.192775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61699b23-9a1e-44fe-a716-eda6666a7ef8 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:01.223199 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 917/1812] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:01 2022] POST /identity/v3/projects => generated 361 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:01.231382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f335ea-bb7f-4f11-b297-fc63227e172b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:01.232668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61699b23-9a1e-44fe-a716-eda6666a7ef8 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:01.370711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f335ea-bb7f-4f11-b297-fc63227e172b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:01.372045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a001258-4b4d-4ab7-9cf6-35c6bfbe8e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:01.372678 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a001258-4b4d-4ab7-9cf6-35c6bfbe8e24 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:01.373058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a001258-4b4d-4ab7-9cf6-35c6bfbe8e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:01.373336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a001258-4b4d-4ab7-9cf6-35c6bfbe8e24 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:01.374132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a001258-4b4d-4ab7-9cf6-35c6bfbe8e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:01.376240 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a001258-4b4d-4ab7-9cf6-35c6bfbe8e24 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:01.379218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72bbf0-ee07-4224-a650-d0d240c57dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:01.380566 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72bbf0-ee07-4224-a650-d0d240c57dda admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:01.380995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72bbf0-ee07-4224-a650-d0d240c57dda admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:01.381801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72bbf0-ee07-4224-a650-d0d240c57dda admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:01.382540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72bbf0-ee07-4224-a650-d0d240c57dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:01.384528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72bbf0-ee07-4224-a650-d0d240c57dda admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:01.405178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 896/1813] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:01.406710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72bbf0-ee07-4224-a650-d0d240c57dda admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:01.417501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72bbf0-ee07-4224-a650-d0d240c57dda admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:01.422204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02901b-1404-4dd5-93e6-f26a984c9b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:01.423061 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02901b-1404-4dd5-93e6-f26a984c9b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:01.423342 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02901b-1404-4dd5-93e6-f26a984c9b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:01.423617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02901b-1404-4dd5-93e6-f26a984c9b1f admin admin] PATH_INFO: `/v3/projects/1cf965fd2aa44adba7fb13beea253469/users/a2f6c04d6e414cd0a1368a488a112f94/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:01.441720 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02901b-1404-4dd5-93e6-f26a984c9b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf965fd2aa44adba7fb13beea253469, user_id=a2f6c04d6e414cd0a1368a488a112f94, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:01.444548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02901b-1404-4dd5-93e6-f26a984c9b1f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:01.485862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 918/1814] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:01 2022] POST /identity/v3/users => generated 281 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:01.487268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a001258-4b4d-4ab7-9cf6-35c6bfbe8e24 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:01.505197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a001258-4b4d-4ab7-9cf6-35c6bfbe8e24 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:01.506257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587302c-19da-4b92-a70d-7952545f9bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:01.506899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587302c-19da-4b92-a70d-7952545f9bdd admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:01.507184 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587302c-19da-4b92-a70d-7952545f9bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:01.507458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587302c-19da-4b92-a70d-7952545f9bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:01.508111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587302c-19da-4b92-a70d-7952545f9bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:01.509707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587302c-19da-4b92-a70d-7952545f9bdd admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:01.523858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 919/1815] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:01.524809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587302c-19da-4b92-a70d-7952545f9bdd admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:01.537058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587302c-19da-4b92-a70d-7952545f9bdd admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:01.541956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3b097-7c8e-42bd-8625-ceb546bc7f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:01.542559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3b097-7c8e-42bd-8625-ceb546bc7f48 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:01.542843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3b097-7c8e-42bd-8625-ceb546bc7f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:01.543234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3b097-7c8e-42bd-8625-ceb546bc7f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:01.543878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3b097-7c8e-42bd-8625-ceb546bc7f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:01.545468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3b097-7c8e-42bd-8625-ceb546bc7f48 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:01.554741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 897/1816] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:01 2022] PUT /identity/v3/projects/1cf965fd2aa44adba7fb13beea253469/users/a2f6c04d6e414cd0a1368a488a112f94/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:01.559754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 920/1817] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:01.559879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02901b-1404-4dd5-93e6-f26a984c9b1f admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:01.563269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3b097-7c8e-42bd-8625-ceb546bc7f48 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:01.574420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3b097-7c8e-42bd-8625-ceb546bc7f48 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:01.625762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02901b-1404-4dd5-93e6-f26a984c9b1f admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:01.632037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c531d2-1189-4c57-ace3-d4e3521014c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:01.632661 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c531d2-1189-4c57-ace3-d4e3521014c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:01.633277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c531d2-1189-4c57-ace3-d4e3521014c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:01.633559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c531d2-1189-4c57-ace3-d4e3521014c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:01.636141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c531d2-1189-4c57-ace3-d4e3521014c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:01.637736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c531d2-1189-4c57-ace3-d4e3521014c5 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:01.662710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 898/1818] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:01.663748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c531d2-1189-4c57-ace3-d4e3521014c5 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:01.667014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-24c531d2-1189-4c57-ace3-d4e3521014c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:01.680739 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197f9a9-b7d5-4bf2-bcfb-d0b3a4a3f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:01.680739 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197f9a9-b7d5-4bf2-bcfb-d0b3a4a3f0b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:01.680739 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197f9a9-b7d5-4bf2-bcfb-d0b3a4a3f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:01.680739 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197f9a9-b7d5-4bf2-bcfb-d0b3a4a3f0b5 admin admin] PATH_INFO: `/v3/projects/52f0e727904b4d7b9b5b13df25cb3b63/users/2ad3877ec481431d9c02d0c2ffb86b7c/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:01.685239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c531d2-1189-4c57-ace3-d4e3521014c5 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:01.693074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c92976-2eaa-452b-8883-145c354a65ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:01.694359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c92976-2eaa-452b-8883-145c354a65ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:01.694359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c92976-2eaa-452b-8883-145c354a65ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:01.694541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c92976-2eaa-452b-8883-145c354a65ed admin admin] PATH_INFO: `/v3/projects/9706f6fd03c1425db24cfe9c8729a6e7` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:01.696029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c92976-2eaa-452b-8883-145c354a65ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9706f6fd03c1425db24cfe9c8729a6e7)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:01.699816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197f9a9-b7d5-4bf2-bcfb-d0b3a4a3f0b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f0e727904b4d7b9b5b13df25cb3b63, user_id=2ad3877ec481431d9c02d0c2ffb86b7c, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:01.702971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197f9a9-b7d5-4bf2-bcfb-d0b3a4a3f0b5 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:01.711882 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c92976-2eaa-452b-8883-145c354a65ed admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:01.793751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 921/1819] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:01 2022] PUT /identity/v3/projects/52f0e727904b4d7b9b5b13df25cb3b63/users/2ad3877ec481431d9c02d0c2ffb86b7c/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:01.794706 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197f9a9-b7d5-4bf2-bcfb-d0b3a4a3f0b5 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:01.866052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d1c92976-2eaa-452b-8883-145c354a65ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9706f6fd03c1425db24cfe9c8729a6e7', 'request_id': 'req-d1c92976-2eaa-452b-8883-145c354a65ed'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:01.880746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d1c92976-2eaa-452b-8883-145c354a65ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9706f6fd03c1425db24cfe9c8729a6e7', 'request_id': 'req-d1c92976-2eaa-452b-8883-145c354a65ed'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:01.898350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d1c92976-2eaa-452b-8883-145c354a65ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9706f6fd03c1425db24cfe9c8729a6e7', 'request_id': 'req-d1c92976-2eaa-452b-8883-145c354a65ed'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:01.932502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197f9a9-b7d5-4bf2-bcfb-d0b3a4a3f0b5 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:01.979439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d1c92976-2eaa-452b-8883-145c354a65ed admin admin] The token cache is being invalidate because project 9706f6fd03c1425db24cfe9c8729a6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:01.979738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d1c92976-2eaa-452b-8883-145c354a65ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:01.981379 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d1c92976-2eaa-452b-8883-145c354a65ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:01.983222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 899/1820] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:01 2022] DELETE /identity/v3/projects/9706f6fd03c1425db24cfe9c8729a6e7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:01.984449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605e77f-da7f-4dfe-8b9e-31d64718c953 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:01.984731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605e77f-da7f-4dfe-8b9e-31d64718c953 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:01.985000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605e77f-da7f-4dfe-8b9e-31d64718c953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.015137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8e44-7cf4-43ea-9304-571cfc4d4ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:02.016245 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8e44-7cf4-43ea-9304-571cfc4d4ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:02.016245 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8e44-7cf4-43ea-9304-571cfc4d4ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:02.016653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8e44-7cf4-43ea-9304-571cfc4d4ba9 admin admin] PATH_INFO: `/v3/projects/1cf965fd2aa44adba7fb13beea253469/users/a2f6c04d6e414cd0a1368a488a112f94/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.020615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8e44-7cf4-43ea-9304-571cfc4d4ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf965fd2aa44adba7fb13beea253469, user_id=a2f6c04d6e414cd0a1368a488a112f94, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:02.024917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8e44-7cf4-43ea-9304-571cfc4d4ba9 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:02.038690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8605e77f-da7f-4dfe-8b9e-31d64718c953 None None] MFA Rules not processed for user `2ad3877ec481431d9c02d0c2ffb86b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:02.040572 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8605e77f-da7f-4dfe-8b9e-31d64718c953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:02.050100 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 922/1821] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:01 2022] PUT /identity/v3/projects/1cf965fd2aa44adba7fb13beea253469/users/a2f6c04d6e414cd0a1368a488a112f94/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:02.050100 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4489a96-42ab-45ab-9f8f-ccd72e086823 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:02.050100 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4489a96-42ab-45ab-9f8f-ccd72e086823 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:02.050100 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4489a96-42ab-45ab-9f8f-ccd72e086823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.073060 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e4489a96-42ab-45ab-9f8f-ccd72e086823 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:02.074513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e4489a96-42ab-45ab-9f8f-ccd72e086823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:02.157119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 900/1822] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:02.159647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c6ab8-a94c-41d9-a63a-9f271c32c1e0 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:02.159829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c6ab8-a94c-41d9-a63a-9f271c32c1e0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:02.160088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c6ab8-a94c-41d9-a63a-9f271c32c1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.204713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 923/1823] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:02.222139 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4489a96-42ab-45ab-9f8f-ccd72e086823 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:02.222139 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e4489a96-42ab-45ab-9f8f-ccd72e086823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:02.222867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-cd6c6ab8-a94c-41d9-a63a-9f271c32c1e0 None None] MFA Rules not processed for user `a2f6c04d6e414cd0a1368a488a112f94`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:02.222867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-cd6c6ab8-a94c-41d9-a63a-9f271c32c1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:02.301328 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4489a96-42ab-45ab-9f8f-ccd72e086823 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:02.310707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d9d1e-55c2-4bdc-9441-a368a72f598b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:02.312021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d9d1e-55c2-4bdc-9441-a368a72f598b service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:02.312752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d9d1e-55c2-4bdc-9441-a368a72f598b service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:02.313116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d9d1e-55c2-4bdc-9441-a368a72f598b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.326311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d9d1e-55c2-4bdc-9441-a368a72f598b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:02.327988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d9d1e-55c2-4bdc-9441-a368a72f598b service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:02.346654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 924/1824] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:02.346654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa5d6-d124-4aa3-a4b3-d0e90030677b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:02.346654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa5d6-d124-4aa3-a4b3-d0e90030677b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:02.346654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa5d6-d124-4aa3-a4b3-d0e90030677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.348971 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 901/1825] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:02.367330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c6ab8-a94c-41d9-a63a-9f271c32c1e0 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:02.369573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-cd6c6ab8-a94c-41d9-a63a-9f271c32c1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:02.387071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-c5cfa5d6-d124-4aa3-a4b3-d0e90030677b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:02.387071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c5cfa5d6-d124-4aa3-a4b3-d0e90030677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:02.388729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c6ab8-a94c-41d9-a63a-9f271c32c1e0 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:02.397217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 925/1826] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:02.400678 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98b060-fbcb-4432-bcbb-33e38dab7058 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:02.400972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98b060-fbcb-4432-bcbb-33e38dab7058 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:02.401793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c7cb3-f45e-455a-9335-07af5f8b19d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:02.402371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c7cb3-f45e-455a-9335-07af5f8b19d3 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:02.402646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c7cb3-f45e-455a-9335-07af5f8b19d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:02.402937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c7cb3-f45e-455a-9335-07af5f8b19d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.403806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98b060-fbcb-4432-bcbb-33e38dab7058 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.405943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 926/1827] 10.222.0.73 () {54 vars in 921 bytes} [Mon Aug 29 23:57:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:57:02.406970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98b060-fbcb-4432-bcbb-33e38dab7058 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:02.416004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0e98b060-fbcb-4432-bcbb-33e38dab7058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:02.419305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c7cb3-f45e-455a-9335-07af5f8b19d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:02.421221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c7cb3-f45e-455a-9335-07af5f8b19d3 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:02.435461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98b060-fbcb-4432-bcbb-33e38dab7058 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:02.441068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 902/1828] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:02.441196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:02.441944 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:02.442326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:02.442611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] PATH_INFO: `/v3/users/2ad3877ec481431d9c02d0c2ffb86b7c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.443771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c7cb3-f45e-455a-9335-07af5f8b19d3 service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:02.443889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad3877ec481431d9c02d0c2ffb86b7c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:02.446269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:02.471230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c7cb3-f45e-455a-9335-07af5f8b19d3 service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:02.492208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0275a5-2644-4aa3-8a09-f0917ac6c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:02.492929 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0275a5-2644-4aa3-8a09-f0917ac6c5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:02.493287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0275a5-2644-4aa3-8a09-f0917ac6c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:02.493649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0275a5-2644-4aa3-8a09-f0917ac6c5a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.494544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0275a5-2644-4aa3-8a09-f0917ac6c5a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:02.494956 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0275a5-2644-4aa3-8a09-f0917ac6c5a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:02.496657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0275a5-2644-4aa3-8a09-f0917ac6c5a3 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:02.518327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 903/1829] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:57:02.520218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052eb307-f698-4005-ab3c-2e0eab9fb7c9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:02.520653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052eb307-f698-4005-ab3c-2e0eab9fb7c9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:02.521243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052eb307-f698-4005-ab3c-2e0eab9fb7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.543619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-052eb307-f698-4005-ab3c-2e0eab9fb7c9 None None] MFA Rules not processed for user `59a1b0b274294a288dbf07cd99f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:02.544998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-052eb307-f698-4005-ab3c-2e0eab9fb7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:02.629322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 904/1830] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Aug 29 23:57:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:02.630526 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052eb307-f698-4005-ab3c-2e0eab9fb7c9 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:02.652898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052eb307-f698-4005-ab3c-2e0eab9fb7c9 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:02.652898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e9f38-9206-43f9-ac3c-3ab9d7c249dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:02.652898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e9f38-9206-43f9-ac3c-3ab9d7c249dc admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:02.652898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e9f38-9206-43f9-ac3c-3ab9d7c249dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:02.653215 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e9f38-9206-43f9-ac3c-3ab9d7c249dc admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.653215 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e9f38-9206-43f9-ac3c-3ab9d7c249dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:02.653215 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e9f38-9206-43f9-ac3c-3ab9d7c249dc admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:02.672706 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:02.744834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad3877ec481431d9c02d0c2ffb86b7c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:02.765109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad3877ec481431d9c02d0c2ffb86b7c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:02.780769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad3877ec481431d9c02d0c2ffb86b7c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:02.781515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad3877ec481431d9c02d0c2ffb86b7c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:02.782152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad3877ec481431d9c02d0c2ffb86b7c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:02.814103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 905/1831] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:02 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:02.814103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e9f38-9206-43f9-ac3c-3ab9d7c249dc admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:02.817760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-022e9f38-9206-43f9-ac3c-3ab9d7c249dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:02.881079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 927/1832] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:02 2022] DELETE /identity/v3/users/2ad3877ec481431d9c02d0c2ffb86b7c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:02.882652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:02.884761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:02.958641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e9f38-9206-43f9-ac3c-3ab9d7c249dc admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:02.962051 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96242b45-c508-411b-815d-d327a109cc26 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:02.967359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fbb99-4f5f-42c7-90d7-30155d3f57be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:02.968062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fbb99-4f5f-42c7-90d7-30155d3f57be service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:02.968433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fbb99-4f5f-42c7-90d7-30155d3f57be service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:02.971861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fbb99-4f5f-42c7-90d7-30155d3f57be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:02.971861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-699fbb99-4f5f-42c7-90d7-30155d3f57be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:03.061812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fbb99-4f5f-42c7-90d7-30155d3f57be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:03.063387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156848b0-94f1-4271-a9c9-63d17b2c5e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:03.064176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156848b0-94f1-4271-a9c9-63d17b2c5e56 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:03.064438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fbb99-4f5f-42c7-90d7-30155d3f57be service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:03.064542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156848b0-94f1-4271-a9c9-63d17b2c5e56 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:03.064713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156848b0-94f1-4271-a9c9-63d17b2c5e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:03.066524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-156848b0-94f1-4271-a9c9-63d17b2c5e56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:03.082647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 928/1833] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:03.082839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156848b0-94f1-4271-a9c9-63d17b2c5e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:03.083772 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fbb99-4f5f-42c7-90d7-30155d3f57be service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:03.086393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156848b0-94f1-4271-a9c9-63d17b2c5e56 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:03.086527 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-699fbb99-4f5f-42c7-90d7-30155d3f57be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:03.110035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 906/1834] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:03.111532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f0b2-d304-4665-bdd1-c4c841efe8db None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:03.111817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f0b2-d304-4665-bdd1-c4c841efe8db None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:03.112847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f0b2-d304-4665-bdd1-c4c841efe8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:03.162539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5aa3f0b2-d304-4665-bdd1-c4c841efe8db None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:03.165790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5aa3f0b2-d304-4665-bdd1-c4c841efe8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:03.243460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fbb99-4f5f-42c7-90d7-30155d3f57be service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:03.262792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016022-9728-4722-a401-ac45466b6140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:03.263479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016022-9728-4722-a401-ac45466b6140 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:03.263764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016022-9728-4722-a401-ac45466b6140 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:03.264170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016022-9728-4722-a401-ac45466b6140 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:03.264861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7016022-9728-4722-a401-ac45466b6140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:03.267899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7016022-9728-4722-a401-ac45466b6140 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:03.299240 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 907/1835] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:03.315887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3f0b2-d304-4665-bdd1-c4c841efe8db None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:03.315887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5aa3f0b2-d304-4665-bdd1-c4c841efe8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:03.349448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:03.395564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3f0b2-d304-4665-bdd1-c4c841efe8db None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:03.402109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4c0b4-0cda-4944-845e-3e0a761ec345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:03.403088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4c0b4-0cda-4944-845e-3e0a761ec345 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:03.403627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4c0b4-0cda-4944-845e-3e0a761ec345 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:03.404327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4c0b4-0cda-4944-845e-3e0a761ec345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:03.417777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4c0b4-0cda-4944-845e-3e0a761ec345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:03.419582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4c0b4-0cda-4944-845e-3e0a761ec345 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:03.436495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 908/1836] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:03.464814 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 929/1837] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:03 2022] POST /identity/v3/users => generated 287 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:03.468403 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4c0b4-0cda-4944-845e-3e0a761ec345 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:03.494719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4c0b4-0cda-4944-845e-3e0a761ec345 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:03.501423 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914d997-d1ce-4293-a670-50e5da84691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:03.502231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914d997-d1ce-4293-a670-50e5da84691d admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:03.502526 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914d997-d1ce-4293-a670-50e5da84691d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:03.502798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914d997-d1ce-4293-a670-50e5da84691d admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:03.503921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914d997-d1ce-4293-a670-50e5da84691d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:03.505655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914d997-d1ce-4293-a670-50e5da84691d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:03.522180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 909/1838] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:03.526497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016022-9728-4722-a401-ac45466b6140 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:03.547709 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016022-9728-4722-a401-ac45466b6140 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:03.572789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b196c01-b4b7-4599-8a08-daf680ad9b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:03.573424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b196c01-b4b7-4599-8a08-daf680ad9b53 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:03.573702 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b196c01-b4b7-4599-8a08-daf680ad9b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:03.573971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b196c01-b4b7-4599-8a08-daf680ad9b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:03.575220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b196c01-b4b7-4599-8a08-daf680ad9b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:03.576835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b196c01-b4b7-4599-8a08-daf680ad9b53 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:03.594085 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 930/1839] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:03.595445 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914d997-d1ce-4293-a670-50e5da84691d admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:03.623327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914d997-d1ce-4293-a670-50e5da84691d admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:03.666694 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338bb3-dc56-4055-8cf3-a5cf78b14361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:03.669308 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338bb3-dc56-4055-8cf3-a5cf78b14361 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:03.672460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338bb3-dc56-4055-8cf3-a5cf78b14361 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:03.673754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338bb3-dc56-4055-8cf3-a5cf78b14361 admin admin] PATH_INFO: `/v3/projects/dea53507e9484e31a0bad1fcaa7dded6/users/e0677af87abf42f2a30b9401081dfb91/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:03.723716 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46338bb3-dc56-4055-8cf3-a5cf78b14361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea53507e9484e31a0bad1fcaa7dded6, user_id=e0677af87abf42f2a30b9401081dfb91, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:03.732918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46338bb3-dc56-4055-8cf3-a5cf78b14361 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:03.910835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 910/1840] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:03 2022] PUT /identity/v3/projects/dea53507e9484e31a0bad1fcaa7dded6/users/e0677af87abf42f2a30b9401081dfb91/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:03.921182 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50bacf-ed3f-44b0-8ba4-9bf85de48520 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:03.921676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50bacf-ed3f-44b0-8ba4-9bf85de48520 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:03.921676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50bacf-ed3f-44b0-8ba4-9bf85de48520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:03.999891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-ce50bacf-ed3f-44b0-8ba4-9bf85de48520 None None] MFA Rules not processed for user `e0677af87abf42f2a30b9401081dfb91`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:04.001276 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ce50bacf-ed3f-44b0-8ba4-9bf85de48520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:04.092106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 931/1841] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:04.096740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338bb3-dc56-4055-8cf3-a5cf78b14361 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:04.207096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338bb3-dc56-4055-8cf3-a5cf78b14361 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:04.213088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba74018-f889-464e-a48c-753de0ca8860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:04.213705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba74018-f889-464e-a48c-753de0ca8860 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:04.213984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba74018-f889-464e-a48c-753de0ca8860 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:04.214252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba74018-f889-464e-a48c-753de0ca8860 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:04.214898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba74018-f889-464e-a48c-753de0ca8860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:04.216797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba74018-f889-464e-a48c-753de0ca8860 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:04.319212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 911/1842] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:04 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:04.320202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50bacf-ed3f-44b0-8ba4-9bf85de48520 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:04.331925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50bacf-ed3f-44b0-8ba4-9bf85de48520 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:04.384142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba74018-f889-464e-a48c-753de0ca8860 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:04.386222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3ba74018-f889-464e-a48c-753de0ca8860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:04.395388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0626cfe-6cfd-4013-8098-71c7163af1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:04.396519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0626cfe-6cfd-4013-8098-71c7163af1aa admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:04.396519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0626cfe-6cfd-4013-8098-71c7163af1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:04.401750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0626cfe-6cfd-4013-8098-71c7163af1aa admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:04.402578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0626cfe-6cfd-4013-8098-71c7163af1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:04.404764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0626cfe-6cfd-4013-8098-71c7163af1aa admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:04.475248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba74018-f889-464e-a48c-753de0ca8860 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:04.480833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:04.482817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:04.482817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:04.482817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] PATH_INFO: `/v3/projects/52f0e727904b4d7b9b5b13df25cb3b63` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:04.483240 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f0e727904b4d7b9b5b13df25cb3b63)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:04.487078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:04.490683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 932/1843] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:04 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:04.491892 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0626cfe-6cfd-4013-8098-71c7163af1aa admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:04.501795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0626cfe-6cfd-4013-8098-71c7163af1aa admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:04.507329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ddd0c-b849-4c8f-8183-4db64f1f3020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:04.508009 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ddd0c-b849-4c8f-8183-4db64f1f3020 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:04.508290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ddd0c-b849-4c8f-8183-4db64f1f3020 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:04.508564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ddd0c-b849-4c8f-8183-4db64f1f3020 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:04.509318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ddd0c-b849-4c8f-8183-4db64f1f3020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:04.510973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ddd0c-b849-4c8f-8183-4db64f1f3020 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:04.520991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 933/1844] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:04.525189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ddd0c-b849-4c8f-8183-4db64f1f3020 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:04.534476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ddd0c-b849-4c8f-8183-4db64f1f3020 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:04.539151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2402d9-02db-4b36-a959-67cc56e6eb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:04.540263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2402d9-02db-4b36-a959-67cc56e6eb9c admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:04.540263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2402d9-02db-4b36-a959-67cc56e6eb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:04.540450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2402d9-02db-4b36-a959-67cc56e6eb9c admin admin] PATH_INFO: `/v3/projects/90e5535a8628485ba0925ee296257120/users/7e636960015443f091b340dc28b19da7/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:04.555323 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2402d9-02db-4b36-a959-67cc56e6eb9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e5535a8628485ba0925ee296257120, user_id=7e636960015443f091b340dc28b19da7, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:04.557949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2402d9-02db-4b36-a959-67cc56e6eb9c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:04.640056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 934/1845] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:04 2022] PUT /identity/v3/projects/90e5535a8628485ba0925ee296257120/users/7e636960015443f091b340dc28b19da7/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:04.640683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2402d9-02db-4b36-a959-67cc56e6eb9c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:04.642258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ff2402d9-02db-4b36-a959-67cc56e6eb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:04.649567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f0e727904b4d7b9b5b13df25cb3b63', 'request_id': 'req-0f24f715-2ffc-40a2-9246-d1cdbafcf789'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:04.655080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f0e727904b4d7b9b5b13df25cb3b63', 'request_id': 'req-0f24f715-2ffc-40a2-9246-d1cdbafcf789'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:04.661631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f0e727904b4d7b9b5b13df25cb3b63', 'request_id': 'req-0f24f715-2ffc-40a2-9246-d1cdbafcf789'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:04.720462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2402d9-02db-4b36-a959-67cc56e6eb9c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:04.746482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] The token cache is being invalidate because project 52f0e727904b4d7b9b5b13df25cb3b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:04.746833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:04.747542 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:04.749140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 912/1846] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:04 2022] DELETE /identity/v3/projects/52f0e727904b4d7b9b5b13df25cb3b63 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:04.749907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:04.751270 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:04.787544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:04.788281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:04.788647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:04.789250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] PATH_INFO: `/v3/users/653ccf51c0fe4292b9fbe73836cbdd15` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:04.790469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=653ccf51c0fe4292b9fbe73836cbdd15)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:04.792552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:04.823801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24f715-2ffc-40a2-9246-d1cdbafcf789 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:04.831509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b57836-685c-4a02-8f2e-8e5f0b7cff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:04.832888 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57836-685c-4a02-8f2e-8e5f0b7cff40 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:04.833355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57836-685c-4a02-8f2e-8e5f0b7cff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:04.834309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57836-685c-4a02-8f2e-8e5f0b7cff40 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:04.834816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b57836-685c-4a02-8f2e-8e5f0b7cff40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:04.837993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b57836-685c-4a02-8f2e-8e5f0b7cff40 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:04.851347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 913/1847] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:04.852943 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546a56e-8129-437a-a539-43e34db04e25 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:04.853242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546a56e-8129-437a-a539-43e34db04e25 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:04.853576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546a56e-8129-437a-a539-43e34db04e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:04.883939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d546a56e-8129-437a-a539-43e34db04e25 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:04.883939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d546a56e-8129-437a-a539-43e34db04e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:04.890305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 914/1848] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:04.891291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546a56e-8129-437a-a539-43e34db04e25 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:04.900984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546a56e-8129-437a-a539-43e34db04e25 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:04.906391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab22e9-6fc0-4cc4-8c2c-56085288f3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:04.910076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab22e9-6fc0-4cc4-8c2c-56085288f3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:04.910076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab22e9-6fc0-4cc4-8c2c-56085288f3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:04.910076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab22e9-6fc0-4cc4-8c2c-56085288f3bc admin admin] PATH_INFO: `/v3/projects/90e5535a8628485ba0925ee296257120/users/7e636960015443f091b340dc28b19da7/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:04.910076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab22e9-6fc0-4cc4-8c2c-56085288f3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e5535a8628485ba0925ee296257120, user_id=7e636960015443f091b340dc28b19da7, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:04.912532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab22e9-6fc0-4cc4-8c2c-56085288f3bc admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:04.929026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 915/1849] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:04 2022] PUT /identity/v3/projects/90e5535a8628485ba0925ee296257120/users/7e636960015443f091b340dc28b19da7/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:04.930287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ab571-37a5-476a-a55a-f82f52c6ab71 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:04.930575 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ab571-37a5-476a-a55a-f82f52c6ab71 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:04.930937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ab571-37a5-476a-a55a-f82f52c6ab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:04.955547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-641ab571-37a5-476a-a55a-f82f52c6ab71 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:04.956899 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-641ab571-37a5-476a-a55a-f82f52c6ab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:05.023651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 916/1850] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:05.025147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbf101-92bf-41f5-861a-717b64a267dc None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:05.025439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbf101-92bf-41f5-861a-717b64a267dc None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:05.025712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbf101-92bf-41f5-861a-717b64a267dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:05.058578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-79fbf101-92bf-41f5-861a-717b64a267dc None None] MFA Rules not processed for user `7e636960015443f091b340dc28b19da7`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:05.059950 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-79fbf101-92bf-41f5-861a-717b64a267dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:05.091460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '653ccf51c0fe4292b9fbe73836cbdd15'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:05.106173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '653ccf51c0fe4292b9fbe73836cbdd15'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:05.114524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '653ccf51c0fe4292b9fbe73836cbdd15'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:05.115681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '653ccf51c0fe4292b9fbe73836cbdd15'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:05.116793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '653ccf51c0fe4292b9fbe73836cbdd15'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:05.137514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 917/1851] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:05.138492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbf101-92bf-41f5-861a-717b64a267dc None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:05.139816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-79fbf101-92bf-41f5-861a-717b64a267dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:05.155521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbf101-92bf-41f5-861a-717b64a267dc None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:05.160070 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b4647-f17d-41c8-aa2e-b6da9dbbd10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:05.162095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b4647-f17d-41c8-aa2e-b6da9dbbd10d admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:05.162095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b4647-f17d-41c8-aa2e-b6da9dbbd10d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:05.162095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b4647-f17d-41c8-aa2e-b6da9dbbd10d admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:05.162095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b4647-f17d-41c8-aa2e-b6da9dbbd10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:05.163137 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b4647-f17d-41c8-aa2e-b6da9dbbd10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:05.165745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b4647-f17d-41c8-aa2e-b6da9dbbd10d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:05.178707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 918/1852] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:57:05.179800 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b4647-f17d-41c8-aa2e-b6da9dbbd10d admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:05.181794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d63b4647-f17d-41c8-aa2e-b6da9dbbd10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:05.193061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 935/1853] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:04 2022] DELETE /identity/v3/users/653ccf51c0fe4292b9fbe73836cbdd15 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:05.193888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:05.244805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b4647-f17d-41c8-aa2e-b6da9dbbd10d admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:05.268570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e63d3-9398-40e7-867c-16fed594d001 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:05.274057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b47b6-352e-4e03-a34e-35664ac7b30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:05.274718 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b47b6-352e-4e03-a34e-35664ac7b30c admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:05.280409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b47b6-352e-4e03-a34e-35664ac7b30c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:05.280409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b47b6-352e-4e03-a34e-35664ac7b30c admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:05.280409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b47b6-352e-4e03-a34e-35664ac7b30c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:05.280409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b47b6-352e-4e03-a34e-35664ac7b30c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:05.293683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbd980-cd99-4665-8bce-ff9735435a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:05.294290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbd980-cd99-4665-8bce-ff9735435a9e service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:05.294567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbd980-cd99-4665-8bce-ff9735435a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:05.294839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbd980-cd99-4665-8bce-ff9735435a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:05.357835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbd980-cd99-4665-8bce-ff9735435a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:05.359304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbd980-cd99-4665-8bce-ff9735435a9e service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:05.368492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 936/1854] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:05 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:05.369473 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 919/1855] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:05.371355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e436f-6fb2-4b2f-87b9-50978262808e None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:05.371705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e436f-6fb2-4b2f-87b9-50978262808e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:05.372194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e436f-6fb2-4b2f-87b9-50978262808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:05.373233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbd980-cd99-4665-8bce-ff9735435a9e service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:05.385440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbd980-cd99-4665-8bce-ff9735435a9e service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:05.394543 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-6e1e436f-6fb2-4b2f-87b9-50978262808e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:05.395839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6e1e436f-6fb2-4b2f-87b9-50978262808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:05.441229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065eb43b-8926-4a02-a5c2-d7ee7322bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:05.441838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eb43b-8926-4a02-a5c2-d7ee7322bca8 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:05.442115 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eb43b-8926-4a02-a5c2-d7ee7322bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:05.442384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eb43b-8926-4a02-a5c2-d7ee7322bca8 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:05.443027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065eb43b-8926-4a02-a5c2-d7ee7322bca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:05.444940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065eb43b-8926-4a02-a5c2-d7ee7322bca8 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:05.454893 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 937/1856] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:05.465429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e436f-6fb2-4b2f-87b9-50978262808e None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:05.466855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6e1e436f-6fb2-4b2f-87b9-50978262808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:05.545959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e436f-6fb2-4b2f-87b9-50978262808e None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:05.553383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8adaf1-e1ff-4dbe-aba4-13db775dbbe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:05.554003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8adaf1-e1ff-4dbe-aba4-13db775dbbe8 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:05.554279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8adaf1-e1ff-4dbe-aba4-13db775dbbe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:05.554600 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8adaf1-e1ff-4dbe-aba4-13db775dbbe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:05.567556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 920/1857] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:05 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:05.569701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065eb43b-8926-4a02-a5c2-d7ee7322bca8 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:05.571215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8adaf1-e1ff-4dbe-aba4-13db775dbbe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:05.572673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8adaf1-e1ff-4dbe-aba4-13db775dbbe8 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:05.583270 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065eb43b-8926-4a02-a5c2-d7ee7322bca8 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:05.586321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 938/1858] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:05.595768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df3215-2d12-4305-85c0-fc3bb751f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:05.595768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df3215-2d12-4305-85c0-fc3bb751f6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:05.595768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df3215-2d12-4305-85c0-fc3bb751f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:05.595768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df3215-2d12-4305-85c0-fc3bb751f6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:05.596170 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df3215-2d12-4305-85c0-fc3bb751f6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:05.596170 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df3215-2d12-4305-85c0-fc3bb751f6f7 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:05.607388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 921/1859] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:05.611310 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8adaf1-e1ff-4dbe-aba4-13db775dbbe8 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:05.631053 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8adaf1-e1ff-4dbe-aba4-13db775dbbe8 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:05.639937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8ecad-1796-471a-810d-a195398a628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:05.640692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8ecad-1796-471a-810d-a195398a628c admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:05.640983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8ecad-1796-471a-810d-a195398a628c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:05.641329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8ecad-1796-471a-810d-a195398a628c admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:05.642099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8ecad-1796-471a-810d-a195398a628c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:05.644958 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8ecad-1796-471a-810d-a195398a628c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:05.646084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df3215-2d12-4305-85c0-fc3bb751f6f7 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:05.657819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 939/1860] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:05.662411 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8ecad-1796-471a-810d-a195398a628c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:05.675544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8ecad-1796-471a-810d-a195398a628c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:05.681250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28b5a8-fd9a-45f6-b3e5-b9aafdc56d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:05.681819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28b5a8-fd9a-45f6-b3e5-b9aafdc56d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:05.682776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28b5a8-fd9a-45f6-b3e5-b9aafdc56d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:05.683239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28b5a8-fd9a-45f6-b3e5-b9aafdc56d3c admin admin] PATH_INFO: `/v3/projects/81022f4887b4454a8aee47764ee25817/users/7545efbc4275443d82752120c93c5da4/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:05.702497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28b5a8-fd9a-45f6-b3e5-b9aafdc56d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81022f4887b4454a8aee47764ee25817, user_id=7545efbc4275443d82752120c93c5da4, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:05.705346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28b5a8-fd9a-45f6-b3e5-b9aafdc56d3c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:05.715095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df3215-2d12-4305-85c0-fc3bb751f6f7 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:05.718772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09613ba6-bcff-416d-a195-77c4055d3a49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:05.719523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09613ba6-bcff-416d-a195-77c4055d3a49 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:05.719805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09613ba6-bcff-416d-a195-77c4055d3a49 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:05.720082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09613ba6-bcff-416d-a195-77c4055d3a49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:05.721895 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-09613ba6-bcff-416d-a195-77c4055d3a49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:05.785881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09613ba6-bcff-416d-a195-77c4055d3a49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:05.787444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09613ba6-bcff-416d-a195-77c4055d3a49 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:05.797305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 922/1861] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:05.804375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 940/1862] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:05 2022] PUT /identity/v3/projects/81022f4887b4454a8aee47764ee25817/users/7545efbc4275443d82752120c93c5da4/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:05.815241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1e2c2-edd5-4675-99ce-e91f31f67a0d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:05.815241 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1e2c2-edd5-4675-99ce-e91f31f67a0d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:05.818416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1e2c2-edd5-4675-99ce-e91f31f67a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:05.848865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-92c1e2c2-edd5-4675-99ce-e91f31f67a0d None None] MFA Rules not processed for user `7545efbc4275443d82752120c93c5da4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:05.850296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-92c1e2c2-edd5-4675-99ce-e91f31f67a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:05.942467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 923/1863] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:05.954288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28b5a8-fd9a-45f6-b3e5-b9aafdc56d3c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:05.957496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-da28b5a8-fd9a-45f6-b3e5-b9aafdc56d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:06.089593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28b5a8-fd9a-45f6-b3e5-b9aafdc56d3c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:06.094043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4b983-70b9-460b-8e3d-d0d3ae112449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:06.094666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4b983-70b9-460b-8e3d-d0d3ae112449 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:06.095056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4b983-70b9-460b-8e3d-d0d3ae112449 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:06.095353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4b983-70b9-460b-8e3d-d0d3ae112449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:06.104529 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4b983-70b9-460b-8e3d-d0d3ae112449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:06.109466 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4b983-70b9-460b-8e3d-d0d3ae112449 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:06.120756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 941/1864] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:06.215145 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1e2c2-edd5-4675-99ce-e91f31f67a0d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:06.217580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-92c1e2c2-edd5-4675-99ce-e91f31f67a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:06.317115 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1e2c2-edd5-4675-99ce-e91f31f67a0d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:06.322824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:06.323829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:06.324189 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:06.324484 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] PATH_INFO: `/v3/projects/667e5c676da940d3b3507cac4759a772` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:06.325654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=667e5c676da940d3b3507cac4759a772)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:06.327626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:06.365611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:06.489173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667e5c676da940d3b3507cac4759a772', 'request_id': 'req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:06.497366 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667e5c676da940d3b3507cac4759a772', 'request_id': 'req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:06.504404 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667e5c676da940d3b3507cac4759a772', 'request_id': 'req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:06.613940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] The token cache is being invalidate because project 667e5c676da940d3b3507cac4759a772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:06.614300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:06.615564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:06.617777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 924/1865] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:06 2022] DELETE /identity/v3/projects/667e5c676da940d3b3507cac4759a772 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:06.621799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4b983-70b9-460b-8e3d-d0d3ae112449 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:06.640586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4b983-70b9-460b-8e3d-d0d3ae112449 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:06.698692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:06.699403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:06.699678 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:06.699950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] PATH_INFO: `/v3/users/1c629207015b46fd81c411a211e18560` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:06.701115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c629207015b46fd81c411a211e18560)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:06.703084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:06.955796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c629207015b46fd81c411a211e18560'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:06.978590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c629207015b46fd81c411a211e18560'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:06.988576 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c629207015b46fd81c411a211e18560'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:06.989387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c629207015b46fd81c411a211e18560'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:06.990211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c629207015b46fd81c411a211e18560'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:07.131001 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 942/1866] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:06 2022] DELETE /identity/v3/users/1c629207015b46fd81c411a211e18560 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:07.222965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:07.224974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:07.243133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eba67e-a5b9-4151-9dee-ea3c5bef1e3c admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:07.324909 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a60a20-45bc-4264-8a6d-a5831607cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:07.325729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60a20-45bc-4264-8a6d-a5831607cd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:07.326008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60a20-45bc-4264-8a6d-a5831607cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:07.326284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60a20-45bc-4264-8a6d-a5831607cd3a admin admin] PATH_INFO: `/v3/users/9dd1bfe2e942442890b7c059d048ea55` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:07.327503 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a60a20-45bc-4264-8a6d-a5831607cd3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd1bfe2e942442890b7c059d048ea55)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:07.329485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a60a20-45bc-4264-8a6d-a5831607cd3a admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:07.550691 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-67a60a20-45bc-4264-8a6d-a5831607cd3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd1bfe2e942442890b7c059d048ea55'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:07.594356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:07.602744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:07.604374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:07.624542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398a7f-4cd6-4bc7-8e83-4a50231a0670 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:07.632028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:07.632975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:07.632975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:07.633322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b admin admin] PATH_INFO: `/v3/projects/1657c0a9b2154aa3968cdc569cb3ff59` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:07.634370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1657c0a9b2154aa3968cdc569cb3ff59)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:07.636740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:07.654210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-67a60a20-45bc-4264-8a6d-a5831607cd3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd1bfe2e942442890b7c059d048ea55'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:07.663543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-67a60a20-45bc-4264-8a6d-a5831607cd3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd1bfe2e942442890b7c059d048ea55'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:07.664262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-67a60a20-45bc-4264-8a6d-a5831607cd3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd1bfe2e942442890b7c059d048ea55'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:07.677301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-67a60a20-45bc-4264-8a6d-a5831607cd3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd1bfe2e942442890b7c059d048ea55'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:07.683980 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 925/1867] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:07 2022] DELETE /identity/v3/users/9dd1bfe2e942442890b7c059d048ea55 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:07.688400 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113a1e0-1b52-4615-9e2d-ce3b1d8589a9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:07.688756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113a1e0-1b52-4615-9e2d-ce3b1d8589a9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:07.689125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113a1e0-1b52-4615-9e2d-ce3b1d8589a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:07.708979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f113a1e0-1b52-4615-9e2d-ce3b1d8589a9 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:07.710466 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f113a1e0-1b52-4615-9e2d-ce3b1d8589a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:07.759860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1657c0a9b2154aa3968cdc569cb3ff59', 'request_id': 'req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:07.765452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1657c0a9b2154aa3968cdc569cb3ff59', 'request_id': 'req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:07.775071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 926/1868] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:07.785075 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113a1e0-1b52-4615-9e2d-ce3b1d8589a9 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:07.786434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f113a1e0-1b52-4615-9e2d-ce3b1d8589a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:07.843743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113a1e0-1b52-4615-9e2d-ce3b1d8589a9 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:07.851284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1657c0a9b2154aa3968cdc569cb3ff59', 'request_id': 'req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:07.867822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b admin admin] The token cache is being invalidate because project 1657c0a9b2154aa3968cdc569cb3ff59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:07.868876 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:07.869517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b28209cc-d9ef-4e87-99eb-a9257ceeef9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:07.871339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 943/1869] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:07 2022] DELETE /identity/v3/projects/1657c0a9b2154aa3968cdc569cb3ff59 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:07.876060 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2c900-eed8-4270-9fef-0e206047becf None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:07.876318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2c900-eed8-4270-9fef-0e206047becf None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:07.876596 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2c900-eed8-4270-9fef-0e206047becf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:07.898488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653ba4a-92f3-4a09-a96d-871510bd5b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:07.899536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653ba4a-92f3-4a09-a96d-871510bd5b77 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:07.900021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653ba4a-92f3-4a09-a96d-871510bd5b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:07.900485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653ba4a-92f3-4a09-a96d-871510bd5b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:07.901499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-8fc2c900-eed8-4270-9fef-0e206047becf None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:07.902745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8fc2c900-eed8-4270-9fef-0e206047becf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:07.903858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b653ba4a-92f3-4a09-a96d-871510bd5b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:07.975644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 944/1870] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:07.981273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653ba4a-92f3-4a09-a96d-871510bd5b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:07.982928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653ba4a-92f3-4a09-a96d-871510bd5b77 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:07.984240 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07324d9-ba34-43c4-882d-d228261999a4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:07.984572 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07324d9-ba34-43c4-882d-d228261999a4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:07.984856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07324d9-ba34-43c4-882d-d228261999a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:07.996110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 927/1871] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:08.032562 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-b07324d9-ba34-43c4-882d-d228261999a4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:08.035033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b07324d9-ba34-43c4-882d-d228261999a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:08.066949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 945/1872] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:08.071449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653ba4a-92f3-4a09-a96d-871510bd5b77 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:08.084477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653ba4a-92f3-4a09-a96d-871510bd5b77 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:08.095871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f05696-3b84-4006-a257-422d1ace9905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:08.095871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f05696-3b84-4006-a257-422d1ace9905 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:08.095871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f05696-3b84-4006-a257-422d1ace9905 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:08.095871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f05696-3b84-4006-a257-422d1ace9905 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:08.096203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f05696-3b84-4006-a257-422d1ace9905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:08.096203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f05696-3b84-4006-a257-422d1ace9905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:08.097315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f05696-3b84-4006-a257-422d1ace9905 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:08.116048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 928/1873] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:57:08.122134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07324d9-ba34-43c4-882d-d228261999a4 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:08.126490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07324d9-ba34-43c4-882d-d228261999a4 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:08.131241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56dd99-6f40-4fa2-ab9b-8c27f07653ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:08.131919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56dd99-6f40-4fa2-ab9b-8c27f07653ac admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:08.132132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56dd99-6f40-4fa2-ab9b-8c27f07653ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:08.132411 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56dd99-6f40-4fa2-ab9b-8c27f07653ac admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:08.133039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56dd99-6f40-4fa2-ab9b-8c27f07653ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:08.134948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56dd99-6f40-4fa2-ab9b-8c27f07653ac admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:08.317935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 946/1874] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:08 2022] POST /identity/v3/projects => generated 407 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:08.321976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f05696-3b84-4006-a257-422d1ace9905 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:08.338302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f05696-3b84-4006-a257-422d1ace9905 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:08.435320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11078e7-bb47-4fa5-9e98-72b6a9b6c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:08.436214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11078e7-bb47-4fa5-9e98-72b6a9b6c382 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:08.436686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11078e7-bb47-4fa5-9e98-72b6a9b6c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:08.437025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11078e7-bb47-4fa5-9e98-72b6a9b6c382 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:08.437733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11078e7-bb47-4fa5-9e98-72b6a9b6c382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:08.440018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11078e7-bb47-4fa5-9e98-72b6a9b6c382 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:08.607653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 929/1875] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:08 2022] POST /identity/v3/users => generated 304 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:08.609884 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56dd99-6f40-4fa2-ab9b-8c27f07653ac admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:08.624088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56dd99-6f40-4fa2-ab9b-8c27f07653ac admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:08.653968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22986aef-9c2c-4f33-8045-9214ae1e02ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:08.655199 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22986aef-9c2c-4f33-8045-9214ae1e02ee admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:08.655708 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22986aef-9c2c-4f33-8045-9214ae1e02ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:08.656207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22986aef-9c2c-4f33-8045-9214ae1e02ee admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:08.658782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22986aef-9c2c-4f33-8045-9214ae1e02ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:08.661182 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22986aef-9c2c-4f33-8045-9214ae1e02ee admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:08.676988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 947/1876] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:08.681719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11078e7-bb47-4fa5-9e98-72b6a9b6c382 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:08.693196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11078e7-bb47-4fa5-9e98-72b6a9b6c382 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:08.698690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5eb4e6-dde1-4017-8859-fc6b8e85c5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:08.699351 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5eb4e6-dde1-4017-8859-fc6b8e85c5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:08.699634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5eb4e6-dde1-4017-8859-fc6b8e85c5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:08.699913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5eb4e6-dde1-4017-8859-fc6b8e85c5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:08.701068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5eb4e6-dde1-4017-8859-fc6b8e85c5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:08.702375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5eb4e6-dde1-4017-8859-fc6b8e85c5f8 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:08.719981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 930/1877] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:08.720513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22986aef-9c2c-4f33-8045-9214ae1e02ee admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:08.741515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22986aef-9c2c-4f33-8045-9214ae1e02ee admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:08.751846 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c597693-6531-4b59-b542-393a1efff96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:08.753051 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c597693-6531-4b59-b542-393a1efff96d admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:08.753482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c597693-6531-4b59-b542-393a1efff96d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:08.753910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c597693-6531-4b59-b542-393a1efff96d admin admin] PATH_INFO: `/v3/projects/562e4ced57d0427fa65793161c14fda5/users/dd6cd94c44884a76808e900062ed4388/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:08.770826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c597693-6531-4b59-b542-393a1efff96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=562e4ced57d0427fa65793161c14fda5, user_id=dd6cd94c44884a76808e900062ed4388, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:08.773778 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c597693-6531-4b59-b542-393a1efff96d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:08.909013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 948/1878] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:08 2022] PUT /identity/v3/projects/562e4ced57d0427fa65793161c14fda5/users/dd6cd94c44884a76808e900062ed4388/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:08.920322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9de6-0fb6-4dca-a0ff-3479a6667970 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:08.920822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9de6-0fb6-4dca-a0ff-3479a6667970 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:08.921456 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9de6-0fb6-4dca-a0ff-3479a6667970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:08.972952 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-86ba9de6-0fb6-4dca-a0ff-3479a6667970 None None] MFA Rules not processed for user `dd6cd94c44884a76808e900062ed4388`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:08.974326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-86ba9de6-0fb6-4dca-a0ff-3479a6667970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:09.050397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 931/1879] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:08 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:09.052842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c597693-6531-4b59-b542-393a1efff96d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:09.061173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9de6-0fb6-4dca-a0ff-3479a6667970 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:09.066112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-86ba9de6-0fb6-4dca-a0ff-3479a6667970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:09.133592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c597693-6531-4b59-b542-393a1efff96d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:09.138965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c4a0a-f8a0-4be8-ad7c-f208dd15d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:09.139672 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c4a0a-f8a0-4be8-ad7c-f208dd15d7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:09.140020 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c4a0a-f8a0-4be8-ad7c-f208dd15d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:09.140364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c4a0a-f8a0-4be8-ad7c-f208dd15d7b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:09.141140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c4a0a-f8a0-4be8-ad7c-f208dd15d7b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:09.143328 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c4a0a-f8a0-4be8-ad7c-f208dd15d7b9 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:09.144068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9de6-0fb6-4dca-a0ff-3479a6667970 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:09.150077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:09.151126 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:09.157964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:09.157964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] PATH_INFO: `/v3/projects/ff58569d3d00482da2033b1607049c05` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:09.157964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff58569d3d00482da2033b1607049c05)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:09.157964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:09.267628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 949/1880] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:09 2022] POST /identity/v3/projects => generated 407 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:09.277374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c4a0a-f8a0-4be8-ad7c-f208dd15d7b9 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:09.299168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff58569d3d00482da2033b1607049c05', 'request_id': 'req-bca416eb-a29a-4981-9106-b8f4f89a7b51'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:09.313070 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff58569d3d00482da2033b1607049c05', 'request_id': 'req-bca416eb-a29a-4981-9106-b8f4f89a7b51'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:09.326996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff58569d3d00482da2033b1607049c05', 'request_id': 'req-bca416eb-a29a-4981-9106-b8f4f89a7b51'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:09.377804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c4a0a-f8a0-4be8-ad7c-f208dd15d7b9 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:09.387420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076131cd-eb91-4215-ac39-22672cbb85c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:09.388378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076131cd-eb91-4215-ac39-22672cbb85c0 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:09.388378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076131cd-eb91-4215-ac39-22672cbb85c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:09.388635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076131cd-eb91-4215-ac39-22672cbb85c0 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:09.389437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076131cd-eb91-4215-ac39-22672cbb85c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:09.391643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076131cd-eb91-4215-ac39-22672cbb85c0 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:09.423973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] The token cache is being invalidate because project ff58569d3d00482da2033b1607049c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:09.424272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:09.425014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:09.429927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 932/1881] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:09 2022] DELETE /identity/v3/projects/ff58569d3d00482da2033b1607049c05 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:09.430600 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:09.432016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:09.495467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:09.505847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca416eb-a29a-4981-9106-b8f4f89a7b51 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:09.514162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 950/1882] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:09 2022] POST /identity/v3/users => generated 310 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:09.515559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:09.516446 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:09.516940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:09.517396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] PATH_INFO: `/v3/users/a2f6c04d6e414cd0a1368a488a112f94` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:09.518044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076131cd-eb91-4215-ac39-22672cbb85c0 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:09.519304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f6c04d6e414cd0a1368a488a112f94)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:09.520527 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-076131cd-eb91-4215-ac39-22672cbb85c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:09.523516 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:09.543656 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076131cd-eb91-4215-ac39-22672cbb85c0 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:09.553108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e7271-1d6c-4f6a-8114-cbcede606eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:09.554806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e7271-1d6c-4f6a-8114-cbcede606eed admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:09.555531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e7271-1d6c-4f6a-8114-cbcede606eed admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:09.556374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e7271-1d6c-4f6a-8114-cbcede606eed admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:09.557454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e7271-1d6c-4f6a-8114-cbcede606eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:09.560827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e7271-1d6c-4f6a-8114-cbcede606eed admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:09.577465 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 951/1883] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:09.583921 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e7271-1d6c-4f6a-8114-cbcede606eed admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:09.594763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e7271-1d6c-4f6a-8114-cbcede606eed admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:09.599689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949465c-bebf-4997-8e73-01ca3b60bc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:09.600450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949465c-bebf-4997-8e73-01ca3b60bc66 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:09.600793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949465c-bebf-4997-8e73-01ca3b60bc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:09.601174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949465c-bebf-4997-8e73-01ca3b60bc66 admin admin] PATH_INFO: `/v3/projects/86df269a289e43818d667e5dafc898cf/users/cdc7ca25084348a8a12c124a329ec35c/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:09.616307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949465c-bebf-4997-8e73-01ca3b60bc66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86df269a289e43818d667e5dafc898cf, user_id=cdc7ca25084348a8a12c124a329ec35c, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:09.619368 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949465c-bebf-4997-8e73-01ca3b60bc66 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:09.747106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 952/1884] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:09 2022] PUT /identity/v3/projects/86df269a289e43818d667e5dafc898cf/users/cdc7ca25084348a8a12c124a329ec35c/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:09.751017 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949465c-bebf-4997-8e73-01ca3b60bc66 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:09.777930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f6c04d6e414cd0a1368a488a112f94'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:09.817636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949465c-bebf-4997-8e73-01ca3b60bc66 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:09.822427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116599d-0f4d-44ba-bd10-ef8319bd5b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:09.823109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116599d-0f4d-44ba-bd10-ef8319bd5b5a admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:09.823388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116599d-0f4d-44ba-bd10-ef8319bd5b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:09.823657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116599d-0f4d-44ba-bd10-ef8319bd5b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:09.824350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116599d-0f4d-44ba-bd10-ef8319bd5b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:09.826778 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116599d-0f4d-44ba-bd10-ef8319bd5b5a admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:09.842498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 953/1885] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:09.844123 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116599d-0f4d-44ba-bd10-ef8319bd5b5a admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:09.856987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116599d-0f4d-44ba-bd10-ef8319bd5b5a admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:09.863554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f6c04d6e414cd0a1368a488a112f94'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:09.884022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f6c04d6e414cd0a1368a488a112f94'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:09.887623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f6c04d6e414cd0a1368a488a112f94'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:09.891366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4cba3-3653-4876-aa09-a8063b9fea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:09.892054 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4cba3-3653-4876-aa09-a8063b9fea51 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:09.893310 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4cba3-3653-4876-aa09-a8063b9fea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:09.898579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4cba3-3653-4876-aa09-a8063b9fea51 admin admin] PATH_INFO: `/v3/projects/86df269a289e43818d667e5dafc898cf/users/cdc7ca25084348a8a12c124a329ec35c/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:09.899138 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4cba3-3653-4876-aa09-a8063b9fea51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86df269a289e43818d667e5dafc898cf, user_id=cdc7ca25084348a8a12c124a329ec35c, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:09.905069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4cba3-3653-4876-aa09-a8063b9fea51 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:09.913521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f6c04d6e414cd0a1368a488a112f94'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:09.920489 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 954/1886] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:09 2022] PUT /identity/v3/projects/86df269a289e43818d667e5dafc898cf/users/cdc7ca25084348a8a12c124a329ec35c/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:09.925345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 933/1887] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:09 2022] DELETE /identity/v3/users/a2f6c04d6e414cd0a1368a488a112f94 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:09.935781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ef9fd-d84e-4cd2-a840-fba1c6515116 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:09.936118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ef9fd-d84e-4cd2-a840-fba1c6515116 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:09.938305 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ef9fd-d84e-4cd2-a840-fba1c6515116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:09.980461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-4d5ef9fd-d84e-4cd2-a840-fba1c6515116 None None] MFA Rules not processed for user `cdc7ca25084348a8a12c124a329ec35c`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:09.982386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4d5ef9fd-d84e-4cd2-a840-fba1c6515116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:10.089425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 955/1888] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:09 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:10.110500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:10.112078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:10.179231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d356537-7578-468b-b1ae-0786ceeaf467 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:10.185371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f116d58-7fb3-4f30-8da1-8f0a541a34f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:10.186003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116d58-7fb3-4f30-8da1-8f0a541a34f9 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:10.186289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116d58-7fb3-4f30-8da1-8f0a541a34f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:10.186811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116d58-7fb3-4f30-8da1-8f0a541a34f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:10.197691 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f116d58-7fb3-4f30-8da1-8f0a541a34f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:10.199332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f116d58-7fb3-4f30-8da1-8f0a541a34f9 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:10.217177 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 934/1889] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:10 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:10.721011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ef9fd-d84e-4cd2-a840-fba1c6515116 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:10.724532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4d5ef9fd-d84e-4cd2-a840-fba1c6515116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:10.738829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ef9fd-d84e-4cd2-a840-fba1c6515116 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:10.742610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab85f7d-ad6e-4224-9328-f24af420518f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:10.743535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab85f7d-ad6e-4224-9328-f24af420518f service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:10.744335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab85f7d-ad6e-4224-9328-f24af420518f service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:10.744620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab85f7d-ad6e-4224-9328-f24af420518f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:10.746548 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2ab85f7d-ad6e-4224-9328-f24af420518f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:10.812969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab85f7d-ad6e-4224-9328-f24af420518f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:10.814415 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab85f7d-ad6e-4224-9328-f24af420518f service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:10.824264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 956/1890] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:10 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:10.934235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f116d58-7fb3-4f30-8da1-8f0a541a34f9 service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:10.936037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1f116d58-7fb3-4f30-8da1-8f0a541a34f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:11.013742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f116d58-7fb3-4f30-8da1-8f0a541a34f9 service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:11.019801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbafa3b-3c6d-40a6-a76e-48840550cff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:11.020729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbafa3b-3c6d-40a6-a76e-48840550cff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:11.021008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbafa3b-3c6d-40a6-a76e-48840550cff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:11.021280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbafa3b-3c6d-40a6-a76e-48840550cff0 admin admin] PATH_INFO: `/v3/projects/1cf965fd2aa44adba7fb13beea253469` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:11.022412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbafa3b-3c6d-40a6-a76e-48840550cff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf965fd2aa44adba7fb13beea253469)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:11.024528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbafa3b-3c6d-40a6-a76e-48840550cff0 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:11.034285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab85f7d-ad6e-4224-9328-f24af420518f service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:11.036002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2ab85f7d-ad6e-4224-9328-f24af420518f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:11.052055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab85f7d-ad6e-4224-9328-f24af420518f service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:11.057370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63a927-1f11-4be8-9fe4-527d39700035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:11.058091 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63a927-1f11-4be8-9fe4-527d39700035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:11.058645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63a927-1f11-4be8-9fe4-527d39700035 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:11.059131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63a927-1f11-4be8-9fe4-527d39700035 admin admin] PATH_INFO: `/v3/users/7545efbc4275443d82752120c93c5da4` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:11.060329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63a927-1f11-4be8-9fe4-527d39700035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7545efbc4275443d82752120c93c5da4)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:11.062364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63a927-1f11-4be8-9fe4-527d39700035 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:11.140300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9bbafa3b-3c6d-40a6-a76e-48840550cff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf965fd2aa44adba7fb13beea253469', 'request_id': 'req-9bbafa3b-3c6d-40a6-a76e-48840550cff0'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:11.149309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9bbafa3b-3c6d-40a6-a76e-48840550cff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf965fd2aa44adba7fb13beea253469', 'request_id': 'req-9bbafa3b-3c6d-40a6-a76e-48840550cff0'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:11.156521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9bbafa3b-3c6d-40a6-a76e-48840550cff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf965fd2aa44adba7fb13beea253469', 'request_id': 'req-9bbafa3b-3c6d-40a6-a76e-48840550cff0'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:11.291743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9bbafa3b-3c6d-40a6-a76e-48840550cff0 admin admin] The token cache is being invalidate because project 1cf965fd2aa44adba7fb13beea253469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:11.292145 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9bbafa3b-3c6d-40a6-a76e-48840550cff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:11.293867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9bbafa3b-3c6d-40a6-a76e-48840550cff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:11.302364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 935/1891] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:10 2022] DELETE /identity/v3/projects/1cf965fd2aa44adba7fb13beea253469 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:11.305860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127fa6-e749-48a7-88cd-55765495594e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:11.307581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127fa6-e749-48a7-88cd-55765495594e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:11.308027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127fa6-e749-48a7-88cd-55765495594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:11.319598 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9b63a927-1f11-4be8-9fe4-527d39700035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7545efbc4275443d82752120c93c5da4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:11.357667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-33127fa6-e749-48a7-88cd-55765495594e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:11.359794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9b63a927-1f11-4be8-9fe4-527d39700035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7545efbc4275443d82752120c93c5da4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:11.363265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-33127fa6-e749-48a7-88cd-55765495594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:11.370528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9b63a927-1f11-4be8-9fe4-527d39700035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7545efbc4275443d82752120c93c5da4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:11.375186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9b63a927-1f11-4be8-9fe4-527d39700035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7545efbc4275443d82752120c93c5da4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:11.377362 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9b63a927-1f11-4be8-9fe4-527d39700035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7545efbc4275443d82752120c93c5da4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:11.471692 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 936/1892] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:11.473580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52770-b0ca-4984-96f2-63696cd2ae4c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:11.473876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52770-b0ca-4984-96f2-63696cd2ae4c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:11.474187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52770-b0ca-4984-96f2-63696cd2ae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:11.480744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 957/1893] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:11 2022] DELETE /identity/v3/users/7545efbc4275443d82752120c93c5da4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:11.485141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e70df-0fcf-4cea-a3e7-f0a90b1a0a3b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:11.485541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e70df-0fcf-4cea-a3e7-f0a90b1a0a3b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:11.485973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e70df-0fcf-4cea-a3e7-f0a90b1a0a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:11.530677 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-47e52770-b0ca-4984-96f2-63696cd2ae4c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:11.532035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-47e52770-b0ca-4984-96f2-63696cd2ae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:11.547761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-6a8e70df-0fcf-4cea-a3e7-f0a90b1a0a3b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:11.550855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6a8e70df-0fcf-4cea-a3e7-f0a90b1a0a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:11.711146 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 958/1894] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:11.721191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e70df-0fcf-4cea-a3e7-f0a90b1a0a3b None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:11.723524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6a8e70df-0fcf-4cea-a3e7-f0a90b1a0a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:11.746457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 937/1895] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:11.756888 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e52770-b0ca-4984-96f2-63696cd2ae4c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:11.770949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e52770-b0ca-4984-96f2-63696cd2ae4c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:11.776071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:11.781523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f506c-7342-4d1d-9c1d-5a724430514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:11.787533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f506c-7342-4d1d-9c1d-5a724430514e admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:11.787533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f506c-7342-4d1d-9c1d-5a724430514e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:11.787533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f506c-7342-4d1d-9c1d-5a724430514e admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:11.788705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f506c-7342-4d1d-9c1d-5a724430514e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:11.789192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f506c-7342-4d1d-9c1d-5a724430514e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:11.791024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f506c-7342-4d1d-9c1d-5a724430514e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:11.815421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e70df-0fcf-4cea-a3e7-f0a90b1a0a3b None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:11.819745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ab3c-a1a9-4da8-885f-5b7374abf1b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:11.827707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ab3c-a1a9-4da8-885f-5b7374abf1b3 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:11.827707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ab3c-a1a9-4da8-885f-5b7374abf1b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:11.827707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ab3c-a1a9-4da8-885f-5b7374abf1b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:11.828082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 938/1896] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:57:11.828738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f506c-7342-4d1d-9c1d-5a724430514e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:11.839501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603ab3c-a1a9-4da8-885f-5b7374abf1b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:11.841013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603ab3c-a1a9-4da8-885f-5b7374abf1b3 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:11.845915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f506c-7342-4d1d-9c1d-5a724430514e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:11.853902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb1727-5657-4053-835b-5a434c97c415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:11.854743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb1727-5657-4053-835b-5a434c97c415 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:11.855164 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb1727-5657-4053-835b-5a434c97c415 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:11.855532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb1727-5657-4053-835b-5a434c97c415 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:11.856275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb1727-5657-4053-835b-5a434c97c415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:11.858552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb1727-5657-4053-835b-5a434c97c415 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:11.868571 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 959/1897] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:12.129882 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ab3c-a1a9-4da8-885f-5b7374abf1b3 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:12.138237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 939/1898] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:11 2022] POST /identity/v3/projects => generated 387 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:12.145201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ab3c-a1a9-4da8-885f-5b7374abf1b3 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:12.247058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b7195-9f90-4691-959e-b114c66609eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:12.248383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b7195-9f90-4691-959e-b114c66609eb admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:12.248383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b7195-9f90-4691-959e-b114c66609eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:12.249022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b7195-9f90-4691-959e-b114c66609eb admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:12.249733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b7195-9f90-4691-959e-b114c66609eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:12.251779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b7195-9f90-4691-959e-b114c66609eb admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:12.380698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:12.386378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 960/1899] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:12 2022] POST /identity/v3/users => generated 294 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:12.390469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb1727-5657-4053-835b-5a434c97c415 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:12.401981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb1727-5657-4053-835b-5a434c97c415 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:12.431238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970619f-669f-4f8a-b469-03c8e698a1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:12.433714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970619f-669f-4f8a-b469-03c8e698a1fe admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:12.434075 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970619f-669f-4f8a-b469-03c8e698a1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:12.435095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970619f-669f-4f8a-b469-03c8e698a1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:12.435827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970619f-669f-4f8a-b469-03c8e698a1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:12.439013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970619f-669f-4f8a-b469-03c8e698a1fe admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:12.457774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 940/1900] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:12.459256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b7195-9f90-4691-959e-b114c66609eb admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:12.475266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b7195-9f90-4691-959e-b114c66609eb admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:12.480904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037b171-f9ef-4178-bdcb-93c6962504cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:12.481528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037b171-f9ef-4178-bdcb-93c6962504cf admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:12.481814 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037b171-f9ef-4178-bdcb-93c6962504cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:12.482089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037b171-f9ef-4178-bdcb-93c6962504cf admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:12.482897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037b171-f9ef-4178-bdcb-93c6962504cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:12.484535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037b171-f9ef-4178-bdcb-93c6962504cf admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:12.489800 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970619f-669f-4f8a-b469-03c8e698a1fe admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:12.492380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3970619f-669f-4f8a-b469-03c8e698a1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:12.500945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 961/1901] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:12.502513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037b171-f9ef-4178-bdcb-93c6962504cf admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:12.512358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970619f-669f-4f8a-b469-03c8e698a1fe admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:12.520426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:12.521399 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:12.521889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:12.522367 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e admin admin] PATH_INFO: `/v3/projects/81022f4887b4454a8aee47764ee25817` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:12.523390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037b171-f9ef-4178-bdcb-93c6962504cf admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:12.524893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=81022f4887b4454a8aee47764ee25817)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:12.527174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:12.534698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a28fcf-f615-4478-99b2-240dc67aa21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:12.537532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a28fcf-f615-4478-99b2-240dc67aa21a admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:12.537532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a28fcf-f615-4478-99b2-240dc67aa21a admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:12.537771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a28fcf-f615-4478-99b2-240dc67aa21a admin admin] PATH_INFO: `/v3/projects/61e60db74c584310a4c153b11128d3d1/users/b844eb3741de4cae9de388b5773aad7c/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:12.570444 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a28fcf-f615-4478-99b2-240dc67aa21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e60db74c584310a4c153b11128d3d1, user_id=b844eb3741de4cae9de388b5773aad7c, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:12.574436 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a28fcf-f615-4478-99b2-240dc67aa21a admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:12.693870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 962/1902] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:12 2022] PUT /identity/v3/projects/61e60db74c584310a4c153b11128d3d1/users/b844eb3741de4cae9de388b5773aad7c/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:12.712714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81084c0-2b09-4e2b-b1e5-90180f670829 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:12.712714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81084c0-2b09-4e2b-b1e5-90180f670829 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:12.712714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81084c0-2b09-4e2b-b1e5-90180f670829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:12.735290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81022f4887b4454a8aee47764ee25817', 'request_id': 'req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:12.754275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81022f4887b4454a8aee47764ee25817', 'request_id': 'req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:12.762754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81022f4887b4454a8aee47764ee25817', 'request_id': 'req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:12.801332 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d81084c0-2b09-4e2b-b1e5-90180f670829 None None] MFA Rules not processed for user `b844eb3741de4cae9de388b5773aad7c`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:12.802843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d81084c0-2b09-4e2b-b1e5-90180f670829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:12.884882 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 963/1903] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:12.891438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81084c0-2b09-4e2b-b1e5-90180f670829 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:12.913896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e admin admin] The token cache is being invalidate because project 81022f4887b4454a8aee47764ee25817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:12.914305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:12.915150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-92f5a1c9-3c32-496b-a87b-57cd336a7d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:12.917041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 941/1904] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:12 2022] DELETE /identity/v3/projects/81022f4887b4454a8aee47764ee25817 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:12.921564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a62eff-7f78-463c-b6e1-1cef6c7aceea None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:12.922805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a62eff-7f78-463c-b6e1-1cef6c7aceea None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:12.923215 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a62eff-7f78-463c-b6e1-1cef6c7aceea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:12.952178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-70a62eff-7f78-463c-b6e1-1cef6c7aceea None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:12.953432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-70a62eff-7f78-463c-b6e1-1cef6c7aceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:12.991274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81084c0-2b09-4e2b-b1e5-90180f670829 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:12.997582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c361b-7828-4c61-bc5e-60a49cccc167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:12.998203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c361b-7828-4c61-bc5e-60a49cccc167 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:12.998485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c361b-7828-4c61-bc5e-60a49cccc167 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:12.998760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c361b-7828-4c61-bc5e-60a49cccc167 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:12.999428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c361b-7828-4c61-bc5e-60a49cccc167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.001346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c361b-7828-4c61-bc5e-60a49cccc167 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:13.017925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 942/1905] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:13.025673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd052-4b57-4a24-a4c5-b8780b43330f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.025974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd052-4b57-4a24-a4c5-b8780b43330f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.026248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd052-4b57-4a24-a4c5-b8780b43330f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.046773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a45cd052-4b57-4a24-a4c5-b8780b43330f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:13.048082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a45cd052-4b57-4a24-a4c5-b8780b43330f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:13.057527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 943/1906] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:13.061834 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd052-4b57-4a24-a4c5-b8780b43330f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:13.071288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd052-4b57-4a24-a4c5-b8780b43330f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:13.076367 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67f27f-6003-44b8-9584-ecb2a3ebe2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:13.076939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67f27f-6003-44b8-9584-ecb2a3ebe2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.077224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67f27f-6003-44b8-9584-ecb2a3ebe2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.077501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67f27f-6003-44b8-9584-ecb2a3ebe2d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.078182 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67f27f-6003-44b8-9584-ecb2a3ebe2d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:13.078488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67f27f-6003-44b8-9584-ecb2a3ebe2d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.080128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67f27f-6003-44b8-9584-ecb2a3ebe2d8 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:13.092238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 944/1907] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:57:13.097119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67f27f-6003-44b8-9584-ecb2a3ebe2d8 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:13.111243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67f27f-6003-44b8-9584-ecb2a3ebe2d8 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:13.113445 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2bf1b-89e7-4057-8730-8eb22d93e32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:13.114060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2bf1b-89e7-4057-8730-8eb22d93e32d admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.114339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2bf1b-89e7-4057-8730-8eb22d93e32d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.114610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2bf1b-89e7-4057-8730-8eb22d93e32d admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.115346 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2bf1b-89e7-4057-8730-8eb22d93e32d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.117375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2bf1b-89e7-4057-8730-8eb22d93e32d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:13.121877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 964/1908] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:12 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:13.128587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c361b-7828-4c61-bc5e-60a49cccc167 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:13.130272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-828c361b-7828-4c61-bc5e-60a49cccc167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:13.208509 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c361b-7828-4c61-bc5e-60a49cccc167 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:13.216923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5521644-0f96-474e-93b0-df5922eca2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:13.217542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5521644-0f96-474e-93b0-df5922eca2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.217829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5521644-0f96-474e-93b0-df5922eca2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.218104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5521644-0f96-474e-93b0-df5922eca2d3 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.218948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5521644-0f96-474e-93b0-df5922eca2d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.228548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 945/1909] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:13 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:13.233934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2bf1b-89e7-4057-8730-8eb22d93e32d admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:13.238032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5521644-0f96-474e-93b0-df5922eca2d3 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:13.319142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2bf1b-89e7-4057-8730-8eb22d93e32d admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:13.341020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e55c5-a4e7-4ce4-baca-f65c2025dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:13.342272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e55c5-a4e7-4ce4-baca-f65c2025dfca admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.342561 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e55c5-a4e7-4ce4-baca-f65c2025dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.343026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e55c5-a4e7-4ce4-baca-f65c2025dfca admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.344537 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e55c5-a4e7-4ce4-baca-f65c2025dfca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.351940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e55c5-a4e7-4ce4-baca-f65c2025dfca admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:13.369821 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 965/1910] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:13 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:13.371215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5521644-0f96-474e-93b0-df5922eca2d3 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:13.401907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5521644-0f96-474e-93b0-df5922eca2d3 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:13.408507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01421f4b-afb8-4458-9d8a-a38e4ab7d506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:13.409885 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01421f4b-afb8-4458-9d8a-a38e4ab7d506 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.410169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01421f4b-afb8-4458-9d8a-a38e4ab7d506 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.410446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01421f4b-afb8-4458-9d8a-a38e4ab7d506 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.411269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01421f4b-afb8-4458-9d8a-a38e4ab7d506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.413570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01421f4b-afb8-4458-9d8a-a38e4ab7d506 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:13.424056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 966/1911] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:13.428605 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01421f4b-afb8-4458-9d8a-a38e4ab7d506 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:13.438997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01421f4b-afb8-4458-9d8a-a38e4ab7d506 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:13.444662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31243076-03ce-4ce2-b754-cdc64c9d9350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:13.446457 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31243076-03ce-4ce2-b754-cdc64c9d9350 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.453189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31243076-03ce-4ce2-b754-cdc64c9d9350 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.453189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31243076-03ce-4ce2-b754-cdc64c9d9350 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.453189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31243076-03ce-4ce2-b754-cdc64c9d9350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.453189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31243076-03ce-4ce2-b754-cdc64c9d9350 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:13.470031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 967/1912] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:13.475348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31243076-03ce-4ce2-b754-cdc64c9d9350 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:13.479475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 946/1913] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:13 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:13.485086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e55c5-a4e7-4ce4-baca-f65c2025dfca admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:13.486528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31243076-03ce-4ce2-b754-cdc64c9d9350 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:13.494255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a13d-7088-490a-ab2a-534a4b8aa4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:13.494959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a13d-7088-490a-ab2a-534a4b8aa4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.495244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a13d-7088-490a-ab2a-534a4b8aa4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.495586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a13d-7088-490a-ab2a-534a4b8aa4c1 admin admin] PATH_INFO: `/v3/projects/802210854d7a4b2bb3edc654b4a07d6a/users/5d5022873d53483fa7eff9910b15b9a2/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.497304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e55c5-a4e7-4ce4-baca-f65c2025dfca admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:13.502648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc6c25-06ea-4e6b-8f29-5499d3325e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:13.503418 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc6c25-06ea-4e6b-8f29-5499d3325e34 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.503751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc6c25-06ea-4e6b-8f29-5499d3325e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.504212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc6c25-06ea-4e6b-8f29-5499d3325e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.505126 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc6c25-06ea-4e6b-8f29-5499d3325e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.506913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc6c25-06ea-4e6b-8f29-5499d3325e34 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:13.511904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5a13d-7088-490a-ab2a-534a4b8aa4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=802210854d7a4b2bb3edc654b4a07d6a, user_id=5d5022873d53483fa7eff9910b15b9a2, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.514572 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5a13d-7088-490a-ab2a-534a4b8aa4c1 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:13.518942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 947/1914] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:13.522458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc6c25-06ea-4e6b-8f29-5499d3325e34 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:13.532578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc6c25-06ea-4e6b-8f29-5499d3325e34 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:13.538060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6fb93-15f8-4b13-878c-a5edfd6a7b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:13.538655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6fb93-15f8-4b13-878c-a5edfd6a7b2c admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.538971 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6fb93-15f8-4b13-878c-a5edfd6a7b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.539246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6fb93-15f8-4b13-878c-a5edfd6a7b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.539877 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6fb93-15f8-4b13-878c-a5edfd6a7b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.541620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6fb93-15f8-4b13-878c-a5edfd6a7b2c admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:13.552677 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 948/1915] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:13.557220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6fb93-15f8-4b13-878c-a5edfd6a7b2c admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:13.567083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6fb93-15f8-4b13-878c-a5edfd6a7b2c admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:13.571821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a199b4-1421-4118-bc9e-20551273f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:13.572492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a199b4-1421-4118-bc9e-20551273f2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.572775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a199b4-1421-4118-bc9e-20551273f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.573051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a199b4-1421-4118-bc9e-20551273f2d3 admin admin] PATH_INFO: `/v3/projects/0c9aef7d2a084a7cad2a232802739f7d/users/e7618d775130406893919641692b81cc/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.590371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a199b4-1421-4118-bc9e-20551273f2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9aef7d2a084a7cad2a232802739f7d, user_id=e7618d775130406893919641692b81cc, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.593128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a199b4-1421-4118-bc9e-20551273f2d3 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:13.611638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 968/1916] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:13 2022] PUT /identity/v3/projects/802210854d7a4b2bb3edc654b4a07d6a/users/5d5022873d53483fa7eff9910b15b9a2/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:13.622104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71749b76-f407-497c-ab96-d34f89898e47 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.622393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71749b76-f407-497c-ab96-d34f89898e47 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.622669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71749b76-f407-497c-ab96-d34f89898e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.667294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-71749b76-f407-497c-ab96-d34f89898e47 None None] MFA Rules not processed for user `5d5022873d53483fa7eff9910b15b9a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:13.668454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-71749b76-f407-497c-ab96-d34f89898e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:13.691006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 949/1917] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:13 2022] PUT /identity/v3/projects/0c9aef7d2a084a7cad2a232802739f7d/users/e7618d775130406893919641692b81cc/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:13.692280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eff7fa-353a-4a7e-b306-bbd37a9c0667 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.692568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eff7fa-353a-4a7e-b306-bbd37a9c0667 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.692845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eff7fa-353a-4a7e-b306-bbd37a9c0667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.724274 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-72eff7fa-353a-4a7e-b306-bbd37a9c0667 None None] MFA Rules not processed for user `e7618d775130406893919641692b81cc`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:13.725890 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-72eff7fa-353a-4a7e-b306-bbd37a9c0667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:13.776990 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 969/1918] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:13.781592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71749b76-f407-497c-ab96-d34f89898e47 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:13.821429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 950/1919] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:13.822395 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eff7fa-353a-4a7e-b306-bbd37a9c0667 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:13.871546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71749b76-f407-497c-ab96-d34f89898e47 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:13.899515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eff7fa-353a-4a7e-b306-bbd37a9c0667 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:13.905470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf73cc-c5b7-4d77-ac78-07181ec5334d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:13.906091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf73cc-c5b7-4d77-ac78-07181ec5334d admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.906374 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf73cc-c5b7-4d77-ac78-07181ec5334d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.906651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf73cc-c5b7-4d77-ac78-07181ec5334d admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.907394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf73cc-c5b7-4d77-ac78-07181ec5334d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.909344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf73cc-c5b7-4d77-ac78-07181ec5334d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:13.952695 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51122b2-8a72-44fb-9ca6-643dc7307111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:13.953342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51122b2-8a72-44fb-9ca6-643dc7307111 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:13.953620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51122b2-8a72-44fb-9ca6-643dc7307111 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:13.953888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51122b2-8a72-44fb-9ca6-643dc7307111 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:13.954526 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51122b2-8a72-44fb-9ca6-643dc7307111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:13.957393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51122b2-8a72-44fb-9ca6-643dc7307111 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:14.015946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 951/1920] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:13 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:14.020486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf73cc-c5b7-4d77-ac78-07181ec5334d admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:14.041487 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 970/1921] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:13 2022] POST /identity/v3/projects => generated 387 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:14.045682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51122b2-8a72-44fb-9ca6-643dc7307111 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:14.090760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf73cc-c5b7-4d77-ac78-07181ec5334d admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:14.130377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51122b2-8a72-44fb-9ca6-643dc7307111 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:14.135438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f80841-f1da-42e4-ac12-f4c4c67a25d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:14.136197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f80841-f1da-42e4-ac12-f4c4c67a25d0 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.136477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f80841-f1da-42e4-ac12-f4c4c67a25d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.137393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f80841-f1da-42e4-ac12-f4c4c67a25d0 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.137393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f80841-f1da-42e4-ac12-f4c4c67a25d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:14.139519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f80841-f1da-42e4-ac12-f4c4c67a25d0 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:14.163242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58d359-e741-40b6-ac1f-fcb898417499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:14.164743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58d359-e741-40b6-ac1f-fcb898417499 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.165021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58d359-e741-40b6-ac1f-fcb898417499 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.165293 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58d359-e741-40b6-ac1f-fcb898417499 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.166502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58d359-e741-40b6-ac1f-fcb898417499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:14.168213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58d359-e741-40b6-ac1f-fcb898417499 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:14.211292 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 971/1922] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:14 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:14.214996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f80841-f1da-42e4-ac12-f4c4c67a25d0 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:14.224946 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f80841-f1da-42e4-ac12-f4c4c67a25d0 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:14.229787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aca5c-4a06-4f27-9455-a2064dea82f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:14.236447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aca5c-4a06-4f27-9455-a2064dea82f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.236447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aca5c-4a06-4f27-9455-a2064dea82f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.236447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aca5c-4a06-4f27-9455-a2064dea82f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.236447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0aca5c-4a06-4f27-9455-a2064dea82f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:14.236447 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0aca5c-4a06-4f27-9455-a2064dea82f0 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:14.245054 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 972/1923] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:14.249075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aca5c-4a06-4f27-9455-a2064dea82f0 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:14.259023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aca5c-4a06-4f27-9455-a2064dea82f0 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:14.262029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 952/1924] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:14 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:14.263678 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a2132-e282-45f1-8124-63788cc809d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:14.266751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a2132-e282-45f1-8124-63788cc809d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.266751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a2132-e282-45f1-8124-63788cc809d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.266751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a2132-e282-45f1-8124-63788cc809d9 admin admin] PATH_INFO: `/v3/projects/ad9383a42b6f4e28ad72cb82c7efeef5/users/7e2a94c929b54b6c9bd2a055ae752515/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.269625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58d359-e741-40b6-ac1f-fcb898417499 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:14.281133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58d359-e741-40b6-ac1f-fcb898417499 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:14.281348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a2132-e282-45f1-8124-63788cc809d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9383a42b6f4e28ad72cb82c7efeef5, user_id=7e2a94c929b54b6c9bd2a055ae752515, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:14.284082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a2132-e282-45f1-8124-63788cc809d9 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:14.286824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7508f4c-ca40-48b2-ba0b-a8c232aa4e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:14.287472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7508f4c-ca40-48b2-ba0b-a8c232aa4e1e admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.287778 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7508f4c-ca40-48b2-ba0b-a8c232aa4e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.288033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7508f4c-ca40-48b2-ba0b-a8c232aa4e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.288727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7508f4c-ca40-48b2-ba0b-a8c232aa4e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:14.293881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7508f4c-ca40-48b2-ba0b-a8c232aa4e1e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:14.303762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 953/1925] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:14.307611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7508f4c-ca40-48b2-ba0b-a8c232aa4e1e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:14.314438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:14.317704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7508f4c-ca40-48b2-ba0b-a8c232aa4e1e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:14.322694 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b16c1-0f14-4d68-b197-b429dd1cbc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:14.323332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b16c1-0f14-4d68-b197-b429dd1cbc1c admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.324152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b16c1-0f14-4d68-b197-b429dd1cbc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.324152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b16c1-0f14-4d68-b197-b429dd1cbc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.324517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b16c1-0f14-4d68-b197-b429dd1cbc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:14.326307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b16c1-0f14-4d68-b197-b429dd1cbc1c admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:14.336957 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 954/1926] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:14.341022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b16c1-0f14-4d68-b197-b429dd1cbc1c admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:14.351207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b16c1-0f14-4d68-b197-b429dd1cbc1c admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:14.355870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f22d9-77e8-4a5b-95a9-893859803255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:14.356509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f22d9-77e8-4a5b-95a9-893859803255 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.356817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f22d9-77e8-4a5b-95a9-893859803255 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.357094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f22d9-77e8-4a5b-95a9-893859803255 admin admin] PATH_INFO: `/v3/projects/792875ddb5844c5db5b316012df0c60f/users/9de75fc55c354253b7baa34502e32954/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.371520 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f22d9-77e8-4a5b-95a9-893859803255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=792875ddb5844c5db5b316012df0c60f, user_id=9de75fc55c354253b7baa34502e32954, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:14.374147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f22d9-77e8-4a5b-95a9-893859803255 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:14.393857 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 973/1927] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:14 2022] PUT /identity/v3/projects/ad9383a42b6f4e28ad72cb82c7efeef5/users/7e2a94c929b54b6c9bd2a055ae752515/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:14.397686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a2132-e282-45f1-8124-63788cc809d9 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:14.464314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 955/1928] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:14 2022] PUT /identity/v3/projects/792875ddb5844c5db5b316012df0c60f/users/9de75fc55c354253b7baa34502e32954/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:14.478572 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a2132-e282-45f1-8124-63788cc809d9 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:14.481400 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f0b5e-12da-4496-868f-0da8f61e8ff7 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.481693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f0b5e-12da-4496-868f-0da8f61e8ff7 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.481969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f0b5e-12da-4496-868f-0da8f61e8ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.517928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-ac6f0b5e-12da-4496-868f-0da8f61e8ff7 None None] MFA Rules not processed for user `9de75fc55c354253b7baa34502e32954`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:14.519604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ac6f0b5e-12da-4496-868f-0da8f61e8ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:14.555977 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b2927-91c3-4329-853a-928802d18a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:14.556641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b2927-91c3-4329-853a-928802d18a92 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.556924 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b2927-91c3-4329-853a-928802d18a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.557192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b2927-91c3-4329-853a-928802d18a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.557860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b2927-91c3-4329-853a-928802d18a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:14.559549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b2927-91c3-4329-853a-928802d18a92 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:14.569774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 974/1929] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:14.573638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b2927-91c3-4329-853a-928802d18a92 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:14.585252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b2927-91c3-4329-853a-928802d18a92 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:14.604735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0f390-c7de-4e3c-a97b-d48ffa1fd67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:14.605422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0f390-c7de-4e3c-a97b-d48ffa1fd67b admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.605698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0f390-c7de-4e3c-a97b-d48ffa1fd67b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.605966 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0f390-c7de-4e3c-a97b-d48ffa1fd67b admin admin] PATH_INFO: `/v3/projects/ad9383a42b6f4e28ad72cb82c7efeef5/users/7e2a94c929b54b6c9bd2a055ae752515/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.608015 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0f390-c7de-4e3c-a97b-d48ffa1fd67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9383a42b6f4e28ad72cb82c7efeef5, user_id=7e2a94c929b54b6c9bd2a055ae752515, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:14.610841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0f390-c7de-4e3c-a97b-d48ffa1fd67b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:14.619882 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 956/1930] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:14.629891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 975/1931] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:14 2022] PUT /identity/v3/projects/ad9383a42b6f4e28ad72cb82c7efeef5/users/7e2a94c929b54b6c9bd2a055ae752515/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:14.635595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f0b5e-12da-4496-868f-0da8f61e8ff7 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:14.640708 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df653-f04e-43a8-ba76-d85e46af2b14 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.640991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df653-f04e-43a8-ba76-d85e46af2b14 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.641270 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df653-f04e-43a8-ba76-d85e46af2b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.653001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f0b5e-12da-4496-868f-0da8f61e8ff7 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:14.682807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-b60df653-f04e-43a8-ba76-d85e46af2b14 None None] MFA Rules not processed for user `7e2a94c929b54b6c9bd2a055ae752515`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:14.684093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b60df653-f04e-43a8-ba76-d85e46af2b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:14.710741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:14.752827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c214d-cf85-4db7-9d02-e400ab868019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:14.756196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c214d-cf85-4db7-9d02-e400ab868019 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.759109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c214d-cf85-4db7-9d02-e400ab868019 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.759316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c214d-cf85-4db7-9d02-e400ab868019 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.760005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c214d-cf85-4db7-9d02-e400ab868019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:14.762035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c214d-cf85-4db7-9d02-e400ab868019 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:14.789930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 976/1932] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:14.847306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60df653-f04e-43a8-ba76-d85e46af2b14 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:14.849150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b60df653-f04e-43a8-ba76-d85e46af2b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:14.917321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60df653-f04e-43a8-ba76-d85e46af2b14 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:14.921173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193efc1-7b32-4d24-a450-c3f0ebb386bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:14.921795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193efc1-7b32-4d24-a450-c3f0ebb386bd service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:14.922071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193efc1-7b32-4d24-a450-c3f0ebb386bd service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:14.922343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193efc1-7b32-4d24-a450-c3f0ebb386bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:14.934012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193efc1-7b32-4d24-a450-c3f0ebb386bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:14.935944 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193efc1-7b32-4d24-a450-c3f0ebb386bd service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:14.943068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 957/1933] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:14 2022] POST /identity/v3/projects => generated 375 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:14.945976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c214d-cf85-4db7-9d02-e400ab868019 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:14.947803 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 977/1934] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:15.046999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c214d-cf85-4db7-9d02-e400ab868019 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:15.046999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ac2f1-57af-45e3-8af1-6a0c218a3a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:15.046999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ac2f1-57af-45e3-8af1-6a0c218a3a92 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:15.046999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ac2f1-57af-45e3-8af1-6a0c218a3a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:15.047464 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ac2f1-57af-45e3-8af1-6a0c218a3a92 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:15.047560 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ac2f1-57af-45e3-8af1-6a0c218a3a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:15.049559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ac2f1-57af-45e3-8af1-6a0c218a3a92 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:15.124335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 958/1935] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:14 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:15.128401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193efc1-7b32-4d24-a450-c3f0ebb386bd service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:15.138654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193efc1-7b32-4d24-a450-c3f0ebb386bd service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:15.143771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087bb9f-df95-4672-92f0-521d420554f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:15.144402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087bb9f-df95-4672-92f0-521d420554f3 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:15.144663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087bb9f-df95-4672-92f0-521d420554f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:15.144917 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087bb9f-df95-4672-92f0-521d420554f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:15.145562 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087bb9f-df95-4672-92f0-521d420554f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:15.147178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087bb9f-df95-4672-92f0-521d420554f3 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:15.157158 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 978/1936] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:15.161948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ac2f1-57af-45e3-8af1-6a0c218a3a92 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:15.171850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ac2f1-57af-45e3-8af1-6a0c218a3a92 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:15.176483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80330edf-c522-44af-b637-41fdfc3f784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:15.177154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80330edf-c522-44af-b637-41fdfc3f784a admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:15.177433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80330edf-c522-44af-b637-41fdfc3f784a admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:15.177708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80330edf-c522-44af-b637-41fdfc3f784a admin admin] PATH_INFO: `/v3/projects/4ecc3efb53444c7dac461d0277590b6d/users/16e34697d88540cbaed285acc4a8e539/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:15.196762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80330edf-c522-44af-b637-41fdfc3f784a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ecc3efb53444c7dac461d0277590b6d, user_id=16e34697d88540cbaed285acc4a8e539, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:15.199564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80330edf-c522-44af-b637-41fdfc3f784a admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:15.277746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 959/1937] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:15 2022] PUT /identity/v3/projects/4ecc3efb53444c7dac461d0277590b6d/users/16e34697d88540cbaed285acc4a8e539/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:15.280593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087bb9f-df95-4672-92f0-521d420554f3 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:15.293711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087bb9f-df95-4672-92f0-521d420554f3 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:15.388594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8061c-14e7-4eca-8404-a6d97eab10c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:15.389984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8061c-14e7-4eca-8404-a6d97eab10c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:15.390307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8061c-14e7-4eca-8404-a6d97eab10c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:15.390648 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8061c-14e7-4eca-8404-a6d97eab10c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:15.391386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8061c-14e7-4eca-8404-a6d97eab10c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:15.393124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8061c-14e7-4eca-8404-a6d97eab10c7 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:15.406636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 979/1938] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:15.410699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80330edf-c522-44af-b637-41fdfc3f784a admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:15.428477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80330edf-c522-44af-b637-41fdfc3f784a admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:15.446604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73908bdf-1dfe-4450-a0d8-f9417d5ef6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:15.447330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73908bdf-1dfe-4450-a0d8-f9417d5ef6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:15.447615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73908bdf-1dfe-4450-a0d8-f9417d5ef6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:15.447895 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73908bdf-1dfe-4450-a0d8-f9417d5ef6d4 admin admin] PATH_INFO: `/v3/projects/4ecc3efb53444c7dac461d0277590b6d/users/16e34697d88540cbaed285acc4a8e539/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:15.450718 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73908bdf-1dfe-4450-a0d8-f9417d5ef6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ecc3efb53444c7dac461d0277590b6d, user_id=16e34697d88540cbaed285acc4a8e539, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:15.452935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73908bdf-1dfe-4450-a0d8-f9417d5ef6d4 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:15.464671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 960/1939] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:15 2022] PUT /identity/v3/projects/4ecc3efb53444c7dac461d0277590b6d/users/16e34697d88540cbaed285acc4a8e539/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:15.474848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbc581-6f70-43e7-bed8-1fad129a5dee None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:15.475202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbc581-6f70-43e7-bed8-1fad129a5dee None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:15.484760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbc581-6f70-43e7-bed8-1fad129a5dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:15.506614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-0fcbc581-6f70-43e7-bed8-1fad129a5dee None None] MFA Rules not processed for user `16e34697d88540cbaed285acc4a8e539`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:15.507989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0fcbc581-6f70-43e7-bed8-1fad129a5dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:15.552915 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:15.585493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 980/1940] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:15.647226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73908bdf-1dfe-4450-a0d8-f9417d5ef6d4 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:15.704958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73908bdf-1dfe-4450-a0d8-f9417d5ef6d4 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:15.708795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee2e3f-8ee0-4127-92e3-05e433e2bd62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:15.709408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee2e3f-8ee0-4127-92e3-05e433e2bd62 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:15.709695 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee2e3f-8ee0-4127-92e3-05e433e2bd62 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:15.710277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee2e3f-8ee0-4127-92e3-05e433e2bd62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:15.773080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee2e3f-8ee0-4127-92e3-05e433e2bd62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:15.774649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee2e3f-8ee0-4127-92e3-05e433e2bd62 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:15.785286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 961/1941] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:16.486409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:17.098298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbc581-6f70-43e7-bed8-1fad129a5dee None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:17.099725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0fcbc581-6f70-43e7-bed8-1fad129a5dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:17.111753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbc581-6f70-43e7-bed8-1fad129a5dee None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:17.115751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd449c-84dc-4dce-ba47-8342a7df089b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:17.116363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd449c-84dc-4dce-ba47-8342a7df089b service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:17.116703 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd449c-84dc-4dce-ba47-8342a7df089b service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:17.116998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd449c-84dc-4dce-ba47-8342a7df089b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:17.118804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1abd449c-84dc-4dce-ba47-8342a7df089b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:17.176568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd449c-84dc-4dce-ba47-8342a7df089b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:17.177996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd449c-84dc-4dce-ba47-8342a7df089b service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:17.186658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 981/1942] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:17.637765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:18.317772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee2e3f-8ee0-4127-92e3-05e433e2bd62 service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:18.326342 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee2e3f-8ee0-4127-92e3-05e433e2bd62 service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:18.330117 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db2443-2f86-4ee2-a5f0-f20adc1931a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:18.330660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2443-2f86-4ee2-a5f0-f20adc1931a2 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:18.331004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2443-2f86-4ee2-a5f0-f20adc1931a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:18.331283 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2443-2f86-4ee2-a5f0-f20adc1931a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:18.393717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db2443-2f86-4ee2-a5f0-f20adc1931a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:18.395249 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db2443-2f86-4ee2-a5f0-f20adc1931a2 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:18.404779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 962/1943] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:18.662889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd449c-84dc-4dce-ba47-8342a7df089b service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:18.664820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1abd449c-84dc-4dce-ba47-8342a7df089b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:18.745191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd449c-84dc-4dce-ba47-8342a7df089b service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:18.750324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:18.751153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:18.751495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:18.751780 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] PATH_INFO: `/v3/users/dd6cd94c44884a76808e900062ed4388` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:18.753641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6cd94c44884a76808e900062ed4388)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:18.755730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:18.820201 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:19.003863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6cd94c44884a76808e900062ed4388'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:19.016475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6cd94c44884a76808e900062ed4388'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:19.023373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6cd94c44884a76808e900062ed4388'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:19.028227 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6cd94c44884a76808e900062ed4388'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:19.028227 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6cd94c44884a76808e900062ed4388'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:19.155025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 982/1944] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:18 2022] DELETE /identity/v3/users/dd6cd94c44884a76808e900062ed4388 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:19.159913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fc3e2-cbd5-4ebe-b336-4e4cd5e15121 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:19.160201 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fc3e2-cbd5-4ebe-b336-4e4cd5e15121 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:19.160477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fc3e2-cbd5-4ebe-b336-4e4cd5e15121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:19.181423 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-e97fc3e2-cbd5-4ebe-b336-4e4cd5e15121 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:19.182611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e97fc3e2-cbd5-4ebe-b336-4e4cd5e15121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:19.192062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:19.244771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 963/1945] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:19.255451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:19.257760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:19.316195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0040df-ce02-4996-9c23-45f14477220e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:19.320170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b18c56-29bb-4497-b196-56b812bba692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:19.320777 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b18c56-29bb-4497-b196-56b812bba692 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:19.321108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b18c56-29bb-4497-b196-56b812bba692 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:19.321389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b18c56-29bb-4497-b196-56b812bba692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:19.330338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b18c56-29bb-4497-b196-56b812bba692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:19.332378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b18c56-29bb-4497-b196-56b812bba692 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:19.342454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 983/1946] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:19.738463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fc3e2-cbd5-4ebe-b336-4e4cd5e15121 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:19.740628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e97fc3e2-cbd5-4ebe-b336-4e4cd5e15121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:19.753684 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fc3e2-cbd5-4ebe-b336-4e4cd5e15121 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:19.758530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:19.759226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:19.759507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:19.763815 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] PATH_INFO: `/v3/projects/562e4ced57d0427fa65793161c14fda5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:19.763815 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] RBAC: Authorizing `identity:delete_project(project_id=562e4ced57d0427fa65793161c14fda5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:19.763815 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:19.933969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562e4ced57d0427fa65793161c14fda5', 'request_id': 'req-e48e0b04-f146-4f7c-a5aa-e4d10980628b'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:19.939414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562e4ced57d0427fa65793161c14fda5', 'request_id': 'req-e48e0b04-f146-4f7c-a5aa-e4d10980628b'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:19.946239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562e4ced57d0427fa65793161c14fda5', 'request_id': 'req-e48e0b04-f146-4f7c-a5aa-e4d10980628b'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:20.053902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] The token cache is being invalidate because project 562e4ced57d0427fa65793161c14fda5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:20.054195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:20.055178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:20.056761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 964/1947] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:19 2022] DELETE /identity/v3/projects/562e4ced57d0427fa65793161c14fda5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:20.061090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b18c56-29bb-4497-b196-56b812bba692 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:20.071977 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b18c56-29bb-4497-b196-56b812bba692 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:20.107708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:20.109896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:20.137888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14b8e0-e008-459d-90b1-e77c6304aade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:20.138559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14b8e0-e008-459d-90b1-e77c6304aade admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:20.138845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14b8e0-e008-459d-90b1-e77c6304aade admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:20.139210 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14b8e0-e008-459d-90b1-e77c6304aade admin admin] PATH_INFO: `/v3/users/cdc7ca25084348a8a12c124a329ec35c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:20.140430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14b8e0-e008-459d-90b1-e77c6304aade admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc7ca25084348a8a12c124a329ec35c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:20.142396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14b8e0-e008-459d-90b1-e77c6304aade admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:20.181011 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e0b04-f146-4f7c-a5aa-e4d10980628b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:20.185007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e573e-ef87-4bb6-8232-b32ae0dbfdf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:20.185562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e573e-ef87-4bb6-8232-b32ae0dbfdf9 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:20.185844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e573e-ef87-4bb6-8232-b32ae0dbfdf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:20.186118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e573e-ef87-4bb6-8232-b32ae0dbfdf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:20.187915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-138e573e-ef87-4bb6-8232-b32ae0dbfdf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:20.256590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e573e-ef87-4bb6-8232-b32ae0dbfdf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:20.258044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e573e-ef87-4bb6-8232-b32ae0dbfdf9 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:20.268672 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 965/1948] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:20.335347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bb14b8e0-e008-459d-90b1-e77c6304aade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc7ca25084348a8a12c124a329ec35c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:20.348912 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bb14b8e0-e008-459d-90b1-e77c6304aade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc7ca25084348a8a12c124a329ec35c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:20.356735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bb14b8e0-e008-459d-90b1-e77c6304aade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc7ca25084348a8a12c124a329ec35c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:20.357483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bb14b8e0-e008-459d-90b1-e77c6304aade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc7ca25084348a8a12c124a329ec35c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:20.358113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bb14b8e0-e008-459d-90b1-e77c6304aade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc7ca25084348a8a12c124a329ec35c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:20.433122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 984/1949] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:20 2022] DELETE /identity/v3/users/cdc7ca25084348a8a12c124a329ec35c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:20.456423 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:20.747983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:20.921942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e573e-ef87-4bb6-8232-b32ae0dbfdf9 service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:20.921942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-138e573e-ef87-4bb6-8232-b32ae0dbfdf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:20.950696 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e573e-ef87-4bb6-8232-b32ae0dbfdf9 service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:21.035636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:21.036729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:21.036729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:21.037010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6 admin admin] PATH_INFO: `/v3/projects/86df269a289e43818d667e5dafc898cf` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:21.038192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86df269a289e43818d667e5dafc898cf)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:21.040189 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:21.174626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86df269a289e43818d667e5dafc898cf', 'request_id': 'req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:21.180882 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86df269a289e43818d667e5dafc898cf', 'request_id': 'req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:21.188964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86df269a289e43818d667e5dafc898cf', 'request_id': 'req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:21.287079 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6 admin admin] The token cache is being invalidate because project 86df269a289e43818d667e5dafc898cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:21.287449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:21.288201 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9a1ce6f7-5965-4560-9ca0-ec34c7f3f0a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:21.299803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 966/1950] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:20 2022] DELETE /identity/v3/projects/86df269a289e43818d667e5dafc898cf => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:21.305506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b1df5-132c-4cdb-a11a-6d44f2c55238 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:21.306699 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b1df5-132c-4cdb-a11a-6d44f2c55238 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:21.307261 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b1df5-132c-4cdb-a11a-6d44f2c55238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:21.337213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-924b1df5-132c-4cdb-a11a-6d44f2c55238 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:21.338922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-924b1df5-132c-4cdb-a11a-6d44f2c55238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:21.486988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 985/1951] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:21.495718 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18581d-1d98-41c5-8d9b-74000cc2a261 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:21.496178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18581d-1d98-41c5-8d9b-74000cc2a261 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:21.496607 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18581d-1d98-41c5-8d9b-74000cc2a261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:21.522631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-ff18581d-1d98-41c5-8d9b-74000cc2a261 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:21.524013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ff18581d-1d98-41c5-8d9b-74000cc2a261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:21.532297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 967/1952] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:21.537933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b1df5-132c-4cdb-a11a-6d44f2c55238 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:21.548994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b1df5-132c-4cdb-a11a-6d44f2c55238 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:21.554494 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece60085-98c6-400d-9c10-4aa045a66e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:21.555439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60085-98c6-400d-9c10-4aa045a66e10 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:21.555722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60085-98c6-400d-9c10-4aa045a66e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:21.555995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60085-98c6-400d-9c10-4aa045a66e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:21.556669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece60085-98c6-400d-9c10-4aa045a66e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:21.560287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece60085-98c6-400d-9c10-4aa045a66e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:21.560287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece60085-98c6-400d-9c10-4aa045a66e10 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:21.571984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 986/1953] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:57:21.576650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18581d-1d98-41c5-8d9b-74000cc2a261 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:21.587322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18581d-1d98-41c5-8d9b-74000cc2a261 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:21.592122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b61c98-e8b3-4764-917c-5691b8bd5345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:21.592726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b61c98-e8b3-4764-917c-5691b8bd5345 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:21.593003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b61c98-e8b3-4764-917c-5691b8bd5345 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:21.593272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b61c98-e8b3-4764-917c-5691b8bd5345 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:21.593926 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b61c98-e8b3-4764-917c-5691b8bd5345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:21.595843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b61c98-e8b3-4764-917c-5691b8bd5345 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:21.710606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 968/1954] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:21 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:21.712490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece60085-98c6-400d-9c10-4aa045a66e10 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:21.723709 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece60085-98c6-400d-9c10-4aa045a66e10 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:21.788902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442e543-3b87-4eb0-94b9-f5a5b5c0aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:21.789616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442e543-3b87-4eb0-94b9-f5a5b5c0aa85 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:21.789973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442e543-3b87-4eb0-94b9-f5a5b5c0aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:21.790334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442e543-3b87-4eb0-94b9-f5a5b5c0aa85 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:21.791101 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442e543-3b87-4eb0-94b9-f5a5b5c0aa85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:21.795647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442e543-3b87-4eb0-94b9-f5a5b5c0aa85 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:21.882698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 987/1955] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:21 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:21.891652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b61c98-e8b3-4764-917c-5691b8bd5345 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:21.903326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b61c98-e8b3-4764-917c-5691b8bd5345 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:21.910147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebb6d3-1670-41fa-8bb5-2dcfd693be54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:21.911163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebb6d3-1670-41fa-8bb5-2dcfd693be54 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:21.911451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebb6d3-1670-41fa-8bb5-2dcfd693be54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:21.911733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebb6d3-1670-41fa-8bb5-2dcfd693be54 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:21.912458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebb6d3-1670-41fa-8bb5-2dcfd693be54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:21.918024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebb6d3-1670-41fa-8bb5-2dcfd693be54 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:21.926932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 969/1956] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:21.930309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442e543-3b87-4eb0-94b9-f5a5b5c0aa85 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:21.943059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442e543-3b87-4eb0-94b9-f5a5b5c0aa85 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:21.948056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635aa2c-23aa-4683-888b-bc4f0a532c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:21.948776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635aa2c-23aa-4683-888b-bc4f0a532c3a admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:21.949208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635aa2c-23aa-4683-888b-bc4f0a532c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:21.949577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635aa2c-23aa-4683-888b-bc4f0a532c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:21.950347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635aa2c-23aa-4683-888b-bc4f0a532c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:21.952370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635aa2c-23aa-4683-888b-bc4f0a532c3a admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:21.969317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 988/1957] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:21.970814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebb6d3-1670-41fa-8bb5-2dcfd693be54 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:21.987207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebb6d3-1670-41fa-8bb5-2dcfd693be54 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:21.993015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb827e2-5786-4731-a0c3-0c56b53a8449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:21.993779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb827e2-5786-4731-a0c3-0c56b53a8449 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:21.994226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb827e2-5786-4731-a0c3-0c56b53a8449 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:21.994508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb827e2-5786-4731-a0c3-0c56b53a8449 admin admin] PATH_INFO: `/v3/projects/34dcf47dd901424593f8243019ebd047/users/b121f7c5bed843d1bd31cba4bd7eed35/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:22.010655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb827e2-5786-4731-a0c3-0c56b53a8449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34dcf47dd901424593f8243019ebd047, user_id=b121f7c5bed843d1bd31cba4bd7eed35, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:22.013397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb827e2-5786-4731-a0c3-0c56b53a8449 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:22.079300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:22.170787 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 970/1958] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:21 2022] PUT /identity/v3/projects/34dcf47dd901424593f8243019ebd047/users/b121f7c5bed843d1bd31cba4bd7eed35/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:22.181137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f1454-156b-492e-b71d-421f01394faf None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:22.181424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f1454-156b-492e-b71d-421f01394faf None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:22.181700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f1454-156b-492e-b71d-421f01394faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:22.209904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a47f1454-156b-492e-b71d-421f01394faf None None] MFA Rules not processed for user `b121f7c5bed843d1bd31cba4bd7eed35`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:22.211169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a47f1454-156b-492e-b71d-421f01394faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:22.284258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 989/1959] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:22.295749 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb827e2-5786-4731-a0c3-0c56b53a8449 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:22.299298 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6bb827e2-5786-4731-a0c3-0c56b53a8449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:22.386827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb827e2-5786-4731-a0c3-0c56b53a8449 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:22.391701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97889410-85a8-4e6a-b676-960714337f90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a10328a436c4159b6519e5493ba57f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:22.392524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97889410-85a8-4e6a-b676-960714337f90 service glance] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:22.392898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97889410-85a8-4e6a-b676-960714337f90 service glance] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:22.393269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97889410-85a8-4e6a-b676-960714337f90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:22.403398 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97889410-85a8-4e6a-b676-960714337f90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:22.404821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97889410-85a8-4e6a-b676-960714337f90 service glance] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:22.413752 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 971/1960] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:22.937144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:23.498327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f1454-156b-492e-b71d-421f01394faf None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:23.499747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a47f1454-156b-492e-b71d-421f01394faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:23.555392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f1454-156b-492e-b71d-421f01394faf None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:23.558858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17d289-f944-45d4-b419-99a5070b8a62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:23.559741 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17d289-f944-45d4-b419-99a5070b8a62 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:23.560712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17d289-f944-45d4-b419-99a5070b8a62 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:23.561039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17d289-f944-45d4-b419-99a5070b8a62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:23.562851 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4e17d289-f944-45d4-b419-99a5070b8a62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:23.627628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17d289-f944-45d4-b419-99a5070b8a62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:23.629068 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17d289-f944-45d4-b419-99a5070b8a62 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:23.638711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 990/1961] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:23.725451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:23.971470 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:25.528153 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97889410-85a8-4e6a-b676-960714337f90 service glance] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:25.529686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-97889410-85a8-4e6a-b676-960714337f90 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:25.540245 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:25.610160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97889410-85a8-4e6a-b676-960714337f90 service glance] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:25.614948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:25.615590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:25.615874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:25.616151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] PATH_INFO: `/v3/users/e7618d775130406893919641692b81cc` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:25.617311 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7618d775130406893919641692b81cc)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:25.619403 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:25.821864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7618d775130406893919641692b81cc'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:25.890627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:25.923732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7618d775130406893919641692b81cc'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:25.933093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7618d775130406893919641692b81cc'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:25.933892 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7618d775130406893919641692b81cc'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:25.946068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7618d775130406893919641692b81cc'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:25.951952 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 972/1962] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:25 2022] DELETE /identity/v3/users/e7618d775130406893919641692b81cc => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:25.959871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5f79c-6c05-4c5b-8041-2aaed6ee7ca4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:25.959871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5f79c-6c05-4c5b-8041-2aaed6ee7ca4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:25.959871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5f79c-6c05-4c5b-8041-2aaed6ee7ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:25.978994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e0b5f79c-6c05-4c5b-8041-2aaed6ee7ca4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:25.980251 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e0b5f79c-6c05-4c5b-8041-2aaed6ee7ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:26.040467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 991/1963] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:26.051715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:26.054022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:26.122929 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1fc7b-b0d1-48c3-a07f-9f69870bc854 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:26.126983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db74b4-2a77-4cd8-a90e-e69d4f84c95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:26.127727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db74b4-2a77-4cd8-a90e-e69d4f84c95e service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:26.128010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db74b4-2a77-4cd8-a90e-e69d4f84c95e service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:26.128286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db74b4-2a77-4cd8-a90e-e69d4f84c95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:26.138127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db74b4-2a77-4cd8-a90e-e69d4f84c95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:26.139482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db74b4-2a77-4cd8-a90e-e69d4f84c95e service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:26.150530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 973/1964] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:26.622815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5f79c-6c05-4c5b-8041-2aaed6ee7ca4 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:26.628210 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e0b5f79c-6c05-4c5b-8041-2aaed6ee7ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:26.639034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5f79c-6c05-4c5b-8041-2aaed6ee7ca4 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:26.645240 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:26.645889 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:26.646173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:26.646448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] PATH_INFO: `/v3/projects/0c9aef7d2a084a7cad2a232802739f7d` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:26.647620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9aef7d2a084a7cad2a232802739f7d)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:26.650755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:26.799276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:26.806411 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9aef7d2a084a7cad2a232802739f7d', 'request_id': 'req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:26.812643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9aef7d2a084a7cad2a232802739f7d', 'request_id': 'req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:26.895916 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9aef7d2a084a7cad2a232802739f7d', 'request_id': 'req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:26.908335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] The token cache is being invalidate because project 0c9aef7d2a084a7cad2a232802739f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:26.908629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:26.909395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:26.910966 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 992/1965] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:26 2022] DELETE /identity/v3/projects/0c9aef7d2a084a7cad2a232802739f7d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:26.914995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db74b4-2a77-4cd8-a90e-e69d4f84c95e service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:26.925427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db74b4-2a77-4cd8-a90e-e69d4f84c95e service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:26.984202 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:26.984843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:26.985125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:26.985419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] PATH_INFO: `/v3/users/9de75fc55c354253b7baa34502e32954` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:26.986645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de75fc55c354253b7baa34502e32954)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:26.989196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:27.203148 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de75fc55c354253b7baa34502e32954'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:27.273312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de75fc55c354253b7baa34502e32954'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:27.285440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de75fc55c354253b7baa34502e32954'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:27.287036 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de75fc55c354253b7baa34502e32954'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:27.302334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de75fc55c354253b7baa34502e32954'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:27.308724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 974/1966] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:26 2022] DELETE /identity/v3/users/9de75fc55c354253b7baa34502e32954 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:27.463196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:27.794406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:27.795964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:27.811162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d4e2f-6e53-4004-8fad-94277cdc47a4 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:27.889614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:27.890250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:27.890718 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:27.891179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] PATH_INFO: `/v3/projects/792875ddb5844c5db5b316012df0c60f` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:27.892458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=792875ddb5844c5db5b316012df0c60f)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:27.894584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:28.055505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792875ddb5844c5db5b316012df0c60f', 'request_id': 'req-24662ce2-38ed-44ce-8269-6d24cb1c27a0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.062179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792875ddb5844c5db5b316012df0c60f', 'request_id': 'req-24662ce2-38ed-44ce-8269-6d24cb1c27a0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.147389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792875ddb5844c5db5b316012df0c60f', 'request_id': 'req-24662ce2-38ed-44ce-8269-6d24cb1c27a0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.161210 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] The token cache is being invalidate because project 792875ddb5844c5db5b316012df0c60f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:28.161503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.162166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.163728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 993/1967] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:27 2022] DELETE /identity/v3/projects/792875ddb5844c5db5b316012df0c60f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:28.167835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:28.169323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:28.180139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:28.183993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa377e-7b66-423f-b6e6-6bbe1472858b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:28.239898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a19b8-7f31-462e-ac76-5cee8212dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:28.240544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a19b8-7f31-462e-ac76-5cee8212dc83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:28.240825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a19b8-7f31-462e-ac76-5cee8212dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:28.241093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a19b8-7f31-462e-ac76-5cee8212dc83 admin admin] PATH_INFO: `/v3/users/16e34697d88540cbaed285acc4a8e539` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:28.242217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a19b8-7f31-462e-ac76-5cee8212dc83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e34697d88540cbaed285acc4a8e539)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:28.244151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a19b8-7f31-462e-ac76-5cee8212dc83 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:28.445554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e90a19b8-7f31-462e-ac76-5cee8212dc83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e34697d88540cbaed285acc4a8e539'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.519347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:28.529883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e90a19b8-7f31-462e-ac76-5cee8212dc83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e34697d88540cbaed285acc4a8e539'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.540908 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e90a19b8-7f31-462e-ac76-5cee8212dc83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e34697d88540cbaed285acc4a8e539'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.541764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e90a19b8-7f31-462e-ac76-5cee8212dc83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e34697d88540cbaed285acc4a8e539'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.552460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:28.556625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:28.557818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e90a19b8-7f31-462e-ac76-5cee8212dc83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e34697d88540cbaed285acc4a8e539'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.565089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 975/1968] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:28 2022] DELETE /identity/v3/users/16e34697d88540cbaed285acc4a8e539 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:28.568075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24662ce2-38ed-44ce-8269-6d24cb1c27a0 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:28.639363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:28.640143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:28.640630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:28.641106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] PATH_INFO: `/v3/users/b844eb3741de4cae9de388b5773aad7c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:28.642468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b844eb3741de4cae9de388b5773aad7c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:28.645232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:28.868717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b844eb3741de4cae9de388b5773aad7c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.881761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b844eb3741de4cae9de388b5773aad7c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.889044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b844eb3741de4cae9de388b5773aad7c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.889931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b844eb3741de4cae9de388b5773aad7c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:28.890644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b844eb3741de4cae9de388b5773aad7c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:29.003601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 994/1969] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:28 2022] DELETE /identity/v3/users/b844eb3741de4cae9de388b5773aad7c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:29.005547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fa05b-3eac-41a1-9aa0-e224c8f3404a None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:29.005839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fa05b-3eac-41a1-9aa0-e224c8f3404a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:29.023233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fa05b-3eac-41a1-9aa0-e224c8f3404a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:29.028799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8e3fa05b-3eac-41a1-9aa0-e224c8f3404a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:29.030269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8e3fa05b-3eac-41a1-9aa0-e224c8f3404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:29.109038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 976/1970] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:29.117133 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:29.118698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:29.147277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:29.226743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6e3aa-fa09-434c-af2a-d39529830328 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:29.230330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9f6f3-dcdf-403a-9609-eac874c63437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:29.230971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9f6f3-dcdf-403a-9609-eac874c63437 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:29.231253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9f6f3-dcdf-403a-9609-eac874c63437 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:29.231531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9f6f3-dcdf-403a-9609-eac874c63437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:29.240998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9f6f3-dcdf-403a-9609-eac874c63437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:29.242476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9f6f3-dcdf-403a-9609-eac874c63437 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:29.253676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 995/1971] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:29.291404 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fa05b-3eac-41a1-9aa0-e224c8f3404a None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:29.292914 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8e3fa05b-3eac-41a1-9aa0-e224c8f3404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:29.327728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fa05b-3eac-41a1-9aa0-e224c8f3404a None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:29.358779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfe274-ed3a-49c9-9975-c507bacc000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:29.360019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfe274-ed3a-49c9-9975-c507bacc000a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:29.360345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfe274-ed3a-49c9-9975-c507bacc000a admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:29.361306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfe274-ed3a-49c9-9975-c507bacc000a admin admin] PATH_INFO: `/v3/projects/4ecc3efb53444c7dac461d0277590b6d` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:29.364396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfe274-ed3a-49c9-9975-c507bacc000a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ecc3efb53444c7dac461d0277590b6d)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:29.367609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfe274-ed3a-49c9-9975-c507bacc000a admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:29.513282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c4bfe274-ed3a-49c9-9975-c507bacc000a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ecc3efb53444c7dac461d0277590b6d', 'request_id': 'req-c4bfe274-ed3a-49c9-9975-c507bacc000a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:29.522996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c4bfe274-ed3a-49c9-9975-c507bacc000a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ecc3efb53444c7dac461d0277590b6d', 'request_id': 'req-c4bfe274-ed3a-49c9-9975-c507bacc000a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:29.530845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c4bfe274-ed3a-49c9-9975-c507bacc000a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ecc3efb53444c7dac461d0277590b6d', 'request_id': 'req-c4bfe274-ed3a-49c9-9975-c507bacc000a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:29.659178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c4bfe274-ed3a-49c9-9975-c507bacc000a admin admin] The token cache is being invalidate because project 4ecc3efb53444c7dac461d0277590b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:29.659643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c4bfe274-ed3a-49c9-9975-c507bacc000a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:29.660330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c4bfe274-ed3a-49c9-9975-c507bacc000a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:29.661843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 977/1972] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:29 2022] DELETE /identity/v3/projects/4ecc3efb53444c7dac461d0277590b6d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:29.667730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2907c-5293-4498-bd6a-124ac88050ab None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:29.668018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2907c-5293-4498-bd6a-124ac88050ab None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:29.668296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2907c-5293-4498-bd6a-124ac88050ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:29.689078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-c4d2907c-5293-4498-bd6a-124ac88050ab None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:29.690791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c4d2907c-5293-4498-bd6a-124ac88050ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:29.752161 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 996/1973] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:29.760902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b95e9-6797-42c1-adac-a6e104cdbb71 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:29.761297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b95e9-6797-42c1-adac-a6e104cdbb71 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:29.761647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b95e9-6797-42c1-adac-a6e104cdbb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:29.789564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-dc5b95e9-6797-42c1-adac-a6e104cdbb71 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:29.790861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-dc5b95e9-6797-42c1-adac-a6e104cdbb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:29.807115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2907c-5293-4498-bd6a-124ac88050ab None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:29.808879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c4d2907c-5293-4498-bd6a-124ac88050ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:29.814764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 978/1974] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:29.819521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b95e9-6797-42c1-adac-a6e104cdbb71 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:29.829187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b95e9-6797-42c1-adac-a6e104cdbb71 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:29.835248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2907c-5293-4498-bd6a-124ac88050ab None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:29.836183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8833c15-9d66-45f1-814f-12e2ff81639b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:29.836814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8833c15-9d66-45f1-814f-12e2ff81639b admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:29.837219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8833c15-9d66-45f1-814f-12e2ff81639b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:29.837500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8833c15-9d66-45f1-814f-12e2ff81639b admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:29.838155 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8833c15-9d66-45f1-814f-12e2ff81639b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:29.838460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8833c15-9d66-45f1-814f-12e2ff81639b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:29.841018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:29.841678 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8833c15-9d66-45f1-814f-12e2ff81639b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:29.841794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:29.842199 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:29.842542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] PATH_INFO: `/v3/projects/61e60db74c584310a4c153b11128d3d1` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:29.850551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e60db74c584310a4c153b11128d3d1)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:29.852788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:29.864943 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 979/1975] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:57:29.865723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8833c15-9d66-45f1-814f-12e2ff81639b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:29.899643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8833c15-9d66-45f1-814f-12e2ff81639b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:29.905838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebedeb-e3b5-406c-91ac-315fee839ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:29.906477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebedeb-e3b5-406c-91ac-315fee839ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:29.906760 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebedeb-e3b5-406c-91ac-315fee839ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:29.909346 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebedeb-e3b5-406c-91ac-315fee839ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:29.910315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebedeb-e3b5-406c-91ac-315fee839ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:29.912613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebedeb-e3b5-406c-91ac-315fee839ec9 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:30.074116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e60db74c584310a4c153b11128d3d1', 'request_id': 'req-bc79377d-6477-4678-afe7-c89223bf95fc'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:30.079591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e60db74c584310a4c153b11128d3d1', 'request_id': 'req-bc79377d-6477-4678-afe7-c89223bf95fc'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:30.091009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 980/1976] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:29 2022] POST /identity/v3/projects => generated 373 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:30.094694 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebedeb-e3b5-406c-91ac-315fee839ec9 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:30.161870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebedeb-e3b5-406c-91ac-315fee839ec9 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:30.171275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889987-87fb-46b8-b817-8ea414dfd394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:30.171275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889987-87fb-46b8-b817-8ea414dfd394 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:30.171275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889987-87fb-46b8-b817-8ea414dfd394 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:30.171275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889987-87fb-46b8-b817-8ea414dfd394 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:30.171907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889987-87fb-46b8-b817-8ea414dfd394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:30.174001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889987-87fb-46b8-b817-8ea414dfd394 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:30.221601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e60db74c584310a4c153b11128d3d1', 'request_id': 'req-bc79377d-6477-4678-afe7-c89223bf95fc'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:30.227239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:30.242005 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] The token cache is being invalidate because project 61e60db74c584310a4c153b11128d3d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:30.242390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:30.243334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:30.245528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 997/1977] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:29 2022] DELETE /identity/v3/projects/61e60db74c584310a4c153b11128d3d1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:30.249614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:30.251533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:30.261707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 981/1978] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:30 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:30.265550 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889987-87fb-46b8-b817-8ea414dfd394 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:30.269531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e0889987-87fb-46b8-b817-8ea414dfd394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:30.287478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889987-87fb-46b8-b817-8ea414dfd394 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:30.292860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57901e78-3472-44eb-b0d7-d9f742e9adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:30.293474 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57901e78-3472-44eb-b0d7-d9f742e9adf4 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:30.293777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57901e78-3472-44eb-b0d7-d9f742e9adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:30.294055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57901e78-3472-44eb-b0d7-d9f742e9adf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:30.294705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57901e78-3472-44eb-b0d7-d9f742e9adf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:30.296349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57901e78-3472-44eb-b0d7-d9f742e9adf4 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:30.314321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 982/1979] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:30.323352 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57901e78-3472-44eb-b0d7-d9f742e9adf4 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:30.333912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57901e78-3472-44eb-b0d7-d9f742e9adf4 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:30.339769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e88d2-0f87-4041-a1cd-b90cac339900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:30.340656 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e88d2-0f87-4041-a1cd-b90cac339900 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:30.341084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e88d2-0f87-4041-a1cd-b90cac339900 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:30.341492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e88d2-0f87-4041-a1cd-b90cac339900 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:30.342281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e88d2-0f87-4041-a1cd-b90cac339900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:30.344191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e88d2-0f87-4041-a1cd-b90cac339900 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:30.353367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79377d-6477-4678-afe7-c89223bf95fc admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:30.357439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 983/1980] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:30.359334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:30.359994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:30.360319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:30.360631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] PATH_INFO: `/v3/users/5d5022873d53483fa7eff9910b15b9a2` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:30.361724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e88d2-0f87-4041-a1cd-b90cac339900 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:30.363118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5022873d53483fa7eff9910b15b9a2)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:30.365634 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:30.374216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e88d2-0f87-4041-a1cd-b90cac339900 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:30.381357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db2eaa-a5b5-4fb6-9fd1-74fa4ba2b803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:30.382286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2eaa-a5b5-4fb6-9fd1-74fa4ba2b803 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:30.382513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2eaa-a5b5-4fb6-9fd1-74fa4ba2b803 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:30.383428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2eaa-a5b5-4fb6-9fd1-74fa4ba2b803 admin admin] PATH_INFO: `/v3/projects/9efcd6bdb0d04037a7f5e5218a2539d9/users/a4804ea558eb4514bd7a76db7fe055bf/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:30.402253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db2eaa-a5b5-4fb6-9fd1-74fa4ba2b803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efcd6bdb0d04037a7f5e5218a2539d9, user_id=a4804ea558eb4514bd7a76db7fe055bf, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:30.406208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db2eaa-a5b5-4fb6-9fd1-74fa4ba2b803 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:30.427463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:30.513705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 984/1981] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:30 2022] PUT /identity/v3/projects/9efcd6bdb0d04037a7f5e5218a2539d9/users/a4804ea558eb4514bd7a76db7fe055bf/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:30.524653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51f761-2d69-4004-96f7-598fbbbd3dd9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:30.524945 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51f761-2d69-4004-96f7-598fbbbd3dd9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:30.525221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51f761-2d69-4004-96f7-598fbbbd3dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:30.558576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-9f51f761-2d69-4004-96f7-598fbbbd3dd9 None None] MFA Rules not processed for user `a4804ea558eb4514bd7a76db7fe055bf`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:30.562242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9f51f761-2d69-4004-96f7-598fbbbd3dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:30.630389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5022873d53483fa7eff9910b15b9a2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:30.678996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5022873d53483fa7eff9910b15b9a2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:30.708053 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 985/1982] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:30.718531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5022873d53483fa7eff9910b15b9a2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:30.719605 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5022873d53483fa7eff9910b15b9a2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:30.720572 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5022873d53483fa7eff9910b15b9a2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:30.739523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51f761-2d69-4004-96f7-598fbbbd3dd9 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:30.741435 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9f51f761-2d69-4004-96f7-598fbbbd3dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:30.818421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 998/1983] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:30 2022] DELETE /identity/v3/users/5d5022873d53483fa7eff9910b15b9a2 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:30.851787 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51f761-2d69-4004-96f7-598fbbbd3dd9 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:30.925562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8a0e3-642f-4c47-924b-4b9b50808667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:30.926428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8a0e3-642f-4c47-924b-4b9b50808667 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:30.926805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8a0e3-642f-4c47-924b-4b9b50808667 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:30.927187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8a0e3-642f-4c47-924b-4b9b50808667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:30.929089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a4b8a0e3-642f-4c47-924b-4b9b50808667 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:31.004076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8a0e3-642f-4c47-924b-4b9b50808667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:31.005515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8a0e3-642f-4c47-924b-4b9b50808667 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:31.017358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 986/1984] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:31.233069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:31.339092 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:31.340802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:31.412169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945679c3-b184-462a-aa42-3aa1dd6ebddd admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:31.416723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:31.417362 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:31.417637 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:31.417907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] PATH_INFO: `/v3/projects/802210854d7a4b2bb3edc654b4a07d6a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:31.419066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=802210854d7a4b2bb3edc654b4a07d6a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:31.420962 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:31.514913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707263f-5a60-49a3-94ab-bb79d44a8a41 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:31.515437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707263f-5a60-49a3-94ab-bb79d44a8a41 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:31.515520 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707263f-5a60-49a3-94ab-bb79d44a8a41 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:31.517116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 987/1985] 10.222.0.73 () {54 vars in 921 bytes} [Mon Aug 29 23:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:57:31.546896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802210854d7a4b2bb3edc654b4a07d6a', 'request_id': 'req-abcd83df-28fd-4720-a859-64ec9001e1aa'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:31.548714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f0510-3a24-4f34-8261-041e2f2c0d5c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:31.549003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f0510-3a24-4f34-8261-041e2f2c0d5c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:31.549891 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f0510-3a24-4f34-8261-041e2f2c0d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:31.564308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802210854d7a4b2bb3edc654b4a07d6a', 'request_id': 'req-abcd83df-28fd-4720-a859-64ec9001e1aa'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:31.574741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-300f0510-3a24-4f34-8261-041e2f2c0d5c None None] MFA Rules not processed for user `ce79452e14fa4984875dca43672ed25a`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:31.576642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-300f0510-3a24-4f34-8261-041e2f2c0d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:31.599524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:31.638345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802210854d7a4b2bb3edc654b4a07d6a', 'request_id': 'req-abcd83df-28fd-4720-a859-64ec9001e1aa'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:31.650925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 988/1986] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Aug 29 23:57:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:31.657919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6533-4f06-481b-ba2f-b615599eeb50 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:31.658341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6533-4f06-481b-ba2f-b615599eeb50 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:31.659414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6533-4f06-481b-ba2f-b615599eeb50 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:31.659725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] The token cache is being invalidate because project 802210854d7a4b2bb3edc654b4a07d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:31.660236 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:31.661316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:31.661761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 989/1987] 10.222.0.73 () {54 vars in 961 bytes} [Mon Aug 29 23:57:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:57:31.673439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60fbc7-188f-44e5-a3d6-34aa70c22747 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:31.673439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60fbc7-188f-44e5-a3d6-34aa70c22747 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:31.673439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60fbc7-188f-44e5-a3d6-34aa70c22747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:31.673838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 999/1988] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:31 2022] DELETE /identity/v3/projects/802210854d7a4b2bb3edc654b4a07d6a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:31.673838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:31.675288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:31.696769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-7f60fbc7-188f-44e5-a3d6-34aa70c22747 None None] MFA Rules not processed for user `ce79452e14fa4984875dca43672ed25a`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:31.697747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7f60fbc7-188f-44e5-a3d6-34aa70c22747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:31.709270 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 990/1989] 10.222.0.73 () {58 vars in 1058 bytes} [Mon Aug 29 23:57:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:31.710698 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60fbc7-188f-44e5-a3d6-34aa70c22747 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:31.712543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7f60fbc7-188f-44e5-a3d6-34aa70c22747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:31.764379 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd83df-28fd-4720-a859-64ec9001e1aa admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:31.770050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:31.770698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:31.771011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:31.771288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] PATH_INFO: `/v3/users/7e2a94c929b54b6c9bd2a055ae752515` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:31.772437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2a94c929b54b6c9bd2a055ae752515)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:31.774351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:31.793988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60fbc7-188f-44e5-a3d6-34aa70c22747 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:31.799315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:31.799964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:31.800254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:31.800525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] PATH_INFO: `/v3/users/eb701d6c531545ac8c7ed76a87706dcd` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:31.801693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb701d6c531545ac8c7ed76a87706dcd)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:31.805190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:31.993026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2a94c929b54b6c9bd2a055ae752515'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.007560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2a94c929b54b6c9bd2a055ae752515'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.017110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2a94c929b54b6c9bd2a055ae752515'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.018112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2a94c929b54b6c9bd2a055ae752515'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.019238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2a94c929b54b6c9bd2a055ae752515'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.076732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb701d6c531545ac8c7ed76a87706dcd'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.141064 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1000/1990] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:31 2022] DELETE /identity/v3/users/7e2a94c929b54b6c9bd2a055ae752515 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:32.144760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:32.144760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:32.214710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881605aa-4cbb-4d23-9c36-099f7d01a4cc admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:32.219838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4524e4b-067f-4fe8-af26-1ce1c819bbe1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:32.220499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4524e4b-067f-4fe8-af26-1ce1c819bbe1 service placement] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:32.220772 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4524e4b-067f-4fe8-af26-1ce1c819bbe1 service placement] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:32.221114 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4524e4b-067f-4fe8-af26-1ce1c819bbe1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:32.222977 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a4524e4b-067f-4fe8-af26-1ce1c819bbe1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:32.234302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4524e4b-067f-4fe8-af26-1ce1c819bbe1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:32.235907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4524e4b-067f-4fe8-af26-1ce1c819bbe1 service placement] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:32.246746 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1001/1991] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:32.304558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb701d6c531545ac8c7ed76a87706dcd'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.312597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb701d6c531545ac8c7ed76a87706dcd'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.313056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb701d6c531545ac8c7ed76a87706dcd'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.325082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb701d6c531545ac8c7ed76a87706dcd'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.332823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 991/1992] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:31 2022] DELETE /identity/v3/users/eb701d6c531545ac8c7ed76a87706dcd => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:32.599785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4524e4b-067f-4fe8-af26-1ce1c819bbe1 service placement] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:32.601609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a4524e4b-067f-4fe8-af26-1ce1c819bbe1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:32.631369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:32.633799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:32.681465 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4524e4b-067f-4fe8-af26-1ce1c819bbe1 service placement] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:32.721564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:32.755051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99d626-1012-411c-8179-249fc24868da admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:32.756339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cdbf7-4b99-468c-9282-111ac7ac5628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:32.756991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cdbf7-4b99-468c-9282-111ac7ac5628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:32.757271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cdbf7-4b99-468c-9282-111ac7ac5628 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:32.757547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cdbf7-4b99-468c-9282-111ac7ac5628 admin admin] PATH_INFO: `/v3/projects/ad9383a42b6f4e28ad72cb82c7efeef5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:32.759872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cdbf7-4b99-468c-9282-111ac7ac5628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9383a42b6f4e28ad72cb82c7efeef5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:32.761896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cdbf7-4b99-468c-9282-111ac7ac5628 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:32.762799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ede27-537c-440f-9667-11b71d86a124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:32.763739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ede27-537c-440f-9667-11b71d86a124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:32.764287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ede27-537c-440f-9667-11b71d86a124 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:32.764566 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ede27-537c-440f-9667-11b71d86a124 admin admin] PATH_INFO: `/v3/projects/655020f06b4744eaa50236b46f195a8d` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:32.766350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ede27-537c-440f-9667-11b71d86a124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=655020f06b4744eaa50236b46f195a8d)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:32.769102 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ede27-537c-440f-9667-11b71d86a124 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:32.884679 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9b4ede27-537c-440f-9667-11b71d86a124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655020f06b4744eaa50236b46f195a8d', 'request_id': 'req-9b4ede27-537c-440f-9667-11b71d86a124'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.890300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9b4ede27-537c-440f-9667-11b71d86a124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655020f06b4744eaa50236b46f195a8d', 'request_id': 'req-9b4ede27-537c-440f-9667-11b71d86a124'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.897357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9b4ede27-537c-440f-9667-11b71d86a124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655020f06b4744eaa50236b46f195a8d', 'request_id': 'req-9b4ede27-537c-440f-9667-11b71d86a124'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.931839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5e2cdbf7-4b99-468c-9282-111ac7ac5628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9383a42b6f4e28ad72cb82c7efeef5', 'request_id': 'req-5e2cdbf7-4b99-468c-9282-111ac7ac5628'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:32.937686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5e2cdbf7-4b99-468c-9282-111ac7ac5628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9383a42b6f4e28ad72cb82c7efeef5', 'request_id': 'req-5e2cdbf7-4b99-468c-9282-111ac7ac5628'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:33.010134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9b4ede27-537c-440f-9667-11b71d86a124 admin admin] The token cache is being invalidate because project 655020f06b4744eaa50236b46f195a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:33.010428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9b4ede27-537c-440f-9667-11b71d86a124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:33.011198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9b4ede27-537c-440f-9667-11b71d86a124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:33.012804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 992/1993] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:32 2022] DELETE /identity/v3/projects/655020f06b4744eaa50236b46f195a8d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:33.016254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d189990-9b7d-44d0-afbf-cf1aeb4871f0 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.016254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d189990-9b7d-44d0-afbf-cf1aeb4871f0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.016254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d189990-9b7d-44d0-afbf-cf1aeb4871f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.033702 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-3d189990-9b7d-44d0-afbf-cf1aeb4871f0 None None] MFA Rules not processed for user `a4804ea558eb4514bd7a76db7fe055bf`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:33.034855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3d189990-9b7d-44d0-afbf-cf1aeb4871f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:33.089691 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 993/1994] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:33.091101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62473d52-47dc-4de1-a4b2-56320cb973c2 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.091387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62473d52-47dc-4de1-a4b2-56320cb973c2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.091662 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62473d52-47dc-4de1-a4b2-56320cb973c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.095608 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5e2cdbf7-4b99-468c-9282-111ac7ac5628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9383a42b6f4e28ad72cb82c7efeef5', 'request_id': 'req-5e2cdbf7-4b99-468c-9282-111ac7ac5628'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:33.110065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5e2cdbf7-4b99-468c-9282-111ac7ac5628 admin admin] The token cache is being invalidate because project ad9383a42b6f4e28ad72cb82c7efeef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:33.110419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5e2cdbf7-4b99-468c-9282-111ac7ac5628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:33.111477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5e2cdbf7-4b99-468c-9282-111ac7ac5628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:33.113170 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-62473d52-47dc-4de1-a4b2-56320cb973c2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:33.113778 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1002/1995] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:32 2022] DELETE /identity/v3/projects/ad9383a42b6f4e28ad72cb82c7efeef5 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:33.114446 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-62473d52-47dc-4de1-a4b2-56320cb973c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:33.126570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0ea5-bb4b-46ad-990f-d969cbb0589d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.126913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0ea5-bb4b-46ad-990f-d969cbb0589d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.127492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0ea5-bb4b-46ad-990f-d969cbb0589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.151711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-5e0d0ea5-bb4b-46ad-990f-d969cbb0589d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:33.151711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5e0d0ea5-bb4b-46ad-990f-d969cbb0589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:33.180378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 994/1996] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:33.188127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650f7fa-6d24-4dd0-8188-f050cdc0493a None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.188416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650f7fa-6d24-4dd0-8188-f050cdc0493a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.188694 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650f7fa-6d24-4dd0-8188-f050cdc0493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.209885 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d650f7fa-6d24-4dd0-8188-f050cdc0493a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:33.211130 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d650f7fa-6d24-4dd0-8188-f050cdc0493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:33.217988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1003/1997] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:33.223009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 995/1998] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:33.226120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d0ea5-bb4b-46ad-990f-d969cbb0589d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:33.226669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad0c0a-5e11-45b1-b413-92bbb30c2c0a None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.227220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad0c0a-5e11-45b1-b413-92bbb30c2c0a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.227684 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad0c0a-5e11-45b1-b413-92bbb30c2c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.236086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d0ea5-bb4b-46ad-990f-d969cbb0589d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:33.242341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1cb95-9207-4972-b4bc-6acf32d4b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:33.243000 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1cb95-9207-4972-b4bc-6acf32d4b1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.243309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1cb95-9207-4972-b4bc-6acf32d4b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.243644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1cb95-9207-4972-b4bc-6acf32d4b1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.244272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1cb95-9207-4972-b4bc-6acf32d4b1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:33.244607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1cb95-9207-4972-b4bc-6acf32d4b1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:33.246215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1cb95-9207-4972-b4bc-6acf32d4b1e8 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:33.251646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-bdad0c0a-5e11-45b1-b413-92bbb30c2c0a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:33.253736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-bdad0c0a-5e11-45b1-b413-92bbb30c2c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:33.258791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1004/1999] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:57:33.262911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 996/2000] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:33.263458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1cb95-9207-4972-b4bc-6acf32d4b1e8 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:33.266691 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad0c0a-5e11-45b1-b413-92bbb30c2c0a None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:33.274523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1cb95-9207-4972-b4bc-6acf32d4b1e8 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:33.276834 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad0c0a-5e11-45b1-b413-92bbb30c2c0a None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:33.282377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1597f-e281-475d-b06b-8a65f61450cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:33.283024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1597f-e281-475d-b06b-8a65f61450cb admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.283325 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1597f-e281-475d-b06b-8a65f61450cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.284230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782b118-4832-4d13-8875-0f8a4f9db656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:33.284369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1597f-e281-475d-b06b-8a65f61450cb admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.284757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b118-4832-4d13-8875-0f8a4f9db656 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.284857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1597f-e281-475d-b06b-8a65f61450cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:33.285042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b118-4832-4d13-8875-0f8a4f9db656 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.285141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1597f-e281-475d-b06b-8a65f61450cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:33.285449 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b118-4832-4d13-8875-0f8a4f9db656 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.286134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782b118-4832-4d13-8875-0f8a4f9db656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:33.286667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1597f-e281-475d-b06b-8a65f61450cb admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:33.288209 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782b118-4832-4d13-8875-0f8a4f9db656 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:33.301268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 997/2001] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:57:33.305509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1597f-e281-475d-b06b-8a65f61450cb admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:33.315803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1597f-e281-475d-b06b-8a65f61450cb admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:33.320738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a874d0-bc9a-4f7e-af35-87e1ba7bd6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:33.321370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a874d0-bc9a-4f7e-af35-87e1ba7bd6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.321650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a874d0-bc9a-4f7e-af35-87e1ba7bd6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.321924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a874d0-bc9a-4f7e-af35-87e1ba7bd6f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.322609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a874d0-bc9a-4f7e-af35-87e1ba7bd6f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:33.324559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a874d0-bc9a-4f7e-af35-87e1ba7bd6f8 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:33.410733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 998/2002] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:33 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:33.415520 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a874d0-bc9a-4f7e-af35-87e1ba7bd6f8 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:33.417455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1005/2003] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:33 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:33.418361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782b118-4832-4d13-8875-0f8a4f9db656 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:33.484894 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a874d0-bc9a-4f7e-af35-87e1ba7bd6f8 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:33.493426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b5876-d502-4a04-ad7e-46a6330f633f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:33.493426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b5876-d502-4a04-ad7e-46a6330f633f admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.493588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782b118-4832-4d13-8875-0f8a4f9db656 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:33.493696 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b5876-d502-4a04-ad7e-46a6330f633f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.493696 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b5876-d502-4a04-ad7e-46a6330f633f admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.493824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b5876-d502-4a04-ad7e-46a6330f633f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:33.495931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b5876-d502-4a04-ad7e-46a6330f633f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:33.498234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37629fc1-bf92-427b-b5d8-1dda2eb9d525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:33.499493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37629fc1-bf92-427b-b5d8-1dda2eb9d525 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.499493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37629fc1-bf92-427b-b5d8-1dda2eb9d525 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.499791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37629fc1-bf92-427b-b5d8-1dda2eb9d525 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.500271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37629fc1-bf92-427b-b5d8-1dda2eb9d525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:33.502456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37629fc1-bf92-427b-b5d8-1dda2eb9d525 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:33.575733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 999/2004] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:33 2022] POST /identity/v3/users => generated 301 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:33.579781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b5876-d502-4a04-ad7e-46a6330f633f admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:33.589838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b5876-d502-4a04-ad7e-46a6330f633f admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:33.594637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc93e8e-831f-4893-a7a2-29aa84144cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:33.595259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc93e8e-831f-4893-a7a2-29aa84144cfc admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.595544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc93e8e-831f-4893-a7a2-29aa84144cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.595817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc93e8e-831f-4893-a7a2-29aa84144cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.597008 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc93e8e-831f-4893-a7a2-29aa84144cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:33.598580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc93e8e-831f-4893-a7a2-29aa84144cfc admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:33.608832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1000/2005] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:33.613550 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc93e8e-831f-4893-a7a2-29aa84144cfc admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:33.625547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1006/2006] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:33 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:33.630670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc93e8e-831f-4893-a7a2-29aa84144cfc admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:33.632882 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37629fc1-bf92-427b-b5d8-1dda2eb9d525 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:33.644802 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755496dc-d0ca-492d-9753-ccd8e4c2e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:33.645602 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755496dc-d0ca-492d-9753-ccd8e4c2e94c admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.645733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755496dc-d0ca-492d-9753-ccd8e4c2e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.645976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755496dc-d0ca-492d-9753-ccd8e4c2e94c admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.647072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755496dc-d0ca-492d-9753-ccd8e4c2e94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:33.652309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755496dc-d0ca-492d-9753-ccd8e4c2e94c admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:33.652435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37629fc1-bf92-427b-b5d8-1dda2eb9d525 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:33.658324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce31d4-b266-4048-8f53-421962dd6a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:33.659856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce31d4-b266-4048-8f53-421962dd6a48 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.660226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce31d4-b266-4048-8f53-421962dd6a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.660594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce31d4-b266-4048-8f53-421962dd6a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.661350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce31d4-b266-4048-8f53-421962dd6a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:33.663065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce31d4-b266-4048-8f53-421962dd6a48 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:33.664127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1001/2007] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:33.668421 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755496dc-d0ca-492d-9753-ccd8e4c2e94c admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:33.678604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1007/2008] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:33.679680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755496dc-d0ca-492d-9753-ccd8e4c2e94c admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:33.679807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce31d4-b266-4048-8f53-421962dd6a48 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:33.686150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a212b-46f6-4ced-b647-8786f1546268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:33.686833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a212b-46f6-4ced-b647-8786f1546268 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.687154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a212b-46f6-4ced-b647-8786f1546268 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.690458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a212b-46f6-4ced-b647-8786f1546268 admin admin] PATH_INFO: `/v3/projects/17d45db2782d40e98ad0c0fa93d561d0/users/23e6dd5874a34b46b8d648c67b2ecc70/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.709139 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce31d4-b266-4048-8f53-421962dd6a48 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:33.742229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a212b-46f6-4ced-b647-8786f1546268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d45db2782d40e98ad0c0fa93d561d0, user_id=23e6dd5874a34b46b8d648c67b2ecc70, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:33.742229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a212b-46f6-4ced-b647-8786f1546268 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:33.745795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5d18b-0fa4-41e0-934f-fe280d60e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:33.746532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d18b-0fa4-41e0-934f-fe280d60e5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.746804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d18b-0fa4-41e0-934f-fe280d60e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.747105 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d18b-0fa4-41e0-934f-fe280d60e5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.747746 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5d18b-0fa4-41e0-934f-fe280d60e5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:33.751283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5d18b-0fa4-41e0-934f-fe280d60e5d1 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:33.779111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1008/2009] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:33.781510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5d18b-0fa4-41e0-934f-fe280d60e5d1 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:33.793682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5d18b-0fa4-41e0-934f-fe280d60e5d1 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:33.800000 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93ea90-d9b7-4fd2-afe4-d435b3d6d7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:33.800668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93ea90-d9b7-4fd2-afe4-d435b3d6d7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.801105 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93ea90-d9b7-4fd2-afe4-d435b3d6d7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.801534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93ea90-d9b7-4fd2-afe4-d435b3d6d7d4 admin admin] PATH_INFO: `/v3/projects/fc6cac410c3a49fd88d289ffb4d8d462/users/703613b3bb254d19a313f0909bce05e5/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.824159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93ea90-d9b7-4fd2-afe4-d435b3d6d7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6cac410c3a49fd88d289ffb4d8d462, user_id=703613b3bb254d19a313f0909bce05e5, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:33.836091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1002/2010] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:33 2022] PUT /identity/v3/projects/17d45db2782d40e98ad0c0fa93d561d0/users/23e6dd5874a34b46b8d648c67b2ecc70/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:33.836608 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93ea90-d9b7-4fd2-afe4-d435b3d6d7d4 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:33.840925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54314911-db30-4ff2-8afd-6df3a45dd426 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.841318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54314911-db30-4ff2-8afd-6df3a45dd426 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.841711 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54314911-db30-4ff2-8afd-6df3a45dd426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.882355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-54314911-db30-4ff2-8afd-6df3a45dd426 None None] MFA Rules not processed for user `23e6dd5874a34b46b8d648c67b2ecc70`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:33.882355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-54314911-db30-4ff2-8afd-6df3a45dd426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:33.908584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1009/2011] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:33 2022] PUT /identity/v3/projects/fc6cac410c3a49fd88d289ffb4d8d462/users/703613b3bb254d19a313f0909bce05e5/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:33.919050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860acea-42fd-4715-abfc-a0c67123116b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:33.919446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860acea-42fd-4715-abfc-a0c67123116b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:33.919810 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860acea-42fd-4715-abfc-a0c67123116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:33.931901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:33.948997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-1860acea-42fd-4715-abfc-a0c67123116b None None] MFA Rules not processed for user `703613b3bb254d19a313f0909bce05e5`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:33.950310 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1860acea-42fd-4715-abfc-a0c67123116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:33.954544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1003/2012] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:33 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:33.959780 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54314911-db30-4ff2-8afd-6df3a45dd426 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:34.047960 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54314911-db30-4ff2-8afd-6df3a45dd426 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:34.083137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1010/2013] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:34.085254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860acea-42fd-4715-abfc-a0c67123116b None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:34.087268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1860acea-42fd-4715-abfc-a0c67123116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:34.148543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806561ec-fbc3-4d58-8b7c-cdc49273ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:34.149158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806561ec-fbc3-4d58-8b7c-cdc49273ca18 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:34.149440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806561ec-fbc3-4d58-8b7c-cdc49273ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:34.149718 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806561ec-fbc3-4d58-8b7c-cdc49273ca18 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:34.150358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806561ec-fbc3-4d58-8b7c-cdc49273ca18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:34.152337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806561ec-fbc3-4d58-8b7c-cdc49273ca18 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:34.197201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860acea-42fd-4715-abfc-a0c67123116b None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:34.202713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c655284-5234-4510-a862-be39a7fdc0fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:34.203359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c655284-5234-4510-a862-be39a7fdc0fb service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:34.203645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c655284-5234-4510-a862-be39a7fdc0fb service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:34.203921 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c655284-5234-4510-a862-be39a7fdc0fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:34.211969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c655284-5234-4510-a862-be39a7fdc0fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:34.213591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c655284-5234-4510-a862-be39a7fdc0fb service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:34.223146 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1011/2014] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:34.268888 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1004/2015] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:33 2022] POST /identity/v3/projects => generated 399 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:34.269431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c655284-5234-4510-a862-be39a7fdc0fb service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:34.283408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c655284-5234-4510-a862-be39a7fdc0fb service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:34.378583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efea53a-603f-4928-9044-33abf3280bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:34.379243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efea53a-603f-4928-9044-33abf3280bab admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:34.379577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efea53a-603f-4928-9044-33abf3280bab admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:34.379856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efea53a-603f-4928-9044-33abf3280bab admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:34.380493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efea53a-603f-4928-9044-33abf3280bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:34.382423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efea53a-603f-4928-9044-33abf3280bab admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:34.467443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806561ec-fbc3-4d58-8b7c-cdc49273ca18 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:34.479078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806561ec-fbc3-4d58-8b7c-cdc49273ca18 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:34.483791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c5de6-e964-4023-9abf-d11a6d98154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:34.486798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c5de6-e964-4023-9abf-d11a6d98154b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:34.486798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c5de6-e964-4023-9abf-d11a6d98154b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:34.486798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c5de6-e964-4023-9abf-d11a6d98154b admin admin] PATH_INFO: `/v3/users/703613b3bb254d19a313f0909bce05e5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:34.486798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c5de6-e964-4023-9abf-d11a6d98154b admin admin] RBAC: Authorizing `identity:delete_user(user_id=703613b3bb254d19a313f0909bce05e5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:34.488140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c5de6-e964-4023-9abf-d11a6d98154b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:34.511856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1012/2016] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:34 2022] POST /identity/v3/users => generated 306 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:34.515717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efea53a-603f-4928-9044-33abf3280bab admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:34.526315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efea53a-603f-4928-9044-33abf3280bab admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:34.530997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a9034-1343-4f01-b8b3-5e7f323055fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:34.531616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a9034-1343-4f01-b8b3-5e7f323055fb admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:34.531895 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a9034-1343-4f01-b8b3-5e7f323055fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:34.532165 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a9034-1343-4f01-b8b3-5e7f323055fb admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:34.532799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a9034-1343-4f01-b8b3-5e7f323055fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:34.535071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a9034-1343-4f01-b8b3-5e7f323055fb admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:34.544812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1013/2017] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:34.548733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a9034-1343-4f01-b8b3-5e7f323055fb admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:34.557988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a9034-1343-4f01-b8b3-5e7f323055fb admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:34.562783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bac8e-49ad-408a-a320-3f2333660bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:34.563623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bac8e-49ad-408a-a320-3f2333660bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:34.563949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bac8e-49ad-408a-a320-3f2333660bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:34.564228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bac8e-49ad-408a-a320-3f2333660bcf admin admin] PATH_INFO: `/v3/projects/cc358b34148145a7b436bc8a8274b920/users/3103b603f0734d048b045d342af2ac7a/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:34.579033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bac8e-49ad-408a-a320-3f2333660bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc358b34148145a7b436bc8a8274b920, user_id=3103b603f0734d048b045d342af2ac7a, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:34.585840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bac8e-49ad-408a-a320-3f2333660bcf admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:34.696866 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1014/2018] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:34 2022] PUT /identity/v3/projects/cc358b34148145a7b436bc8a8274b920/users/3103b603f0734d048b045d342af2ac7a/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:34.701201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bac8e-49ad-408a-a320-3f2333660bcf admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:34.710144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a6c5de6-e964-4023-9abf-d11a6d98154b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '703613b3bb254d19a313f0909bce05e5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:34.767746 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bac8e-49ad-408a-a320-3f2333660bcf admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:34.773370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9783cf8-b2c8-4918-9c0b-1e7e124e8192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:34.773987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9783cf8-b2c8-4918-9c0b-1e7e124e8192 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:34.774273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9783cf8-b2c8-4918-9c0b-1e7e124e8192 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:34.774551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9783cf8-b2c8-4918-9c0b-1e7e124e8192 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:34.775421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9783cf8-b2c8-4918-9c0b-1e7e124e8192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:34.777075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9783cf8-b2c8-4918-9c0b-1e7e124e8192 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:34.781480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a6c5de6-e964-4023-9abf-d11a6d98154b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '703613b3bb254d19a313f0909bce05e5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:34.787679 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:34.790206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1015/2019] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:34.794296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9783cf8-b2c8-4918-9c0b-1e7e124e8192 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:34.794629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a6c5de6-e964-4023-9abf-d11a6d98154b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '703613b3bb254d19a313f0909bce05e5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:34.795776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a6c5de6-e964-4023-9abf-d11a6d98154b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '703613b3bb254d19a313f0909bce05e5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:34.804827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9783cf8-b2c8-4918-9c0b-1e7e124e8192 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:34.810130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2415ad-79f7-4c4d-a387-290f28131f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:34.810848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2415ad-79f7-4c4d-a387-290f28131f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:34.811176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2415ad-79f7-4c4d-a387-290f28131f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:34.811740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2415ad-79f7-4c4d-a387-290f28131f8b admin admin] PATH_INFO: `/v3/projects/cc358b34148145a7b436bc8a8274b920/users/3103b603f0734d048b045d342af2ac7a/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:34.813839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a6c5de6-e964-4023-9abf-d11a6d98154b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '703613b3bb254d19a313f0909bce05e5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:34.813972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2415ad-79f7-4c4d-a387-290f28131f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc358b34148145a7b436bc8a8274b920, user_id=3103b603f0734d048b045d342af2ac7a, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:34.817277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2415ad-79f7-4c4d-a387-290f28131f8b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:34.821906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1005/2020] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:34 2022] DELETE /identity/v3/users/703613b3bb254d19a313f0909bce05e5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:34.827087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59075019-d194-4bb4-b222-0cd772fdae78 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:34.827698 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59075019-d194-4bb4-b222-0cd772fdae78 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:34.828074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59075019-d194-4bb4-b222-0cd772fdae78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:34.834948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1016/2021] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:34 2022] PUT /identity/v3/projects/cc358b34148145a7b436bc8a8274b920/users/3103b603f0734d048b045d342af2ac7a/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:34.843676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8746-923b-4b97-a282-2787b8df7fda None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:34.844113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8746-923b-4b97-a282-2787b8df7fda None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:34.844453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8746-923b-4b97-a282-2787b8df7fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:34.849791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-59075019-d194-4bb4-b222-0cd772fdae78 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:34.851154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-59075019-d194-4bb4-b222-0cd772fdae78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:34.873605 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-ffca8746-923b-4b97-a282-2787b8df7fda None None] MFA Rules not processed for user `3103b603f0734d048b045d342af2ac7a`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:34.874924 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ffca8746-923b-4b97-a282-2787b8df7fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:34.913203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1006/2022] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:34.922969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59075019-d194-4bb4-b222-0cd772fdae78 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:34.924577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-59075019-d194-4bb4-b222-0cd772fdae78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:34.950600 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1017/2023] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:34 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:34.962931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8746-923b-4b97-a282-2787b8df7fda None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:34.964363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ffca8746-923b-4b97-a282-2787b8df7fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:34.982463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59075019-d194-4bb4-b222-0cd772fdae78 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:34.986076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcb69a-a663-4198-90e3-03e447f8ee8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:34.986713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcb69a-a663-4198-90e3-03e447f8ee8c service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:34.987122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcb69a-a663-4198-90e3-03e447f8ee8c service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:34.987409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcb69a-a663-4198-90e3-03e447f8ee8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:34.998231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcb69a-a663-4198-90e3-03e447f8ee8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:35.000141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcb69a-a663-4198-90e3-03e447f8ee8c service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:35.015666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1007/2024] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:35.032563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8746-923b-4b97-a282-2787b8df7fda None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:35.038443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8198130-9edf-436e-a79f-f76548e0189e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:35.039196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8198130-9edf-436e-a79f-f76548e0189e service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:35.039587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8198130-9edf-436e-a79f-f76548e0189e service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:35.039949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8198130-9edf-436e-a79f-f76548e0189e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:35.050735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8198130-9edf-436e-a79f-f76548e0189e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:35.051741 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8198130-9edf-436e-a79f-f76548e0189e service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:35.061770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1018/2025] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:34 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:35.107140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:35.306472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcb69a-a663-4198-90e3-03e447f8ee8c service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:35.316230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcb69a-a663-4198-90e3-03e447f8ee8c service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:35.320020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2fecd-edf6-4f04-a704-87035efb2e44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:35.321946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2fecd-edf6-4f04-a704-87035efb2e44 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:35.321946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2fecd-edf6-4f04-a704-87035efb2e44 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:35.321946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2fecd-edf6-4f04-a704-87035efb2e44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:35.323221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-72d2fecd-edf6-4f04-a704-87035efb2e44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:35.388544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2fecd-edf6-4f04-a704-87035efb2e44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:35.390048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2fecd-edf6-4f04-a704-87035efb2e44 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:35.399072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1008/2026] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:35 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:35.469975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8198130-9edf-436e-a79f-f76548e0189e service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:35.472282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d8198130-9edf-436e-a79f-f76548e0189e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:35.499868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8198130-9edf-436e-a79f-f76548e0189e service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:35.508839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68ef83-08d1-4891-949b-133a9c0172ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:35.510063 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68ef83-08d1-4891-949b-133a9c0172ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:35.510492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68ef83-08d1-4891-949b-133a9c0172ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:35.510933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68ef83-08d1-4891-949b-133a9c0172ff admin admin] PATH_INFO: `/v3/projects/fc6cac410c3a49fd88d289ffb4d8d462` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:35.512706 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68ef83-08d1-4891-949b-133a9c0172ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6cac410c3a49fd88d289ffb4d8d462)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:35.514921 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68ef83-08d1-4891-949b-133a9c0172ff admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:35.655057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8f68ef83-08d1-4891-949b-133a9c0172ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6cac410c3a49fd88d289ffb4d8d462', 'request_id': 'req-8f68ef83-08d1-4891-949b-133a9c0172ff'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:35.660985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8f68ef83-08d1-4891-949b-133a9c0172ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6cac410c3a49fd88d289ffb4d8d462', 'request_id': 'req-8f68ef83-08d1-4891-949b-133a9c0172ff'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:35.764621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8f68ef83-08d1-4891-949b-133a9c0172ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6cac410c3a49fd88d289ffb4d8d462', 'request_id': 'req-8f68ef83-08d1-4891-949b-133a9c0172ff'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:35.785556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8f68ef83-08d1-4891-949b-133a9c0172ff admin admin] The token cache is being invalidate because project fc6cac410c3a49fd88d289ffb4d8d462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:35.786010 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8f68ef83-08d1-4891-949b-133a9c0172ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:35.787030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8f68ef83-08d1-4891-949b-133a9c0172ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:35.789454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1019/2027] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:35 2022] DELETE /identity/v3/projects/fc6cac410c3a49fd88d289ffb4d8d462 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:35.794487 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a3b29-dc67-49e9-bfb5-027d9901b9f5 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:35.795284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a3b29-dc67-49e9-bfb5-027d9901b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:35.795556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a3b29-dc67-49e9-bfb5-027d9901b9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:35.820193 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-720a3b29-dc67-49e9-bfb5-027d9901b9f5 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:35.822679 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-720a3b29-dc67-49e9-bfb5-027d9901b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:35.895209 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1009/2028] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:35.904318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe04a6-3141-4628-9e99-264b368d0b72 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:35.904855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe04a6-3141-4628-9e99-264b368d0b72 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:35.905327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe04a6-3141-4628-9e99-264b368d0b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:35.926476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-1afe04a6-3141-4628-9e99-264b368d0b72 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:35.928253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1afe04a6-3141-4628-9e99-264b368d0b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:35.936534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1020/2029] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:35.941305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a3b29-dc67-49e9-bfb5-027d9901b9f5 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:35.950971 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a3b29-dc67-49e9-bfb5-027d9901b9f5 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:35.955486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9bc7c-e1aa-4964-b7e3-b023a958b677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:35.956082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bc7c-e1aa-4964-b7e3-b023a958b677 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:35.956357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bc7c-e1aa-4964-b7e3-b023a958b677 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:35.956688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bc7c-e1aa-4964-b7e3-b023a958b677 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:35.957327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9bc7c-e1aa-4964-b7e3-b023a958b677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:35.957649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9bc7c-e1aa-4964-b7e3-b023a958b677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:35.959253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9bc7c-e1aa-4964-b7e3-b023a958b677 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:35.971182 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1010/2030] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:57:35.975714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe04a6-3141-4628-9e99-264b368d0b72 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:35.984930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe04a6-3141-4628-9e99-264b368d0b72 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:35.990205 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbabb8-c716-4bcb-8b87-1c975ab3657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:35.990836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbabb8-c716-4bcb-8b87-1c975ab3657f admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:35.991150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbabb8-c716-4bcb-8b87-1c975ab3657f admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:35.997463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbabb8-c716-4bcb-8b87-1c975ab3657f admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:35.997463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:35.997463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbabb8-c716-4bcb-8b87-1c975ab3657f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:35.997463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbabb8-c716-4bcb-8b87-1c975ab3657f admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:36.115041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1021/2031] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:35 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:36.122453 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9bc7c-e1aa-4964-b7e3-b023a958b677 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:36.132584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9bc7c-e1aa-4964-b7e3-b023a958b677 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:36.210294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:36.213334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d230a-03be-4f4e-81ba-b8043c039505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:36.214414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d230a-03be-4f4e-81ba-b8043c039505 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:36.214806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d230a-03be-4f4e-81ba-b8043c039505 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:36.215253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d230a-03be-4f4e-81ba-b8043c039505 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:36.216094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d230a-03be-4f4e-81ba-b8043c039505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:36.218871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d230a-03be-4f4e-81ba-b8043c039505 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:36.320266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1011/2032] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:36 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:36.324407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbabb8-c716-4bcb-8b87-1c975ab3657f admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:36.337731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbabb8-c716-4bcb-8b87-1c975ab3657f admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:36.343111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac68392-aaf2-4d7d-9c9f-0109afef2816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:36.343463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac68392-aaf2-4d7d-9c9f-0109afef2816 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:36.343880 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac68392-aaf2-4d7d-9c9f-0109afef2816 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:36.344283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac68392-aaf2-4d7d-9c9f-0109afef2816 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:36.345209 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac68392-aaf2-4d7d-9c9f-0109afef2816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:36.347253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac68392-aaf2-4d7d-9c9f-0109afef2816 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:36.357844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1022/2033] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:36.362999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d230a-03be-4f4e-81ba-b8043c039505 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:36.372983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d230a-03be-4f4e-81ba-b8043c039505 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:36.378742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bf7ed-9565-4767-802d-4b4bfdfea9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:36.379466 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bf7ed-9565-4767-802d-4b4bfdfea9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:36.379755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bf7ed-9565-4767-802d-4b4bfdfea9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:36.380028 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bf7ed-9565-4767-802d-4b4bfdfea9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:36.380675 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bf7ed-9565-4767-802d-4b4bfdfea9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:36.382398 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bf7ed-9565-4767-802d-4b4bfdfea9e1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:36.395650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1012/2034] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:36.400402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac68392-aaf2-4d7d-9c9f-0109afef2816 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:36.411471 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac68392-aaf2-4d7d-9c9f-0109afef2816 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:36.416145 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f14a1d-1f2f-484d-8915-d57b24b874b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:36.416799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f14a1d-1f2f-484d-8915-d57b24b874b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:36.417458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f14a1d-1f2f-484d-8915-d57b24b874b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:36.417458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f14a1d-1f2f-484d-8915-d57b24b874b2 admin admin] PATH_INFO: `/v3/projects/3f7be33bbf97463da889a4fd26a8a0f6/users/beb584597db44ff08b5ca1b78ee3f5d1/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:36.435124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f14a1d-1f2f-484d-8915-d57b24b874b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7be33bbf97463da889a4fd26a8a0f6, user_id=beb584597db44ff08b5ca1b78ee3f5d1, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:36.438061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f14a1d-1f2f-484d-8915-d57b24b874b2 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:36.517111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:36.526399 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1023/2035] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:36 2022] PUT /identity/v3/projects/3f7be33bbf97463da889a4fd26a8a0f6/users/beb584597db44ff08b5ca1b78ee3f5d1/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:36.537974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e1182-f1bd-408d-a6fd-6067aecb2741 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:36.538280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e1182-f1bd-408d-a6fd-6067aecb2741 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:36.538642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e1182-f1bd-408d-a6fd-6067aecb2741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:36.567596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-e75e1182-f1bd-408d-a6fd-6067aecb2741 None None] MFA Rules not processed for user `beb584597db44ff08b5ca1b78ee3f5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:36.568821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e75e1182-f1bd-408d-a6fd-6067aecb2741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:36.647215 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1013/2036] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:36.651666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f14a1d-1f2f-484d-8915-d57b24b874b2 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:36.743915 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f14a1d-1f2f-484d-8915-d57b24b874b2 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:36.748871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f0e06-7a2c-45b9-85bf-d9db55980c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:36.749499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f0e06-7a2c-45b9-85bf-d9db55980c36 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:36.749776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f0e06-7a2c-45b9-85bf-d9db55980c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:36.750047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f0e06-7a2c-45b9-85bf-d9db55980c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:36.750698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f0e06-7a2c-45b9-85bf-d9db55980c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:36.753221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f0e06-7a2c-45b9-85bf-d9db55980c36 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:36.837187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1024/2037] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:36 2022] POST /identity/v3/projects => generated 363 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:36.841425 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e1182-f1bd-408d-a6fd-6067aecb2741 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:36.853071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e1182-f1bd-408d-a6fd-6067aecb2741 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:36.921387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9684a-9fc7-4bde-8c8d-73ab3cefdaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:36.922144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9684a-9fc7-4bde-8c8d-73ab3cefdaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:36.922445 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9684a-9fc7-4bde-8c8d-73ab3cefdaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:36.922719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9684a-9fc7-4bde-8c8d-73ab3cefdaf9 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:36.923395 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9684a-9fc7-4bde-8c8d-73ab3cefdaf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:36.925577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9684a-9fc7-4bde-8c8d-73ab3cefdaf9 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:37.005614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:37.019181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1014/2038] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:36 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:37.021103 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f0e06-7a2c-45b9-85bf-d9db55980c36 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:37.032949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f0e06-7a2c-45b9-85bf-d9db55980c36 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:37.040056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81c353-8796-47c8-be5b-8d2ebc897987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:37.040732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c353-8796-47c8-be5b-8d2ebc897987 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:37.041090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c353-8796-47c8-be5b-8d2ebc897987 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:37.041373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c353-8796-47c8-be5b-8d2ebc897987 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:37.042021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81c353-8796-47c8-be5b-8d2ebc897987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:37.043740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81c353-8796-47c8-be5b-8d2ebc897987 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:37.064428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1025/2039] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:37.069524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9684a-9fc7-4bde-8c8d-73ab3cefdaf9 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:37.085962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9684a-9fc7-4bde-8c8d-73ab3cefdaf9 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:37.109828 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5770e-45d1-457c-82c0-e4e6128d210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:37.110704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5770e-45d1-457c-82c0-e4e6128d210a admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:37.111014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5770e-45d1-457c-82c0-e4e6128d210a admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:37.111289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5770e-45d1-457c-82c0-e4e6128d210a admin admin] PATH_INFO: `/v3/projects/8a4135b3bfb544e28c7fae47c8d90488/users/d8d7dfc99dfc4227ac221517c28ee29f/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:37.136159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5770e-45d1-457c-82c0-e4e6128d210a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4135b3bfb544e28c7fae47c8d90488, user_id=d8d7dfc99dfc4227ac221517c28ee29f, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:37.139601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:37.139820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5770e-45d1-457c-82c0-e4e6128d210a admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:37.220701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1015/2040] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:37 2022] PUT /identity/v3/projects/8a4135b3bfb544e28c7fae47c8d90488/users/d8d7dfc99dfc4227ac221517c28ee29f/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:37.224584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81c353-8796-47c8-be5b-8d2ebc897987 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:37.235397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81c353-8796-47c8-be5b-8d2ebc897987 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:37.306610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bf1b9-ee4f-4d26-8a1d-fb7c2778be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:37.307534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bf1b9-ee4f-4d26-8a1d-fb7c2778be00 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:37.307534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bf1b9-ee4f-4d26-8a1d-fb7c2778be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:37.307799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bf1b9-ee4f-4d26-8a1d-fb7c2778be00 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:37.308635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bf1b9-ee4f-4d26-8a1d-fb7c2778be00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:37.310513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bf1b9-ee4f-4d26-8a1d-fb7c2778be00 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:37.323192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1026/2041] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:37.326437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5770e-45d1-457c-82c0-e4e6128d210a admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:37.338863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5770e-45d1-457c-82c0-e4e6128d210a admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:37.343661 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047de7b-16b4-4b29-8502-9203dbedb595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:37.344438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047de7b-16b4-4b29-8502-9203dbedb595 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:37.344770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047de7b-16b4-4b29-8502-9203dbedb595 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:37.345136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047de7b-16b4-4b29-8502-9203dbedb595 admin admin] PATH_INFO: `/v3/projects/8a4135b3bfb544e28c7fae47c8d90488/users/d8d7dfc99dfc4227ac221517c28ee29f/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:37.347627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047de7b-16b4-4b29-8502-9203dbedb595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4135b3bfb544e28c7fae47c8d90488, user_id=d8d7dfc99dfc4227ac221517c28ee29f, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:37.350361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047de7b-16b4-4b29-8502-9203dbedb595 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:37.360808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1016/2042] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:37 2022] PUT /identity/v3/projects/8a4135b3bfb544e28c7fae47c8d90488/users/d8d7dfc99dfc4227ac221517c28ee29f/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:37.371959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130442a-f1f5-4bb5-bfe3-2f321febf946 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:37.372337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130442a-f1f5-4bb5-bfe3-2f321febf946 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:37.372744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130442a-f1f5-4bb5-bfe3-2f321febf946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:37.402656 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e130442a-f1f5-4bb5-bfe3-2f321febf946 None None] MFA Rules not processed for user `d8d7dfc99dfc4227ac221517c28ee29f`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:37.403942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e130442a-f1f5-4bb5-bfe3-2f321febf946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:37.483209 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1027/2043] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:37.497524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047de7b-16b4-4b29-8502-9203dbedb595 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:37.501626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5047de7b-16b4-4b29-8502-9203dbedb595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:37.581476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047de7b-16b4-4b29-8502-9203dbedb595 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:37.586685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5e21f-e383-4695-b40e-5df82a2f2891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:37.587350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5e21f-e383-4695-b40e-5df82a2f2891 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:37.587629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5e21f-e383-4695-b40e-5df82a2f2891 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:37.587928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5e21f-e383-4695-b40e-5df82a2f2891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:37.607492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5e21f-e383-4695-b40e-5df82a2f2891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:37.609503 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5e21f-e383-4695-b40e-5df82a2f2891 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:37.625572 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1017/2044] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:38.009925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:38.115842 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:38.439354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:38.784682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130442a-f1f5-4bb5-bfe3-2f321febf946 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:38.861754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130442a-f1f5-4bb5-bfe3-2f321febf946 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:38.871834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:38.872610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:38.872970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:38.873244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] PATH_INFO: `/v3/users/beb584597db44ff08b5ca1b78ee3f5d1` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:38.876463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb584597db44ff08b5ca1b78ee3f5d1)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:38.879024 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:39.103507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb584597db44ff08b5ca1b78ee3f5d1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:39.116363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb584597db44ff08b5ca1b78ee3f5d1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:39.124444 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb584597db44ff08b5ca1b78ee3f5d1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:39.125840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb584597db44ff08b5ca1b78ee3f5d1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:39.126616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb584597db44ff08b5ca1b78ee3f5d1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:39.173446 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:39.204844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1028/2045] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:38 2022] DELETE /identity/v3/users/beb584597db44ff08b5ca1b78ee3f5d1 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:39.210043 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441e93b-8678-4896-af90-c9c18ea57bd0 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:39.210460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441e93b-8678-4896-af90-c9c18ea57bd0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:39.210994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441e93b-8678-4896-af90-c9c18ea57bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:39.233785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-0441e93b-8678-4896-af90-c9c18ea57bd0 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:39.235077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0441e93b-8678-4896-af90-c9c18ea57bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:39.309057 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1018/2046] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:39.318786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:39.320358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:39.387496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d730f-c75e-4bdf-94e3-21554eb05354 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:39.391684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd9454-0e56-4a0e-837c-4c331cd59eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:39.392266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd9454-0e56-4a0e-837c-4c331cd59eec service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:39.393986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd9454-0e56-4a0e-837c-4c331cd59eec service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:39.393986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd9454-0e56-4a0e-837c-4c331cd59eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:39.404315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd9454-0e56-4a0e-837c-4c331cd59eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:39.405853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd9454-0e56-4a0e-837c-4c331cd59eec service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:39.420392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:39.427056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1029/2047] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:39.790356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:39.868457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441e93b-8678-4896-af90-c9c18ea57bd0 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:39.869971 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0441e93b-8678-4896-af90-c9c18ea57bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:39.882340 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441e93b-8678-4896-af90-c9c18ea57bd0 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:39.887078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:39.887728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:39.888009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:39.888287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] PATH_INFO: `/v3/projects/3f7be33bbf97463da889a4fd26a8a0f6` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:39.889431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f7be33bbf97463da889a4fd26a8a0f6)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:39.891386 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:40.008065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f7be33bbf97463da889a4fd26a8a0f6', 'request_id': 'req-9e9bc5b8-bb55-49dc-969f-c8ef89081902'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:40.016322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f7be33bbf97463da889a4fd26a8a0f6', 'request_id': 'req-9e9bc5b8-bb55-49dc-969f-c8ef89081902'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:40.024419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f7be33bbf97463da889a4fd26a8a0f6', 'request_id': 'req-9e9bc5b8-bb55-49dc-969f-c8ef89081902'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:40.157098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] The token cache is being invalidate because project 3f7be33bbf97463da889a4fd26a8a0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:40.157389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:40.158012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:40.159593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1019/2048] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:39 2022] DELETE /identity/v3/projects/3f7be33bbf97463da889a4fd26a8a0f6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:40.163614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd9454-0e56-4a0e-837c-4c331cd59eec service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:40.173093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd9454-0e56-4a0e-837c-4c331cd59eec service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:40.231484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44d0a6-d3c4-4f30-a90f-45d79dfa9a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:40.232153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44d0a6-d3c4-4f30-a90f-45d79dfa9a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:40.232431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44d0a6-d3c4-4f30-a90f-45d79dfa9a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:40.232705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44d0a6-d3c4-4f30-a90f-45d79dfa9a69 admin admin] PATH_INFO: `/v3/users/d8d7dfc99dfc4227ac221517c28ee29f` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:40.233848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44d0a6-d3c4-4f30-a90f-45d79dfa9a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d7dfc99dfc4227ac221517c28ee29f)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:40.235834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44d0a6-d3c4-4f30-a90f-45d79dfa9a69 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:40.469028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0f44d0a6-d3c4-4f30-a90f-45d79dfa9a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d7dfc99dfc4227ac221517c28ee29f'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:40.482571 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0f44d0a6-d3c4-4f30-a90f-45d79dfa9a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d7dfc99dfc4227ac221517c28ee29f'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:40.490339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0f44d0a6-d3c4-4f30-a90f-45d79dfa9a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d7dfc99dfc4227ac221517c28ee29f'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:40.501162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0f44d0a6-d3c4-4f30-a90f-45d79dfa9a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d7dfc99dfc4227ac221517c28ee29f'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:40.501868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0f44d0a6-d3c4-4f30-a90f-45d79dfa9a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d7dfc99dfc4227ac221517c28ee29f'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:40.619206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1030/2049] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:40 2022] DELETE /identity/v3/users/d8d7dfc99dfc4227ac221517c28ee29f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:40.667839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:40.669564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:40.684717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc5b8-bb55-49dc-969f-c8ef89081902 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:40.748967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:40.749674 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:40.749967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:40.750229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] PATH_INFO: `/v3/users/23e6dd5874a34b46b8d648c67b2ecc70` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:40.751382 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e6dd5874a34b46b8d648c67b2ecc70)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:40.753889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:40.864792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:40.942851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e6dd5874a34b46b8d648c67b2ecc70'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:40.952179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:41.032068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e6dd5874a34b46b8d648c67b2ecc70'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.040016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e6dd5874a34b46b8d648c67b2ecc70'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.040680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e6dd5874a34b46b8d648c67b2ecc70'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.052865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e6dd5874a34b46b8d648c67b2ecc70'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.059227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1020/2050] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:40 2022] DELETE /identity/v3/users/23e6dd5874a34b46b8d648c67b2ecc70 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:41.063400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02b577-75e2-4824-b8a9-b985f6e9209c None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:41.063702 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02b577-75e2-4824-b8a9-b985f6e9209c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:41.063988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02b577-75e2-4824-b8a9-b985f6e9209c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:41.085306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-5c02b577-75e2-4824-b8a9-b985f6e9209c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:41.090634 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5c02b577-75e2-4824-b8a9-b985f6e9209c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:41.092187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:41.093758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:41.166872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1031/2051] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:41.176611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960cf3-e736-4262-95c9-d178aec5308b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:41.180028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02b577-75e2-4824-b8a9-b985f6e9209c None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:41.181666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6120f1-aa9d-4722-b775-88aa9f1df26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:41.182611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6120f1-aa9d-4722-b775-88aa9f1df26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:41.182767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5c02b577-75e2-4824-b8a9-b985f6e9209c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:41.182905 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6120f1-aa9d-4722-b775-88aa9f1df26e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:41.183009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6120f1-aa9d-4722-b775-88aa9f1df26e admin admin] PATH_INFO: `/v3/projects/8a4135b3bfb544e28c7fae47c8d90488` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:41.184314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6120f1-aa9d-4722-b775-88aa9f1df26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4135b3bfb544e28c7fae47c8d90488)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:41.186798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6120f1-aa9d-4722-b775-88aa9f1df26e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:41.253176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02b577-75e2-4824-b8a9-b985f6e9209c None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:41.256921 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0029-3af4-4632-b4d7-afe6bbf9da6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:41.257539 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0029-3af4-4632-b4d7-afe6bbf9da6f service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:41.257973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0029-3af4-4632-b4d7-afe6bbf9da6f service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:41.258253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0029-3af4-4632-b4d7-afe6bbf9da6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:41.267812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a0029-3af4-4632-b4d7-afe6bbf9da6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:41.272160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a0029-3af4-4632-b4d7-afe6bbf9da6f service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:41.279341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1032/2052] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:41.363515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-6b6120f1-aa9d-4722-b775-88aa9f1df26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4135b3bfb544e28c7fae47c8d90488', 'request_id': 'req-6b6120f1-aa9d-4722-b775-88aa9f1df26e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.369128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-6b6120f1-aa9d-4722-b775-88aa9f1df26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4135b3bfb544e28c7fae47c8d90488', 'request_id': 'req-6b6120f1-aa9d-4722-b775-88aa9f1df26e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.375641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-6b6120f1-aa9d-4722-b775-88aa9f1df26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4135b3bfb544e28c7fae47c8d90488', 'request_id': 'req-6b6120f1-aa9d-4722-b775-88aa9f1df26e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.447235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-6b6120f1-aa9d-4722-b775-88aa9f1df26e admin admin] The token cache is being invalidate because project 8a4135b3bfb544e28c7fae47c8d90488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:41.447579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-6b6120f1-aa9d-4722-b775-88aa9f1df26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.448280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-6b6120f1-aa9d-4722-b775-88aa9f1df26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.450575 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1021/2053] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:41 2022] DELETE /identity/v3/projects/8a4135b3bfb544e28c7fae47c8d90488 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:41.454931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2d60c-e012-4632-9a11-2b879c0df9ad None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:41.455817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2d60c-e012-4632-9a11-2b879c0df9ad None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:41.456285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2d60c-e012-4632-9a11-2b879c0df9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:41.477133 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-cdf2d60c-e012-4632-9a11-2b879c0df9ad None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:41.478388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cdf2d60c-e012-4632-9a11-2b879c0df9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:41.561121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1033/2054] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:41.562997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2914b8d-6480-4a82-bed7-1f9bddc19186 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:41.563288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2914b8d-6480-4a82-bed7-1f9bddc19186 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:41.563593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2914b8d-6480-4a82-bed7-1f9bddc19186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:41.586697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f2914b8d-6480-4a82-bed7-1f9bddc19186 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:41.587966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f2914b8d-6480-4a82-bed7-1f9bddc19186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:41.596380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1022/2055] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:41.600840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2d60c-e012-4632-9a11-2b879c0df9ad None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:41.611022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2d60c-e012-4632-9a11-2b879c0df9ad None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:41.615977 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29876f-7dda-4de4-9ec5-9e539252d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:41.616580 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29876f-7dda-4de4-9ec5-9e539252d62b admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:41.616863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29876f-7dda-4de4-9ec5-9e539252d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:41.617142 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29876f-7dda-4de4-9ec5-9e539252d62b admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:41.617825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29876f-7dda-4de4-9ec5-9e539252d62b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:41.618148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29876f-7dda-4de4-9ec5-9e539252d62b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:41.619945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29876f-7dda-4de4-9ec5-9e539252d62b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:41.632245 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1034/2056] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:57:41.636705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2914b8d-6480-4a82-bed7-1f9bddc19186 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:41.646767 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2914b8d-6480-4a82-bed7-1f9bddc19186 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:41.651800 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6782-ed2a-48ef-98cf-3a157fe5b35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:41.652443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6782-ed2a-48ef-98cf-3a157fe5b35b admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:41.652726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6782-ed2a-48ef-98cf-3a157fe5b35b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:41.653003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6782-ed2a-48ef-98cf-3a157fe5b35b admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:41.653705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e6782-ed2a-48ef-98cf-3a157fe5b35b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:41.655135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:41.655671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e6782-ed2a-48ef-98cf-3a157fe5b35b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:41.686252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29876f-7dda-4de4-9ec5-9e539252d62b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:41.688283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1b29876f-7dda-4de4-9ec5-9e539252d62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:41.704821 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29876f-7dda-4de4-9ec5-9e539252d62b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:41.711792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:41.712387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:41.712652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:41.712928 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] PATH_INFO: `/v3/projects/17d45db2782d40e98ad0c0fa93d561d0` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:41.714075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=17d45db2782d40e98ad0c0fa93d561d0)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:41.716018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:41.785745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:41.786246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1023/2057] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:41 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:41.788456 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6782-ed2a-48ef-98cf-3a157fe5b35b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:41.856946 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d45db2782d40e98ad0c0fa93d561d0', 'request_id': 'req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.858353 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6782-ed2a-48ef-98cf-3a157fe5b35b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:41.873830 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d45db2782d40e98ad0c0fa93d561d0', 'request_id': 'req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.925118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aab7aa-a1cd-4bc6-96da-46714de4ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:41.925754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab7aa-a1cd-4bc6-96da-46714de4ffc1 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:41.926033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab7aa-a1cd-4bc6-96da-46714de4ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:41.926308 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab7aa-a1cd-4bc6-96da-46714de4ffc1 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:41.927294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aab7aa-a1cd-4bc6-96da-46714de4ffc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:41.931723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aab7aa-a1cd-4bc6-96da-46714de4ffc1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:41.958612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d45db2782d40e98ad0c0fa93d561d0', 'request_id': 'req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.975590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] The token cache is being invalidate because project 17d45db2782d40e98ad0c0fa93d561d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:41.975872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.977117 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:41.984078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1035/2058] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:41 2022] DELETE /identity/v3/projects/17d45db2782d40e98ad0c0fa93d561d0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:41.984078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:41.985121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:42.004110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84772d29-30e1-4e3c-9ef2-7cb61b4e60aa admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:42.010164 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:42.012129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:42.012129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:42.012129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] PATH_INFO: `/v3/users/3103b603f0734d048b045d342af2ac7a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:42.013544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3103b603f0734d048b045d342af2ac7a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:42.016844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:42.040063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1024/2059] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:41 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:42.045315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aab7aa-a1cd-4bc6-96da-46714de4ffc1 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:42.048187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b3aab7aa-a1cd-4bc6-96da-46714de4ffc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:42.060827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aab7aa-a1cd-4bc6-96da-46714de4ffc1 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:42.066122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c201b-fecd-489a-a2f2-80972c75454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:42.066922 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c201b-fecd-489a-a2f2-80972c75454b admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:42.067218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c201b-fecd-489a-a2f2-80972c75454b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:42.067484 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c201b-fecd-489a-a2f2-80972c75454b admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:42.068145 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c201b-fecd-489a-a2f2-80972c75454b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:42.069755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c201b-fecd-489a-a2f2-80972c75454b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:42.081708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1025/2060] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:42.086096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c201b-fecd-489a-a2f2-80972c75454b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:42.099050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c201b-fecd-489a-a2f2-80972c75454b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:42.104059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b0b19-3d05-480c-8f62-876a7d785afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:42.104946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b0b19-3d05-480c-8f62-876a7d785afc admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:42.105248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b0b19-3d05-480c-8f62-876a7d785afc admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:42.105527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b0b19-3d05-480c-8f62-876a7d785afc admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:42.106242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b0b19-3d05-480c-8f62-876a7d785afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:42.108250 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b0b19-3d05-480c-8f62-876a7d785afc admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:42.125355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1026/2061] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:42.127448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b0b19-3d05-480c-8f62-876a7d785afc admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:42.140325 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b0b19-3d05-480c-8f62-876a7d785afc admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:42.146794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d715c-3335-4b6c-be20-3aafee4aa496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:42.147533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d715c-3335-4b6c-be20-3aafee4aa496 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:42.148265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d715c-3335-4b6c-be20-3aafee4aa496 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:42.148265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d715c-3335-4b6c-be20-3aafee4aa496 admin admin] PATH_INFO: `/v3/projects/9f54c7eb152e44daa0953f70db964398/users/e5be0c08b9eb425fa39d548765359205/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:42.169116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d715c-3335-4b6c-be20-3aafee4aa496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f54c7eb152e44daa0953f70db964398, user_id=e5be0c08b9eb425fa39d548765359205, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:42.172020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d715c-3335-4b6c-be20-3aafee4aa496 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:42.238546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3103b603f0734d048b045d342af2ac7a'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:42.250075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3103b603f0734d048b045d342af2ac7a'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:42.258082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3103b603f0734d048b045d342af2ac7a'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:42.259019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3103b603f0734d048b045d342af2ac7a'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:42.259619 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3103b603f0734d048b045d342af2ac7a'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:42.266090 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1027/2062] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:42 2022] PUT /identity/v3/projects/9f54c7eb152e44daa0953f70db964398/users/e5be0c08b9eb425fa39d548765359205/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:42.277268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc260af-123c-4b36-b49d-616d97e6e9b6 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:42.278140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc260af-123c-4b36-b49d-616d97e6e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:42.278424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc260af-123c-4b36-b49d-616d97e6e9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:42.307094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-dfc260af-123c-4b36-b49d-616d97e6e9b6 None None] MFA Rules not processed for user `e5be0c08b9eb425fa39d548765359205`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:42.308343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-dfc260af-123c-4b36-b49d-616d97e6e9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:42.373998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1028/2063] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:42.378293 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc260af-123c-4b36-b49d-616d97e6e9b6 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:42.379702 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-dfc260af-123c-4b36-b49d-616d97e6e9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:42.384977 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1036/2064] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:41 2022] DELETE /identity/v3/users/3103b603f0734d048b045d342af2ac7a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:42.453983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc260af-123c-4b36-b49d-616d97e6e9b6 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:42.487999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:42.518870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e26f76-756f-4b86-9f2f-ac26e0335460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:42.519567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e26f76-756f-4b86-9f2f-ac26e0335460 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:42.519871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e26f76-756f-4b86-9f2f-ac26e0335460 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:42.520146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e26f76-756f-4b86-9f2f-ac26e0335460 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:42.520774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e26f76-756f-4b86-9f2f-ac26e0335460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:42.522777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e26f76-756f-4b86-9f2f-ac26e0335460 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:42.621260 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:42.629309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1029/2065] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:42 2022] POST /identity/v3/projects => generated 369 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:42.633128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:42.646770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1d05c-cfde-4b20-8b8c-7e802df82abc admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:42.720304 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d52dd-650b-49a0-80bd-35ae9120ecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:42.721795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d52dd-650b-49a0-80bd-35ae9120ecf1 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:42.722078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d52dd-650b-49a0-80bd-35ae9120ecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:42.722349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d52dd-650b-49a0-80bd-35ae9120ecf1 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:42.723021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d52dd-650b-49a0-80bd-35ae9120ecf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:42.725137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d52dd-650b-49a0-80bd-35ae9120ecf1 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:42.800884 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1037/2066] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:42 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:42.805259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e26f76-756f-4b86-9f2f-ac26e0335460 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:42.816949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e26f76-756f-4b86-9f2f-ac26e0335460 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:42.821937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807b25b-4545-4490-be60-1eaf5ebddd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:42.822560 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807b25b-4545-4490-be60-1eaf5ebddd4d admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:42.823040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807b25b-4545-4490-be60-1eaf5ebddd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:42.823321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807b25b-4545-4490-be60-1eaf5ebddd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:42.824012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807b25b-4545-4490-be60-1eaf5ebddd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:42.825751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807b25b-4545-4490-be60-1eaf5ebddd4d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:42.839560 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1030/2067] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:42.848115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d52dd-650b-49a0-80bd-35ae9120ecf1 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:42.858535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d52dd-650b-49a0-80bd-35ae9120ecf1 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:42.864743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cba000-e553-449a-b804-cdefed2bc20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:42.865421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cba000-e553-449a-b804-cdefed2bc20c admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:42.865697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cba000-e553-449a-b804-cdefed2bc20c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:42.866005 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cba000-e553-449a-b804-cdefed2bc20c admin admin] PATH_INFO: `/v3/projects/9432420b2651436194437f8e7fc0d930/users/5d224c8e7c8b492c930dfcc0de9aad58/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:42.881993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cba000-e553-449a-b804-cdefed2bc20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9432420b2651436194437f8e7fc0d930, user_id=5d224c8e7c8b492c930dfcc0de9aad58, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:42.884672 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cba000-e553-449a-b804-cdefed2bc20c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:42.980173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1038/2068] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:42 2022] PUT /identity/v3/projects/9432420b2651436194437f8e7fc0d930/users/5d224c8e7c8b492c930dfcc0de9aad58/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:42.984334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807b25b-4545-4490-be60-1eaf5ebddd4d admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:42.994982 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807b25b-4545-4490-be60-1eaf5ebddd4d admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:43.053650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb347e80-e640-40ae-8b9f-219fa43506cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:43.054262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb347e80-e640-40ae-8b9f-219fa43506cf admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:43.054541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb347e80-e640-40ae-8b9f-219fa43506cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:43.054811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb347e80-e640-40ae-8b9f-219fa43506cf admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:43.055475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb347e80-e640-40ae-8b9f-219fa43506cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:43.057054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb347e80-e640-40ae-8b9f-219fa43506cf admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:43.067493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1031/2069] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:43.071992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cba000-e553-449a-b804-cdefed2bc20c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:43.083080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cba000-e553-449a-b804-cdefed2bc20c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:43.088045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe402b86-903f-49d9-ad5a-34f72232cf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:43.088715 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402b86-903f-49d9-ad5a-34f72232cf81 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:43.088995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402b86-903f-49d9-ad5a-34f72232cf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:43.089306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402b86-903f-49d9-ad5a-34f72232cf81 admin admin] PATH_INFO: `/v3/projects/9432420b2651436194437f8e7fc0d930/users/5d224c8e7c8b492c930dfcc0de9aad58/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:43.091258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe402b86-903f-49d9-ad5a-34f72232cf81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9432420b2651436194437f8e7fc0d930, user_id=5d224c8e7c8b492c930dfcc0de9aad58, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:43.093924 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe402b86-903f-49d9-ad5a-34f72232cf81 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:43.104460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1039/2070] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:43 2022] PUT /identity/v3/projects/9432420b2651436194437f8e7fc0d930/users/5d224c8e7c8b492c930dfcc0de9aad58/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:43.115007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c300795-a8a3-4adb-8800-4c5d07988022 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:43.115319 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c300795-a8a3-4adb-8800-4c5d07988022 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:43.115589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c300795-a8a3-4adb-8800-4c5d07988022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:43.132417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe402b86-903f-49d9-ad5a-34f72232cf81 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:43.134331 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-fe402b86-903f-49d9-ad5a-34f72232cf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:43.153222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-1c300795-a8a3-4adb-8800-4c5d07988022 None None] MFA Rules not processed for user `5d224c8e7c8b492c930dfcc0de9aad58`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:43.154851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1c300795-a8a3-4adb-8800-4c5d07988022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:43.220892 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe402b86-903f-49d9-ad5a-34f72232cf81 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:43.225749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008e84d-e234-497d-9686-59ad31aca4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:43.226389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008e84d-e234-497d-9686-59ad31aca4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:43.226669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008e84d-e234-497d-9686-59ad31aca4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:43.226972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008e84d-e234-497d-9686-59ad31aca4e0 admin admin] PATH_INFO: `/v3/projects/cc358b34148145a7b436bc8a8274b920` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:43.228112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008e84d-e234-497d-9686-59ad31aca4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc358b34148145a7b436bc8a8274b920)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:43.230027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008e84d-e234-497d-9686-59ad31aca4e0 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:43.236441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1032/2071] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:43.243579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:43.248042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c300795-a8a3-4adb-8800-4c5d07988022 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:43.249427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1c300795-a8a3-4adb-8800-4c5d07988022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:43.315369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c300795-a8a3-4adb-8800-4c5d07988022 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:43.319710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6a8c4-586f-447d-abe3-ac6414d2c252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:43.320272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6a8c4-586f-447d-abe3-ac6414d2c252 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:43.320585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6a8c4-586f-447d-abe3-ac6414d2c252 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:43.320825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6a8c4-586f-447d-abe3-ac6414d2c252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:43.331245 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6a8c4-586f-447d-abe3-ac6414d2c252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:43.332725 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6a8c4-586f-447d-abe3-ac6414d2c252 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:43.343906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:43.347496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f008e84d-e234-497d-9686-59ad31aca4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc358b34148145a7b436bc8a8274b920', 'request_id': 'req-f008e84d-e234-497d-9686-59ad31aca4e0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:43.349904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1033/2072] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:43.354750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f008e84d-e234-497d-9686-59ad31aca4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc358b34148145a7b436bc8a8274b920', 'request_id': 'req-f008e84d-e234-497d-9686-59ad31aca4e0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:43.466355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f008e84d-e234-497d-9686-59ad31aca4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc358b34148145a7b436bc8a8274b920', 'request_id': 'req-f008e84d-e234-497d-9686-59ad31aca4e0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:43.478849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f008e84d-e234-497d-9686-59ad31aca4e0 admin admin] The token cache is being invalidate because project cc358b34148145a7b436bc8a8274b920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:43.479200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f008e84d-e234-497d-9686-59ad31aca4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:43.479877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f008e84d-e234-497d-9686-59ad31aca4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:43.481597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1040/2073] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:43 2022] DELETE /identity/v3/projects/cc358b34148145a7b436bc8a8274b920 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:43.486857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955d322-2cff-48aa-90f5-0265626fc1d2 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:43.487051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955d322-2cff-48aa-90f5-0265626fc1d2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:43.487489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955d322-2cff-48aa-90f5-0265626fc1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:43.508022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-b955d322-2cff-48aa-90f5-0265626fc1d2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:43.509248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b955d322-2cff-48aa-90f5-0265626fc1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:43.571609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1034/2074] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:43.579334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c29d2-9c61-4ecc-87ca-c3ad2f75b24d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:43.579597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c29d2-9c61-4ecc-87ca-c3ad2f75b24d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:43.579875 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c29d2-9c61-4ecc-87ca-c3ad2f75b24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:43.609657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-f32c29d2-9c61-4ecc-87ca-c3ad2f75b24d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:43.610978 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f32c29d2-9c61-4ecc-87ca-c3ad2f75b24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:43.628832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1041/2075] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:43.634863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955d322-2cff-48aa-90f5-0265626fc1d2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:43.645525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955d322-2cff-48aa-90f5-0265626fc1d2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:43.663793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5bc42-1bbb-4dbc-a849-62c5d3505a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:43.663793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5bc42-1bbb-4dbc-a849-62c5d3505a80 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:43.663793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5bc42-1bbb-4dbc-a849-62c5d3505a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:43.663793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5bc42-1bbb-4dbc-a849-62c5d3505a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:43.664121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5bc42-1bbb-4dbc-a849-62c5d3505a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:43.664121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5bc42-1bbb-4dbc-a849-62c5d3505a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:43.664121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5bc42-1bbb-4dbc-a849-62c5d3505a80 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:43.687767 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1035/2076] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:57:43.696503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c29d2-9c61-4ecc-87ca-c3ad2f75b24d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:43.707304 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c29d2-9c61-4ecc-87ca-c3ad2f75b24d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:43.715061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce21d20-87d5-4938-bf10-3a2faa6e6d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:43.715745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce21d20-87d5-4938-bf10-3a2faa6e6d4d admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:43.716032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce21d20-87d5-4938-bf10-3a2faa6e6d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:43.721863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce21d20-87d5-4938-bf10-3a2faa6e6d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:43.721863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce21d20-87d5-4938-bf10-3a2faa6e6d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:43.721863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce21d20-87d5-4938-bf10-3a2faa6e6d4d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:43.827551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1042/2077] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:43 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:43.831863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5bc42-1bbb-4dbc-a849-62c5d3505a80 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:43.842715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5bc42-1bbb-4dbc-a849-62c5d3505a80 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:43.848682 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:43.910642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431381a0-c527-46d7-a65f-ae44291ce664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:43.912495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431381a0-c527-46d7-a65f-ae44291ce664 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:43.912495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431381a0-c527-46d7-a65f-ae44291ce664 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:43.912495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431381a0-c527-46d7-a65f-ae44291ce664 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:43.912495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431381a0-c527-46d7-a65f-ae44291ce664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:43.914286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431381a0-c527-46d7-a65f-ae44291ce664 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:44.054375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1036/2078] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:43 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:44.058477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce21d20-87d5-4938-bf10-3a2faa6e6d4d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:44.069150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce21d20-87d5-4938-bf10-3a2faa6e6d4d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:44.073691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6012006-136f-49d2-b29b-bfa5d2c9808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:44.074283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6012006-136f-49d2-b29b-bfa5d2c9808e admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:44.074564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6012006-136f-49d2-b29b-bfa5d2c9808e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:44.074838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6012006-136f-49d2-b29b-bfa5d2c9808e admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:44.075517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6012006-136f-49d2-b29b-bfa5d2c9808e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:44.077106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6012006-136f-49d2-b29b-bfa5d2c9808e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:44.087730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1043/2079] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:44.091582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431381a0-c527-46d7-a65f-ae44291ce664 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:44.095269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:44.110377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431381a0-c527-46d7-a65f-ae44291ce664 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:44.117042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f4611-5239-446f-b212-c76b92485705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:44.117902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f4611-5239-446f-b212-c76b92485705 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:44.118483 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f4611-5239-446f-b212-c76b92485705 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:44.119014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f4611-5239-446f-b212-c76b92485705 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:44.119861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f4611-5239-446f-b212-c76b92485705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:44.121707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f4611-5239-446f-b212-c76b92485705 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:44.135457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1037/2080] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:44.139405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6012006-136f-49d2-b29b-bfa5d2c9808e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:44.159507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6012006-136f-49d2-b29b-bfa5d2c9808e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:44.165290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e9fac-e5af-4bfd-8052-fab933d5a723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:44.167996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9fac-e5af-4bfd-8052-fab933d5a723 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:44.167996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9fac-e5af-4bfd-8052-fab933d5a723 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:44.167996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9fac-e5af-4bfd-8052-fab933d5a723 admin admin] PATH_INFO: `/v3/projects/97ccc8ea72d0424ea85aea7980fa591c/users/0fa8ba3ab3a14b699564cbea344d1b70/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:44.184635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e9fac-e5af-4bfd-8052-fab933d5a723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ccc8ea72d0424ea85aea7980fa591c, user_id=0fa8ba3ab3a14b699564cbea344d1b70, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:44.187667 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e9fac-e5af-4bfd-8052-fab933d5a723 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:44.311402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1044/2081] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:44 2022] PUT /identity/v3/projects/97ccc8ea72d0424ea85aea7980fa591c/users/0fa8ba3ab3a14b699564cbea344d1b70/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:44.323248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9d962-0baa-4131-a3f8-7970120ff5c1 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:44.323536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9d962-0baa-4131-a3f8-7970120ff5c1 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:44.323838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9d962-0baa-4131-a3f8-7970120ff5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:44.352407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f3f9d962-0baa-4131-a3f8-7970120ff5c1 None None] MFA Rules not processed for user `0fa8ba3ab3a14b699564cbea344d1b70`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:44.353608 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f3f9d962-0baa-4131-a3f8-7970120ff5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:44.424397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1038/2082] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:44.428859 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e9fac-e5af-4bfd-8052-fab933d5a723 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:44.501786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e9fac-e5af-4bfd-8052-fab933d5a723 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:44.506909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af6a84-aa92-43f0-8aaa-e64975752c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:44.507659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af6a84-aa92-43f0-8aaa-e64975752c12 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:44.507944 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af6a84-aa92-43f0-8aaa-e64975752c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:44.508220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af6a84-aa92-43f0-8aaa-e64975752c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:44.508859 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af6a84-aa92-43f0-8aaa-e64975752c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:44.510905 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af6a84-aa92-43f0-8aaa-e64975752c12 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:44.628265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1045/2083] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:44 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:44.635027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9d962-0baa-4131-a3f8-7970120ff5c1 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:44.647468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9d962-0baa-4131-a3f8-7970120ff5c1 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:44.737340 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7e57c-7240-4543-bdbf-1a3d8f2804b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:44.743978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7e57c-7240-4543-bdbf-1a3d8f2804b9 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:44.743978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7e57c-7240-4543-bdbf-1a3d8f2804b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:44.743978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7e57c-7240-4543-bdbf-1a3d8f2804b9 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:44.743978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7e57c-7240-4543-bdbf-1a3d8f2804b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:44.743978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7e57c-7240-4543-bdbf-1a3d8f2804b9 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:44.838476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1039/2084] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:44 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:44.842682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af6a84-aa92-43f0-8aaa-e64975752c12 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:44.853339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af6a84-aa92-43f0-8aaa-e64975752c12 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:44.858177 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afb544-bb8a-4dde-a1ce-fe47c450fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:44.858827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afb544-bb8a-4dde-a1ce-fe47c450fa42 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:44.859180 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afb544-bb8a-4dde-a1ce-fe47c450fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:44.859458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afb544-bb8a-4dde-a1ce-fe47c450fa42 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:44.860106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afb544-bb8a-4dde-a1ce-fe47c450fa42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:44.861759 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afb544-bb8a-4dde-a1ce-fe47c450fa42 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:44.874348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1046/2085] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:44.879302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7e57c-7240-4543-bdbf-1a3d8f2804b9 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:44.889240 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7e57c-7240-4543-bdbf-1a3d8f2804b9 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:44.894586 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba92494-aa8d-4384-a00e-c6874964b4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:44.895235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba92494-aa8d-4384-a00e-c6874964b4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:44.895524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba92494-aa8d-4384-a00e-c6874964b4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:44.895830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba92494-aa8d-4384-a00e-c6874964b4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:44.896478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba92494-aa8d-4384-a00e-c6874964b4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:44.898078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba92494-aa8d-4384-a00e-c6874964b4c5 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:44.908568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1040/2086] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:44.912660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afb544-bb8a-4dde-a1ce-fe47c450fa42 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:44.922848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afb544-bb8a-4dde-a1ce-fe47c450fa42 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:44.944735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886635-9bfe-4aa1-b1c5-382e074b04b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:44.944735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886635-9bfe-4aa1-b1c5-382e074b04b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:44.944735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886635-9bfe-4aa1-b1c5-382e074b04b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:44.944735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886635-9bfe-4aa1-b1c5-382e074b04b6 admin admin] PATH_INFO: `/v3/projects/935a397a1e3d4a7e9d01418e2cf93b8d/users/42926de3707f4302a9b9ee96fb813ce4/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:44.958507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5886635-9bfe-4aa1-b1c5-382e074b04b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935a397a1e3d4a7e9d01418e2cf93b8d, user_id=42926de3707f4302a9b9ee96fb813ce4, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:44.961802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5886635-9bfe-4aa1-b1c5-382e074b04b6 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:45.064022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1047/2087] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:44 2022] PUT /identity/v3/projects/935a397a1e3d4a7e9d01418e2cf93b8d/users/42926de3707f4302a9b9ee96fb813ce4/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:45.075897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46967b-10ea-4a19-be5b-c2bb7feb2c73 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:45.076186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46967b-10ea-4a19-be5b-c2bb7feb2c73 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:45.076480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46967b-10ea-4a19-be5b-c2bb7feb2c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:45.106589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-ee46967b-10ea-4a19-be5b-c2bb7feb2c73 None None] MFA Rules not processed for user `42926de3707f4302a9b9ee96fb813ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:45.107921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ee46967b-10ea-4a19-be5b-c2bb7feb2c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:45.176387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1041/2088] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:45.180923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886635-9bfe-4aa1-b1c5-382e074b04b6 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:45.247366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886635-9bfe-4aa1-b1c5-382e074b04b6 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:45.252055 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c95915-1a38-4479-b396-78039448a910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:45.252658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c95915-1a38-4479-b396-78039448a910 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:45.252939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c95915-1a38-4479-b396-78039448a910 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:45.253213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c95915-1a38-4479-b396-78039448a910 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:45.253839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c95915-1a38-4479-b396-78039448a910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:45.255782 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c95915-1a38-4479-b396-78039448a910 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:45.369272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1048/2089] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:45 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:45.372981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46967b-10ea-4a19-be5b-c2bb7feb2c73 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:45.384697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46967b-10ea-4a19-be5b-c2bb7feb2c73 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:45.445097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c634d-2dc1-4fe2-9c96-592b8dbc9eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:45.445830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c634d-2dc1-4fe2-9c96-592b8dbc9eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:45.446041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c634d-2dc1-4fe2-9c96-592b8dbc9eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:45.446322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c634d-2dc1-4fe2-9c96-592b8dbc9eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:45.446984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c634d-2dc1-4fe2-9c96-592b8dbc9eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:45.448945 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c634d-2dc1-4fe2-9c96-592b8dbc9eb2 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:45.546166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1042/2090] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:45 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:45.554379 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c95915-1a38-4479-b396-78039448a910 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:45.566505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c95915-1a38-4479-b396-78039448a910 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:45.572801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf146a8-b760-4864-9108-a2e37629effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:45.584689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf146a8-b760-4864-9108-a2e37629effc admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:45.584689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf146a8-b760-4864-9108-a2e37629effc admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:45.584689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf146a8-b760-4864-9108-a2e37629effc admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:45.584689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf146a8-b760-4864-9108-a2e37629effc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:45.584689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf146a8-b760-4864-9108-a2e37629effc admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:45.592402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1049/2091] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:45.600281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c634d-2dc1-4fe2-9c96-592b8dbc9eb2 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:45.615954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c634d-2dc1-4fe2-9c96-592b8dbc9eb2 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:45.626518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf146a8-b760-4864-9108-a2e37629effc admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:45.629955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ebf146a8-b760-4864-9108-a2e37629effc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:45.633398 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bd80f-0380-42df-8784-b126c572fcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:45.634315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bd80f-0380-42df-8784-b126c572fcb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:45.634944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bd80f-0380-42df-8784-b126c572fcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:45.635429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bd80f-0380-42df-8784-b126c572fcb0 admin admin] PATH_INFO: `/v3/projects/4a93fefbdef748e99a4dd4c30edd8603/users/4a81c657f34c4ff4abd1e46bdf438a82/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:45.655295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf146a8-b760-4864-9108-a2e37629effc admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:45.658228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bd80f-0380-42df-8784-b126c572fcb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a93fefbdef748e99a4dd4c30edd8603, user_id=4a81c657f34c4ff4abd1e46bdf438a82, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:45.662244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bd80f-0380-42df-8784-b126c572fcb0 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:45.664096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33ada8-25f1-4eb4-b885-576ac488b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:45.665175 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33ada8-25f1-4eb4-b885-576ac488b995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:45.665860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33ada8-25f1-4eb4-b885-576ac488b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:45.666331 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33ada8-25f1-4eb4-b885-576ac488b995 admin admin] PATH_INFO: `/v3/users/b121f7c5bed843d1bd31cba4bd7eed35` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:45.668874 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33ada8-25f1-4eb4-b885-576ac488b995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b121f7c5bed843d1bd31cba4bd7eed35)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:45.672715 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33ada8-25f1-4eb4-b885-576ac488b995 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:45.763654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1043/2092] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:45 2022] PUT /identity/v3/projects/4a93fefbdef748e99a4dd4c30edd8603/users/4a81c657f34c4ff4abd1e46bdf438a82/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:45.767641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bd80f-0380-42df-8784-b126c572fcb0 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:45.835962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bd80f-0380-42df-8784-b126c572fcb0 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:45.840614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8e8dc-f545-474b-8179-8958fccbe436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:45.841249 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e8dc-f545-474b-8179-8958fccbe436 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:45.841473 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e8dc-f545-474b-8179-8958fccbe436 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:45.841737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e8dc-f545-474b-8179-8958fccbe436 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:45.842368 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8e8dc-f545-474b-8179-8958fccbe436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:45.844034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8e8dc-f545-474b-8179-8958fccbe436 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:45.854165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1044/2093] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:45.858262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8e8dc-f545-474b-8179-8958fccbe436 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:45.867591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8e8dc-f545-474b-8179-8958fccbe436 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:45.872295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d748-ce9e-4a75-b9e8-037ad31d246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:45.872942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d748-ce9e-4a75-b9e8-037ad31d246f admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:45.873227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d748-ce9e-4a75-b9e8-037ad31d246f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:45.873503 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d748-ce9e-4a75-b9e8-037ad31d246f admin admin] PATH_INFO: `/v3/projects/4a93fefbdef748e99a4dd4c30edd8603/users/4a81c657f34c4ff4abd1e46bdf438a82/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:45.875580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d748-ce9e-4a75-b9e8-037ad31d246f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a93fefbdef748e99a4dd4c30edd8603, user_id=4a81c657f34c4ff4abd1e46bdf438a82, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:45.878261 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d748-ce9e-4a75-b9e8-037ad31d246f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:45.889305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1045/2094] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:45 2022] PUT /identity/v3/projects/4a93fefbdef748e99a4dd4c30edd8603/users/4a81c657f34c4ff4abd1e46bdf438a82/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:45.899811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75458c-7f32-467b-958f-9d92a89f5095 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:45.900100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75458c-7f32-467b-958f-9d92a89f5095 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:45.900380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75458c-7f32-467b-958f-9d92a89f5095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:45.928529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-dc75458c-7f32-467b-958f-9d92a89f5095 None None] MFA Rules not processed for user `4a81c657f34c4ff4abd1e46bdf438a82`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:45.929768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-dc75458c-7f32-467b-958f-9d92a89f5095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:45.952987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ad33ada8-25f1-4eb4-b885-576ac488b995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b121f7c5bed843d1bd31cba4bd7eed35'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:45.975755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ad33ada8-25f1-4eb4-b885-576ac488b995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b121f7c5bed843d1bd31cba4bd7eed35'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:45.985827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ad33ada8-25f1-4eb4-b885-576ac488b995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b121f7c5bed843d1bd31cba4bd7eed35'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:45.987141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ad33ada8-25f1-4eb4-b885-576ac488b995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b121f7c5bed843d1bd31cba4bd7eed35'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:45.987784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ad33ada8-25f1-4eb4-b885-576ac488b995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b121f7c5bed843d1bd31cba4bd7eed35'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:46.019738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1046/2095] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:46.023157 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:46.040522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75458c-7f32-467b-958f-9d92a89f5095 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:46.042130 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-dc75458c-7f32-467b-958f-9d92a89f5095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:46.082343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1050/2096] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:45 2022] DELETE /identity/v3/users/b121f7c5bed843d1bd31cba4bd7eed35 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:46.090075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ee8b8-7dc8-448d-829f-105c244f95b1 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:46.090365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ee8b8-7dc8-448d-829f-105c244f95b1 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:46.090642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ee8b8-7dc8-448d-829f-105c244f95b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:46.114223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-721ee8b8-7dc8-448d-829f-105c244f95b1 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:46.114837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-721ee8b8-7dc8-448d-829f-105c244f95b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:46.115286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75458c-7f32-467b-958f-9d92a89f5095 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:46.170546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:46.182224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9bdc3-709b-4565-a90b-75ab86c90794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:46.182975 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9bdc3-709b-4565-a90b-75ab86c90794 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:46.183417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9bdc3-709b-4565-a90b-75ab86c90794 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:46.183710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9bdc3-709b-4565-a90b-75ab86c90794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:46.193940 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1051/2097] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:46.204036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ee8b8-7dc8-448d-829f-105c244f95b1 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:46.205995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-721ee8b8-7dc8-448d-829f-105c244f95b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:46.248411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9bdc3-709b-4565-a90b-75ab86c90794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:46.249922 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9bdc3-709b-4565-a90b-75ab86c90794 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:46.261885 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1047/2098] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:46.267934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ee8b8-7dc8-448d-829f-105c244f95b1 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:46.271577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469ae5b-b298-4673-8099-04689e7a49b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:46.272176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469ae5b-b298-4673-8099-04689e7a49b7 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:46.272452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469ae5b-b298-4673-8099-04689e7a49b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:46.272721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469ae5b-b298-4673-8099-04689e7a49b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:46.282223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469ae5b-b298-4673-8099-04689e7a49b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:46.283663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469ae5b-b298-4673-8099-04689e7a49b7 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:46.293435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1052/2099] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:46.375211 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9bdc3-709b-4565-a90b-75ab86c90794 service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:46.386235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9bdc3-709b-4565-a90b-75ab86c90794 service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:46.389905 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c22e6-5a32-4d53-8047-e69dabc7b6aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:46.390511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c22e6-5a32-4d53-8047-e69dabc7b6aa service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:46.390791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c22e6-5a32-4d53-8047-e69dabc7b6aa service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:46.391123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c22e6-5a32-4d53-8047-e69dabc7b6aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:46.401196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8d1c22e6-5a32-4d53-8047-e69dabc7b6aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:46.468353 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c22e6-5a32-4d53-8047-e69dabc7b6aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:46.469782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c22e6-5a32-4d53-8047-e69dabc7b6aa service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:46.480131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1048/2100] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:46.754302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469ae5b-b298-4673-8099-04689e7a49b7 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:46.755795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2469ae5b-b298-4673-8099-04689e7a49b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:46.797069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469ae5b-b298-4673-8099-04689e7a49b7 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:46.802674 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:46.803347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:46.803620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:46.803896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] PATH_INFO: `/v3/projects/34dcf47dd901424593f8243019ebd047` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:46.805138 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34dcf47dd901424593f8243019ebd047)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:46.807062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:46.950705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34dcf47dd901424593f8243019ebd047', 'request_id': 'req-9bd9d73e-38e3-442e-9a63-ec97973ed789'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:46.956496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34dcf47dd901424593f8243019ebd047', 'request_id': 'req-9bd9d73e-38e3-442e-9a63-ec97973ed789'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:47.065269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34dcf47dd901424593f8243019ebd047', 'request_id': 'req-9bd9d73e-38e3-442e-9a63-ec97973ed789'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:47.074422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] The token cache is being invalidate because project 34dcf47dd901424593f8243019ebd047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:47.074718 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:47.075596 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:47.089321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1053/2101] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:46 2022] DELETE /identity/v3/projects/34dcf47dd901424593f8243019ebd047 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:47.094195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185defc-37e8-4cce-948e-d45369c893e4 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:47.094706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185defc-37e8-4cce-948e-d45369c893e4 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:47.094949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185defc-37e8-4cce-948e-d45369c893e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:47.117561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:47.122456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:47.129417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8185defc-37e8-4cce-948e-d45369c893e4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:47.130754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8185defc-37e8-4cce-948e-d45369c893e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:47.200620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9d73e-38e3-442e-9a63-ec97973ed789 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:47.206339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20512c2e-b84a-47a7-9136-28db35ab2dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:47.207163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20512c2e-b84a-47a7-9136-28db35ab2dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:47.207514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20512c2e-b84a-47a7-9136-28db35ab2dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:47.207799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20512c2e-b84a-47a7-9136-28db35ab2dc9 admin admin] PATH_INFO: `/v3/users/e5be0c08b9eb425fa39d548765359205` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:47.209732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20512c2e-b84a-47a7-9136-28db35ab2dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5be0c08b9eb425fa39d548765359205)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:47.216702 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1049/2102] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:47.216903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20512c2e-b84a-47a7-9136-28db35ab2dc9 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:47.226741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b367c1-1167-426d-a0ff-ddfed31541d9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:47.226741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b367c1-1167-426d-a0ff-ddfed31541d9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:47.226741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b367c1-1167-426d-a0ff-ddfed31541d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:47.241292 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-64b367c1-1167-426d-a0ff-ddfed31541d9 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:47.242524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-64b367c1-1167-426d-a0ff-ddfed31541d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:47.250770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1050/2103] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:47.255870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b367c1-1167-426d-a0ff-ddfed31541d9 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:47.265172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b367c1-1167-426d-a0ff-ddfed31541d9 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:47.270986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febc488-5755-4587-ba1d-b03bbb02ca4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:47.271666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febc488-5755-4587-ba1d-b03bbb02ca4b admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:47.272803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febc488-5755-4587-ba1d-b03bbb02ca4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:47.272988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febc488-5755-4587-ba1d-b03bbb02ca4b admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:47.273647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febc488-5755-4587-ba1d-b03bbb02ca4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:47.273954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febc488-5755-4587-ba1d-b03bbb02ca4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:47.275725 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febc488-5755-4587-ba1d-b03bbb02ca4b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:47.290020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1051/2104] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:57:47.299187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febc488-5755-4587-ba1d-b03bbb02ca4b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:47.309026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febc488-5755-4587-ba1d-b03bbb02ca4b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:47.315141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317627d8-7426-4473-a1e8-a3aa386c93f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:47.315785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317627d8-7426-4473-a1e8-a3aa386c93f7 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:47.316253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317627d8-7426-4473-a1e8-a3aa386c93f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:47.316340 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317627d8-7426-4473-a1e8-a3aa386c93f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:47.316921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317627d8-7426-4473-a1e8-a3aa386c93f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:47.318849 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317627d8-7426-4473-a1e8-a3aa386c93f7 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:47.413137 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1052/2105] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:47 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:47.415718 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317627d8-7426-4473-a1e8-a3aa386c93f7 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:47.425538 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-20512c2e-b84a-47a7-9136-28db35ab2dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5be0c08b9eb425fa39d548765359205'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:47.443938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-20512c2e-b84a-47a7-9136-28db35ab2dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5be0c08b9eb425fa39d548765359205'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:47.451936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-20512c2e-b84a-47a7-9136-28db35ab2dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5be0c08b9eb425fa39d548765359205'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:47.452698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-20512c2e-b84a-47a7-9136-28db35ab2dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5be0c08b9eb425fa39d548765359205'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:47.453361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-20512c2e-b84a-47a7-9136-28db35ab2dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5be0c08b9eb425fa39d548765359205'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:47.485831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317627d8-7426-4473-a1e8-a3aa386c93f7 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:47.491033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554fe48-5e84-4e99-834c-c4061db5441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:47.491803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554fe48-5e84-4e99-834c-c4061db5441f admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:47.492144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554fe48-5e84-4e99-834c-c4061db5441f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:47.492479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554fe48-5e84-4e99-834c-c4061db5441f admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:47.493110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554fe48-5e84-4e99-834c-c4061db5441f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:47.495037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554fe48-5e84-4e99-834c-c4061db5441f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:47.575070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1054/2106] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:47 2022] DELETE /identity/v3/users/e5be0c08b9eb425fa39d548765359205 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:47.579618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea765476-f9f5-4fc7-9884-2796d971031d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:47.580547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea765476-f9f5-4fc7-9884-2796d971031d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:47.580880 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea765476-f9f5-4fc7-9884-2796d971031d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:47.600371 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-ea765476-f9f5-4fc7-9884-2796d971031d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:47.601676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ea765476-f9f5-4fc7-9884-2796d971031d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:47.617447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1053/2107] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:47 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:47.622120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554fe48-5e84-4e99-834c-c4061db5441f admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:47.625153 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e554fe48-5e84-4e99-834c-c4061db5441f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:47.639622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554fe48-5e84-4e99-834c-c4061db5441f admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:47.672237 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1055/2108] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:47.682286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea765476-f9f5-4fc7-9884-2796d971031d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:47.683834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ea765476-f9f5-4fc7-9884-2796d971031d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:47.697230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd49006-f16f-4c09-a262-4a9c0a81fc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:47.697933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd49006-f16f-4c09-a262-4a9c0a81fc51 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:47.698215 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd49006-f16f-4c09-a262-4a9c0a81fc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:47.698493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd49006-f16f-4c09-a262-4a9c0a81fc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:47.699166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd49006-f16f-4c09-a262-4a9c0a81fc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:47.700751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd49006-f16f-4c09-a262-4a9c0a81fc51 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:47.711709 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1054/2109] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:47.715518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd49006-f16f-4c09-a262-4a9c0a81fc51 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:47.725646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd49006-f16f-4c09-a262-4a9c0a81fc51 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:47.737381 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8df0b2-818d-4321-bcd3-a50ac5d7a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:47.739138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8df0b2-818d-4321-bcd3-a50ac5d7a7ed admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:47.739594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8df0b2-818d-4321-bcd3-a50ac5d7a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:47.740284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8df0b2-818d-4321-bcd3-a50ac5d7a7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:47.741098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8df0b2-818d-4321-bcd3-a50ac5d7a7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:47.743591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8df0b2-818d-4321-bcd3-a50ac5d7a7ed admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:47.749310 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea765476-f9f5-4fc7-9884-2796d971031d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:47.753524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85af6b5-a7c7-471f-9819-6f67d57c19b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:47.754129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85af6b5-a7c7-471f-9819-6f67d57c19b8 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:47.754407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85af6b5-a7c7-471f-9819-6f67d57c19b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:47.754982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85af6b5-a7c7-471f-9819-6f67d57c19b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:47.756134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1055/2110] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:47.762676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8df0b2-818d-4321-bcd3-a50ac5d7a7ed admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:47.772271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85af6b5-a7c7-471f-9819-6f67d57c19b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:47.776461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8df0b2-818d-4321-bcd3-a50ac5d7a7ed admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:47.776577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85af6b5-a7c7-471f-9819-6f67d57c19b8 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:47.778653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388c3a0-fa3a-4312-a546-8f2f8d937ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:47.779338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388c3a0-fa3a-4312-a546-8f2f8d937ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:47.779652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388c3a0-fa3a-4312-a546-8f2f8d937ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:47.779935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388c3a0-fa3a-4312-a546-8f2f8d937ea6 admin admin] PATH_INFO: `/v3/projects/f2c89ef3c4cb4d3191382b01a9cb15e0/users/6545091c85f047bca3771dba7c70a9c3/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:47.784785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1056/2111] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:47.798458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388c3a0-fa3a-4312-a546-8f2f8d937ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c89ef3c4cb4d3191382b01a9cb15e0, user_id=6545091c85f047bca3771dba7c70a9c3, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:47.801437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388c3a0-fa3a-4312-a546-8f2f8d937ea6 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:47.895998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1056/2112] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:47 2022] PUT /identity/v3/projects/f2c89ef3c4cb4d3191382b01a9cb15e0/users/6545091c85f047bca3771dba7c70a9c3/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:47.906720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bf5bf-3ca1-4233-9f7d-c45cb4d4563d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:47.907079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bf5bf-3ca1-4233-9f7d-c45cb4d4563d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:47.907363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bf5bf-3ca1-4233-9f7d-c45cb4d4563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:47.935490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-9d3bf5bf-3ca1-4233-9f7d-c45cb4d4563d None None] MFA Rules not processed for user `6545091c85f047bca3771dba7c70a9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:47.936641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9d3bf5bf-3ca1-4233-9f7d-c45cb4d4563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:48.004292 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1057/2113] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:48.016717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388c3a0-fa3a-4312-a546-8f2f8d937ea6 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:48.019287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f388c3a0-fa3a-4312-a546-8f2f8d937ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:48.085857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388c3a0-fa3a-4312-a546-8f2f8d937ea6 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:48.089881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a259bf-2bdc-419d-8f3d-351f5c327fdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:48.090657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a259bf-2bdc-419d-8f3d-351f5c327fdd service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:48.091092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a259bf-2bdc-419d-8f3d-351f5c327fdd service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:48.091224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a259bf-2bdc-419d-8f3d-351f5c327fdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:48.101660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a259bf-2bdc-419d-8f3d-351f5c327fdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:48.104188 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a259bf-2bdc-419d-8f3d-351f5c327fdd service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:48.115064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1057/2114] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:48.211344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bf5bf-3ca1-4233-9f7d-c45cb4d4563d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:48.212869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9d3bf5bf-3ca1-4233-9f7d-c45cb4d4563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:48.294224 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bf5bf-3ca1-4233-9f7d-c45cb4d4563d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:48.301429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:48.302127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:48.302464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:48.302754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] PATH_INFO: `/v3/projects/9f54c7eb152e44daa0953f70db964398` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:48.304088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f54c7eb152e44daa0953f70db964398)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:48.306007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:48.469027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f54c7eb152e44daa0953f70db964398', 'request_id': 'req-8b281228-559f-4a71-a83f-9040854fd9ea'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:48.475181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f54c7eb152e44daa0953f70db964398', 'request_id': 'req-8b281228-559f-4a71-a83f-9040854fd9ea'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:48.567175 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f54c7eb152e44daa0953f70db964398', 'request_id': 'req-8b281228-559f-4a71-a83f-9040854fd9ea'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:48.580017 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] The token cache is being invalidate because project 9f54c7eb152e44daa0953f70db964398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:48.580199 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:48.580869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:48.582369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1058/2115] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:48 2022] DELETE /identity/v3/projects/9f54c7eb152e44daa0953f70db964398 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:48.586770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a259bf-2bdc-419d-8f3d-351f5c327fdd service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:48.601088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:48.604037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a259bf-2bdc-419d-8f3d-351f5c327fdd service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:48.679560 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ffdee-05cf-4084-aadd-c3875d7b43f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:48.680334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ffdee-05cf-4084-aadd-c3875d7b43f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:48.681072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ffdee-05cf-4084-aadd-c3875d7b43f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:48.681546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ffdee-05cf-4084-aadd-c3875d7b43f3 admin admin] PATH_INFO: `/v3/users/5d224c8e7c8b492c930dfcc0de9aad58` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:48.682728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ffdee-05cf-4084-aadd-c3875d7b43f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d224c8e7c8b492c930dfcc0de9aad58)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:48.684772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ffdee-05cf-4084-aadd-c3875d7b43f3 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:48.940211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:48.955831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a1ffdee-05cf-4084-aadd-c3875d7b43f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d224c8e7c8b492c930dfcc0de9aad58'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.014850 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:49.016435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:49.030349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b281228-559f-4a71-a83f-9040854fd9ea admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:49.035717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:49.036342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:49.036624 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:49.036900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] PATH_INFO: `/v3/users/e0677af87abf42f2a30b9401081dfb91` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:49.038014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0677af87abf42f2a30b9401081dfb91)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:49.040068 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:49.055147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a1ffdee-05cf-4084-aadd-c3875d7b43f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d224c8e7c8b492c930dfcc0de9aad58'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.063357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a1ffdee-05cf-4084-aadd-c3875d7b43f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d224c8e7c8b492c930dfcc0de9aad58'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.064576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a1ffdee-05cf-4084-aadd-c3875d7b43f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d224c8e7c8b492c930dfcc0de9aad58'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.077347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a1ffdee-05cf-4084-aadd-c3875d7b43f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d224c8e7c8b492c930dfcc0de9aad58'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.083955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1058/2116] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:48 2022] DELETE /identity/v3/users/5d224c8e7c8b492c930dfcc0de9aad58 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:49.252803 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0677af87abf42f2a30b9401081dfb91'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.272123 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0677af87abf42f2a30b9401081dfb91'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.283736 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0677af87abf42f2a30b9401081dfb91'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.284470 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0677af87abf42f2a30b9401081dfb91'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.285182 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0677af87abf42f2a30b9401081dfb91'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.393160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1059/2117] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:49 2022] DELETE /identity/v3/users/e0677af87abf42f2a30b9401081dfb91 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:49.397591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52956a43-0be4-4b2c-b7e0-be071b2f340f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:49.398090 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52956a43-0be4-4b2c-b7e0-be071b2f340f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:49.398342 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52956a43-0be4-4b2c-b7e0-be071b2f340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:49.424069 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-52956a43-0be4-4b2c-b7e0-be071b2f340f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:49.424293 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-52956a43-0be4-4b2c-b7e0-be071b2f340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:49.480315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:49.482660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:49.501413 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1059/2118] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:49.512118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52956a43-0be4-4b2c-b7e0-be071b2f340f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:49.513964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-52956a43-0be4-4b2c-b7e0-be071b2f340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:49.555148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aa391-99b5-4d30-864c-aee403fcc81d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:49.573777 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93b802-73fd-45cc-a6e4-5a62490a930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:49.574753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b802-73fd-45cc-a6e4-5a62490a930a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:49.575481 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b802-73fd-45cc-a6e4-5a62490a930a admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:49.576732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b802-73fd-45cc-a6e4-5a62490a930a admin admin] PATH_INFO: `/v3/projects/9432420b2651436194437f8e7fc0d930` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:49.581824 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93b802-73fd-45cc-a6e4-5a62490a930a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9432420b2651436194437f8e7fc0d930)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:49.581943 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52956a43-0be4-4b2c-b7e0-be071b2f340f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:49.582282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93b802-73fd-45cc-a6e4-5a62490a930a admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:49.585827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e416f-1a31-4c8b-b9fa-45fc0733eb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:49.586442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e416f-1a31-4c8b-b9fa-45fc0733eb94 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:49.586718 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e416f-1a31-4c8b-b9fa-45fc0733eb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:49.587011 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e416f-1a31-4c8b-b9fa-45fc0733eb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:49.597993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e416f-1a31-4c8b-b9fa-45fc0733eb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:49.602913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e416f-1a31-4c8b-b9fa-45fc0733eb94 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:49.612176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1060/2119] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:49.810294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dc93b802-73fd-45cc-a6e4-5a62490a930a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9432420b2651436194437f8e7fc0d930', 'request_id': 'req-dc93b802-73fd-45cc-a6e4-5a62490a930a'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.819621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dc93b802-73fd-45cc-a6e4-5a62490a930a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9432420b2651436194437f8e7fc0d930', 'request_id': 'req-dc93b802-73fd-45cc-a6e4-5a62490a930a'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.917928 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dc93b802-73fd-45cc-a6e4-5a62490a930a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9432420b2651436194437f8e7fc0d930', 'request_id': 'req-dc93b802-73fd-45cc-a6e4-5a62490a930a'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.935802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dc93b802-73fd-45cc-a6e4-5a62490a930a admin admin] The token cache is being invalidate because project 9432420b2651436194437f8e7fc0d930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:49.936160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dc93b802-73fd-45cc-a6e4-5a62490a930a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.936862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dc93b802-73fd-45cc-a6e4-5a62490a930a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:49.943050 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1060/2120] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:49 2022] DELETE /identity/v3/projects/9432420b2651436194437f8e7fc0d930 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:49.945163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725ba08-fab5-454b-a3ae-4679caa767ca None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:49.945570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725ba08-fab5-454b-a3ae-4679caa767ca None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:49.945747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725ba08-fab5-454b-a3ae-4679caa767ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:49.972729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f725ba08-fab5-454b-a3ae-4679caa767ca None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:49.974214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f725ba08-fab5-454b-a3ae-4679caa767ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:50.075895 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1061/2121] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:50.082941 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff5131-0808-4410-b274-a9b4fc66ba38 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:50.083390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff5131-0808-4410-b274-a9b4fc66ba38 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:50.083669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff5131-0808-4410-b274-a9b4fc66ba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:50.104659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-0bff5131-0808-4410-b274-a9b4fc66ba38 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:50.105970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0bff5131-0808-4410-b274-a9b4fc66ba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:50.114079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1061/2122] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:50.118449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725ba08-fab5-454b-a3ae-4679caa767ca None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:50.128867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725ba08-fab5-454b-a3ae-4679caa767ca None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:50.133717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e29b3-ca75-4a8a-85e7-f1388d6bed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:50.134543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e29b3-ca75-4a8a-85e7-f1388d6bed56 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:50.135272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e29b3-ca75-4a8a-85e7-f1388d6bed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:50.135610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e29b3-ca75-4a8a-85e7-f1388d6bed56 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:50.136299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e29b3-ca75-4a8a-85e7-f1388d6bed56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:50.136610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e29b3-ca75-4a8a-85e7-f1388d6bed56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:50.138230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e29b3-ca75-4a8a-85e7-f1388d6bed56 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:50.151007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1062/2123] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:57:50.155444 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff5131-0808-4410-b274-a9b4fc66ba38 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:50.164983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff5131-0808-4410-b274-a9b4fc66ba38 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:50.169919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2f93f-513b-4e46-a888-288814ea22e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:50.171946 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2f93f-513b-4e46-a888-288814ea22e2 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:50.171946 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2f93f-513b-4e46-a888-288814ea22e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:50.171946 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2f93f-513b-4e46-a888-288814ea22e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:50.171946 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2f93f-513b-4e46-a888-288814ea22e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:50.174083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2f93f-513b-4e46-a888-288814ea22e2 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:50.199167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e29b3-ca75-4a8a-85e7-f1388d6bed56 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:50.201007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c08e29b3-ca75-4a8a-85e7-f1388d6bed56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:50.214847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e29b3-ca75-4a8a-85e7-f1388d6bed56 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:50.222226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:50.223387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:50.223387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:50.223584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] PATH_INFO: `/v3/projects/dea53507e9484e31a0bad1fcaa7dded6` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:50.224656 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea53507e9484e31a0bad1fcaa7dded6)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:50.226665 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:50.312838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1062/2124] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:50 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:50.317715 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2f93f-513b-4e46-a888-288814ea22e2 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:50.378074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea53507e9484e31a0bad1fcaa7dded6', 'request_id': 'req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:50.383974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea53507e9484e31a0bad1fcaa7dded6', 'request_id': 'req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:50.384500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2f93f-513b-4e46-a888-288814ea22e2 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:50.391904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea53507e9484e31a0bad1fcaa7dded6', 'request_id': 'req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:50.447725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49ef60-cc7c-4f8b-b452-7c02d26476e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:50.448339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49ef60-cc7c-4f8b-b452-7c02d26476e8 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:50.448623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49ef60-cc7c-4f8b-b452-7c02d26476e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:50.448896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49ef60-cc7c-4f8b-b452-7c02d26476e8 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:50.449520 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49ef60-cc7c-4f8b-b452-7c02d26476e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:50.451488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49ef60-cc7c-4f8b-b452-7c02d26476e8 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:50.510272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] The token cache is being invalidate because project dea53507e9484e31a0bad1fcaa7dded6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:50.510820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:50.511234 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:50.512906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1063/2125] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:50 2022] DELETE /identity/v3/projects/dea53507e9484e31a0bad1fcaa7dded6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:50.516517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:50.517875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:50.531762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa83da-d9c4-432b-8e1c-261cf3908aa3 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:50.538794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1063/2126] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:50 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:50.540080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49ef60-cc7c-4f8b-b452-7c02d26476e8 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:50.545213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:50.545348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5e49ef60-cc7c-4f8b-b452-7c02d26476e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:50.545457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:50.545457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:50.545457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] PATH_INFO: `/v3/users/7e636960015443f091b340dc28b19da7` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:50.545457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e636960015443f091b340dc28b19da7)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:50.546094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:50.554125 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49ef60-cc7c-4f8b-b452-7c02d26476e8 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:50.558902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69d5a4-a816-406e-93ee-c53816a89363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:50.559537 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69d5a4-a816-406e-93ee-c53816a89363 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:50.559930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69d5a4-a816-406e-93ee-c53816a89363 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:50.560069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69d5a4-a816-406e-93ee-c53816a89363 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:50.560735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69d5a4-a816-406e-93ee-c53816a89363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:50.562309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69d5a4-a816-406e-93ee-c53816a89363 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:50.572373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1064/2127] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:50.576314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69d5a4-a816-406e-93ee-c53816a89363 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:50.585952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69d5a4-a816-406e-93ee-c53816a89363 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:50.590522 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02606fee-d745-4a8f-b707-8a9d87b987df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:50.591120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02606fee-d745-4a8f-b707-8a9d87b987df admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:50.591398 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02606fee-d745-4a8f-b707-8a9d87b987df admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:50.591666 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02606fee-d745-4a8f-b707-8a9d87b987df admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:50.592281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02606fee-d745-4a8f-b707-8a9d87b987df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:50.593829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02606fee-d745-4a8f-b707-8a9d87b987df admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:50.604720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1065/2128] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:50.608774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02606fee-d745-4a8f-b707-8a9d87b987df admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:50.619175 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02606fee-d745-4a8f-b707-8a9d87b987df admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:50.623820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafdef1-59ec-4a55-943a-7f8e28dfd129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:50.624497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafdef1-59ec-4a55-943a-7f8e28dfd129 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:50.624779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafdef1-59ec-4a55-943a-7f8e28dfd129 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:50.625057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafdef1-59ec-4a55-943a-7f8e28dfd129 admin admin] PATH_INFO: `/v3/projects/42818006170f41f4aded6b2aa47ca24c/users/ba92b6fc56c44b07a82e0538d4d929ae/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:50.640776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafdef1-59ec-4a55-943a-7f8e28dfd129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42818006170f41f4aded6b2aa47ca24c, user_id=ba92b6fc56c44b07a82e0538d4d929ae, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:50.644089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafdef1-59ec-4a55-943a-7f8e28dfd129 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:50.709096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e636960015443f091b340dc28b19da7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:50.745281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:50.750622 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1066/2129] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:50 2022] PUT /identity/v3/projects/42818006170f41f4aded6b2aa47ca24c/users/ba92b6fc56c44b07a82e0538d4d929ae/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:50.761438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f9dc3-e858-49e2-9388-eda694c74d5f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:50.761726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f9dc3-e858-49e2-9388-eda694c74d5f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:50.762071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f9dc3-e858-49e2-9388-eda694c74d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:50.769462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e636960015443f091b340dc28b19da7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:50.777306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e636960015443f091b340dc28b19da7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:50.777910 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e636960015443f091b340dc28b19da7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:50.792716 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e636960015443f091b340dc28b19da7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:50.794202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-f69f9dc3-e858-49e2-9388-eda694c74d5f None None] MFA Rules not processed for user `ba92b6fc56c44b07a82e0538d4d929ae`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:50.795528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f69f9dc3-e858-49e2-9388-eda694c74d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:50.801114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1064/2130] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:50 2022] DELETE /identity/v3/users/7e636960015443f091b340dc28b19da7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:50.865254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1067/2131] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:50.870936 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:50.872569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:50.956531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caecf4d-8552-4913-8441-fa9d5dca85ea admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:50.962790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fe423-4fc8-477c-b493-c6dbfdc9eb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:50.963690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fe423-4fc8-477c-b493-c6dbfdc9eb3b admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:50.964670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fe423-4fc8-477c-b493-c6dbfdc9eb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:50.965096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fe423-4fc8-477c-b493-c6dbfdc9eb3b admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:50.965894 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fe423-4fc8-477c-b493-c6dbfdc9eb3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:50.967995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fe423-4fc8-477c-b493-c6dbfdc9eb3b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:51.123821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1065/2132] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:50 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:51.128480 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f9dc3-e858-49e2-9388-eda694c74d5f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:51.135170 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fe423-4fc8-477c-b493-c6dbfdc9eb3b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:51.154620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4e0fe423-4fc8-477c-b493-c6dbfdc9eb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:51.170133 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:51.208388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f9dc3-e858-49e2-9388-eda694c74d5f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:51.231501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fe423-4fc8-477c-b493-c6dbfdc9eb3b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:51.236748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:51.237564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.238155 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.238578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] PATH_INFO: `/v3/users/0fa8ba3ab3a14b699564cbea344d1b70` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.239998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa8ba3ab3a14b699564cbea344d1b70)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:51.242096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:51.271856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff8416-c14f-4758-9825-52b9c825ae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:51.272474 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff8416-c14f-4758-9825-52b9c825ae61 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.272758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff8416-c14f-4758-9825-52b9c825ae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.273035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff8416-c14f-4758-9825-52b9c825ae61 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.273665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff8416-c14f-4758-9825-52b9c825ae61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:51.275675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff8416-c14f-4758-9825-52b9c825ae61 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:51.440087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1068/2133] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:51 2022] POST /identity/v3/users => generated 299 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:51.440087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff8416-c14f-4758-9825-52b9c825ae61 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:51.440087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4dff8416-c14f-4758-9825-52b9c825ae61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:51.451469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff8416-c14f-4758-9825-52b9c825ae61 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:51.456323 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:51.456929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.457211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.457488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf admin admin] PATH_INFO: `/v3/projects/90e5535a8628485ba0925ee296257120` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.458594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e5535a8628485ba0925ee296257120)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:51.460786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:51.496585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa8ba3ab3a14b699564cbea344d1b70'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:51.561096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa8ba3ab3a14b699564cbea344d1b70'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:51.563636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e5535a8628485ba0925ee296257120', 'request_id': 'req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:51.570615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e5535a8628485ba0925ee296257120', 'request_id': 'req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:51.578069 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa8ba3ab3a14b699564cbea344d1b70'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:51.580713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa8ba3ab3a14b699564cbea344d1b70'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:51.593097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa8ba3ab3a14b699564cbea344d1b70'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:51.599124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1066/2134] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:51 2022] DELETE /identity/v3/users/0fa8ba3ab3a14b699564cbea344d1b70 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:51.600713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:51.602117 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:51.646833 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e5535a8628485ba0925ee296257120', 'request_id': 'req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:51.659785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf admin admin] The token cache is being invalidate because project 90e5535a8628485ba0925ee296257120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:51.660230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:51.660806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f799fbc4-3ddc-4288-bef1-a4654d39e1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:51.662305 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1069/2135] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:51 2022] DELETE /identity/v3/projects/90e5535a8628485ba0925ee296257120 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:51.666762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c7319-0111-486e-8560-f0ac884d751d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.667064 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c7319-0111-486e-8560-f0ac884d751d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.667331 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c7319-0111-486e-8560-f0ac884d751d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.670019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7396102-2876-4177-b222-2f456e85eb87 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:51.675318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493595b-b3ac-4df2-a875-41e4ef3b5e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:51.679864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493595b-b3ac-4df2-a875-41e4ef3b5e8d admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.679864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493595b-b3ac-4df2-a875-41e4ef3b5e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.679864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493595b-b3ac-4df2-a875-41e4ef3b5e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.679864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493595b-b3ac-4df2-a875-41e4ef3b5e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:51.679864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493595b-b3ac-4df2-a875-41e4ef3b5e8d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:51.686784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-5a7c7319-0111-486e-8560-f0ac884d751d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:51.688034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5a7c7319-0111-486e-8560-f0ac884d751d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:51.690056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1067/2136] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:51.691519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e92ba-0673-4308-9747-771e2b9d0d97 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.691831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e92ba-0673-4308-9747-771e2b9d0d97 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.692110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e92ba-0673-4308-9747-771e2b9d0d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.701088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1070/2137] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:51.701088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c7319-0111-486e-8560-f0ac884d751d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:51.701848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5a7c7319-0111-486e-8560-f0ac884d751d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:51.712425 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-059e92ba-0673-4308-9747-771e2b9d0d97 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:51.713639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-059e92ba-0673-4308-9747-771e2b9d0d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:51.713748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c7319-0111-486e-8560-f0ac884d751d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:51.718500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627471-8ed6-4659-bbe1-2af75fad6136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:51.719189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627471-8ed6-4659-bbe1-2af75fad6136 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.719474 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627471-8ed6-4659-bbe1-2af75fad6136 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.719760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627471-8ed6-4659-bbe1-2af75fad6136 admin admin] PATH_INFO: `/v3/projects/81dd24309a6e49e8b402fb543b1edd99/users/292a32318ed54f75a261aafe6859e479/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.722203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1068/2138] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:51.723027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e92ba-0673-4308-9747-771e2b9d0d97 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:51.724343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-059e92ba-0673-4308-9747-771e2b9d0d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:51.741545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72627471-8ed6-4659-bbe1-2af75fad6136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81dd24309a6e49e8b402fb543b1edd99, user_id=292a32318ed54f75a261aafe6859e479, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:51.744370 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72627471-8ed6-4659-bbe1-2af75fad6136 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:51.787725 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e92ba-0673-4308-9747-771e2b9d0d97 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:51.791439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dcc4c-482a-4b4f-8acf-8043ea27a6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:51.792040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dcc4c-482a-4b4f-8acf-8043ea27a6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.792317 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dcc4c-482a-4b4f-8acf-8043ea27a6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.792585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dcc4c-482a-4b4f-8acf-8043ea27a6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.802210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dcc4c-482a-4b4f-8acf-8043ea27a6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:51.803697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dcc4c-482a-4b4f-8acf-8043ea27a6e5 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:51.813401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1069/2139] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:51.815396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3de8d0-aeba-4dd3-a852-130c0f3fa65b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.815690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3de8d0-aeba-4dd3-a852-130c0f3fa65b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.816042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3de8d0-aeba-4dd3-a852-130c0f3fa65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.836566 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-ea3de8d0-aeba-4dd3-a852-130c0f3fa65b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:51.837797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ea3de8d0-aeba-4dd3-a852-130c0f3fa65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:51.850363 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1070/2140] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:51.851631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3de8d0-aeba-4dd3-a852-130c0f3fa65b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:51.854904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1071/2141] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:51 2022] PUT /identity/v3/projects/81dd24309a6e49e8b402fb543b1edd99/users/292a32318ed54f75a261aafe6859e479/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:51.860284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627471-8ed6-4659-bbe1-2af75fad6136 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:51.864031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3de8d0-aeba-4dd3-a852-130c0f3fa65b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:51.928998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627471-8ed6-4659-bbe1-2af75fad6136 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:51.929443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19de49-327d-469c-94e6-942e64fc855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:51.930061 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19de49-327d-469c-94e6-942e64fc855d admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.930350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19de49-327d-469c-94e6-942e64fc855d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.930624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19de49-327d-469c-94e6-942e64fc855d admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.931299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19de49-327d-469c-94e6-942e64fc855d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:51.931605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19de49-327d-469c-94e6-942e64fc855d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:51.933200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19de49-327d-469c-94e6-942e64fc855d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:51.933970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806a2a-9bd6-4c04-942f-81d11e26386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:51.934620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806a2a-9bd6-4c04-942f-81d11e26386d admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.934922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806a2a-9bd6-4c04-942f-81d11e26386d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.942479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806a2a-9bd6-4c04-942f-81d11e26386d admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.942479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c806a2a-9bd6-4c04-942f-81d11e26386d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:51.942479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c806a2a-9bd6-4c04-942f-81d11e26386d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:51.949288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1071/2142] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:57:51.949435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1072/2143] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:51.950356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19de49-327d-469c-94e6-942e64fc855d admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:51.952263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806a2a-9bd6-4c04-942f-81d11e26386d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:51.960818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19de49-327d-469c-94e6-942e64fc855d admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:51.962303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806a2a-9bd6-4c04-942f-81d11e26386d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:51.966358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde280d2-d235-4f33-b842-e7d8fda8f928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:51.966999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde280d2-d235-4f33-b842-e7d8fda8f928 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.967288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde280d2-d235-4f33-b842-e7d8fda8f928 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.967403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841f6ff-e4d6-484b-9c33-de9aa4f6ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:51.967559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde280d2-d235-4f33-b842-e7d8fda8f928 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.968007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f6ff-e4d6-484b-9c33-de9aa4f6ea39 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.968191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde280d2-d235-4f33-b842-e7d8fda8f928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:51.968304 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f6ff-e4d6-484b-9c33-de9aa4f6ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.968558 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f6ff-e4d6-484b-9c33-de9aa4f6ea39 admin admin] PATH_INFO: `/v3/projects/81dd24309a6e49e8b402fb543b1edd99/users/292a32318ed54f75a261aafe6859e479/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:51.970119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde280d2-d235-4f33-b842-e7d8fda8f928 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:51.970565 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841f6ff-e4d6-484b-9c33-de9aa4f6ea39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81dd24309a6e49e8b402fb543b1edd99, user_id=292a32318ed54f75a261aafe6859e479, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:51.973326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841f6ff-e4d6-484b-9c33-de9aa4f6ea39 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:51.985096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1073/2144] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:51 2022] PUT /identity/v3/projects/81dd24309a6e49e8b402fb543b1edd99/users/292a32318ed54f75a261aafe6859e479/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:51.997268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9336ed-6935-4eb9-a7ac-2e8b43d1ea92 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:51.997553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9336ed-6935-4eb9-a7ac-2e8b43d1ea92 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:51.997831 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9336ed-6935-4eb9-a7ac-2e8b43d1ea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:52.027663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-dd9336ed-6935-4eb9-a7ac-2e8b43d1ea92 None None] MFA Rules not processed for user `292a32318ed54f75a261aafe6859e479`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:52.028938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-dd9336ed-6935-4eb9-a7ac-2e8b43d1ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:52.112482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1074/2145] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:52.120634 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9336ed-6935-4eb9-a7ac-2e8b43d1ea92 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:52.121723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1072/2146] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:51 2022] POST /identity/v3/projects => generated 355 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:52.123738 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-dd9336ed-6935-4eb9-a7ac-2e8b43d1ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:52.131741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde280d2-d235-4f33-b842-e7d8fda8f928 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:52.224770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9336ed-6935-4eb9-a7ac-2e8b43d1ea92 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:52.242676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde280d2-d235-4f33-b842-e7d8fda8f928 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:52.249156 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88637ad-d9a6-40fb-a2d3-8004d95a5596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:52.249961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88637ad-d9a6-40fb-a2d3-8004d95a5596 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:52.250271 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88637ad-d9a6-40fb-a2d3-8004d95a5596 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:52.250617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88637ad-d9a6-40fb-a2d3-8004d95a5596 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:52.251523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88637ad-d9a6-40fb-a2d3-8004d95a5596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:52.254650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88637ad-d9a6-40fb-a2d3-8004d95a5596 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:52.289019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311d295-115f-4a08-a49c-7349c52abbfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:52.289320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d295-115f-4a08-a49c-7349c52abbfd service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:52.289606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d295-115f-4a08-a49c-7349c52abbfd service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:52.289879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d295-115f-4a08-a49c-7349c52abbfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:52.353345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311d295-115f-4a08-a49c-7349c52abbfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:52.354805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311d295-115f-4a08-a49c-7349c52abbfd service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:52.367745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1073/2147] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:52 2022] POST /identity/v3/users => generated 278 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:52.367934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:52.368026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88637ad-d9a6-40fb-a2d3-8004d95a5596 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:52.368315 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c88637ad-d9a6-40fb-a2d3-8004d95a5596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:52.372335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1075/2148] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:52.372988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311d295-115f-4a08-a49c-7349c52abbfd service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:52.381948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88637ad-d9a6-40fb-a2d3-8004d95a5596 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:52.387029 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311d295-115f-4a08-a49c-7349c52abbfd service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:52.391103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:52.392364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:52.397284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:52.397284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] PATH_INFO: `/v3/projects/97ccc8ea72d0424ea85aea7980fa591c` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:52.397482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f8b65-a4b6-45c9-8779-26aae5279422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:52.397482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f8b65-a4b6-45c9-8779-26aae5279422 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:52.397482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f8b65-a4b6-45c9-8779-26aae5279422 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:52.397748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ccc8ea72d0424ea85aea7980fa591c)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:52.397839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f8b65-a4b6-45c9-8779-26aae5279422 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:52.397839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f8b65-a4b6-45c9-8779-26aae5279422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:52.398085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:52.398181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f8b65-a4b6-45c9-8779-26aae5279422 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:52.409938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1076/2149] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:52.410815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f8b65-a4b6-45c9-8779-26aae5279422 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:52.420781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f8b65-a4b6-45c9-8779-26aae5279422 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:52.425605 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:52.426290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:52.426571 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:52.426848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] PATH_INFO: `/v3/users/ba92b6fc56c44b07a82e0538d4d929ae` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:52.428021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba92b6fc56c44b07a82e0538d4d929ae)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:52.430086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:52.489715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:52.508204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ccc8ea72d0424ea85aea7980fa591c', 'request_id': 'req-427e0797-88f6-460e-9f0f-57834450151f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:52.513653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ccc8ea72d0424ea85aea7980fa591c', 'request_id': 'req-427e0797-88f6-460e-9f0f-57834450151f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:52.520417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ccc8ea72d0424ea85aea7980fa591c', 'request_id': 'req-427e0797-88f6-460e-9f0f-57834450151f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:52.612372 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] The token cache is being invalidate because project 97ccc8ea72d0424ea85aea7980fa591c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:52.612985 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:52.613248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:52.614766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1074/2150] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:52 2022] DELETE /identity/v3/projects/97ccc8ea72d0424ea85aea7980fa591c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:52.615559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:52.616848 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:52.645904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba92b6fc56c44b07a82e0538d4d929ae'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:52.657985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba92b6fc56c44b07a82e0538d4d929ae'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:52.664808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba92b6fc56c44b07a82e0538d4d929ae'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:52.665502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba92b6fc56c44b07a82e0538d4d929ae'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:52.666135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba92b6fc56c44b07a82e0538d4d929ae'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:52.679325 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e0797-88f6-460e-9f0f-57834450151f admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:52.685455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211dbea-d6a0-4fbe-9bb7-efecdab62f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:52.685455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211dbea-d6a0-4fbe-9bb7-efecdab62f4e admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:52.685455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211dbea-d6a0-4fbe-9bb7-efecdab62f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:52.685455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211dbea-d6a0-4fbe-9bb7-efecdab62f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:52.685817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211dbea-d6a0-4fbe-9bb7-efecdab62f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:52.687406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211dbea-d6a0-4fbe-9bb7-efecdab62f4e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:52.697655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1075/2151] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:52.698803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141a74f-d183-4030-b3ae-93184bc0b51d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:52.699111 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141a74f-d183-4030-b3ae-93184bc0b51d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:52.699385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141a74f-d183-4030-b3ae-93184bc0b51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:52.717742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4141a74f-d183-4030-b3ae-93184bc0b51d None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:52.718955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4141a74f-d183-4030-b3ae-93184bc0b51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:53.057979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1076/2152] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Aug 29 23:57:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:53.057979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141a74f-d183-4030-b3ae-93184bc0b51d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:53.057979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4141a74f-d183-4030-b3ae-93184bc0b51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:53.057979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141a74f-d183-4030-b3ae-93184bc0b51d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:53.059506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1b411-b6b2-4813-a01f-9542b26ef437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:53.059506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1b411-b6b2-4813-a01f-9542b26ef437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:53.059506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1b411-b6b2-4813-a01f-9542b26ef437 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:53.059506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1b411-b6b2-4813-a01f-9542b26ef437 admin admin] PATH_INFO: `/v3/users/42926de3707f4302a9b9ee96fb813ce4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:53.060123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1b411-b6b2-4813-a01f-9542b26ef437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42926de3707f4302a9b9ee96fb813ce4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:53.060123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1b411-b6b2-4813-a01f-9542b26ef437 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:53.060562 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1077/2153] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:52 2022] DELETE /identity/v3/users/ba92b6fc56c44b07a82e0538d4d929ae => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:53.060562 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:53.060562 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:53.060562 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ea524-fa68-490c-a716-df898403fb17 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:53.061214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143de0-74ba-42bf-a46b-c47f3b13a036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:53.061214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143de0-74ba-42bf-a46b-c47f3b13a036 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:53.061214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143de0-74ba-42bf-a46b-c47f3b13a036 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:53.061214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143de0-74ba-42bf-a46b-c47f3b13a036 admin admin] PATH_INFO: `/v3/projects/f0a7616cfe3141b890b611c6724c4204/users/e8be7e3f0ee64eaea38d319d43ca7e78/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:53.061771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0143de0-74ba-42bf-a46b-c47f3b13a036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a7616cfe3141b890b611c6724c4204, user_id=e8be7e3f0ee64eaea38d319d43ca7e78, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:53.061771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0143de0-74ba-42bf-a46b-c47f3b13a036 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:53.094578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1078/2154] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:52 2022] PUT /identity/v3/projects/f0a7616cfe3141b890b611c6724c4204/users/e8be7e3f0ee64eaea38d319d43ca7e78/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:53.096809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143de0-74ba-42bf-a46b-c47f3b13a036 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:53.097503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a0143de0-74ba-42bf-a46b-c47f3b13a036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:53.123133 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:53.166089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143de0-74ba-42bf-a46b-c47f3b13a036 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:53.171317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e407e-7377-4d9e-9d39-55f04e931456 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:53.171920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e407e-7377-4d9e-9d39-55f04e931456 service swift] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:53.172192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e407e-7377-4d9e-9d39-55f04e931456 service swift] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:53.172471 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e407e-7377-4d9e-9d39-55f04e931456 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:53.211728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f6f1b411-b6b2-4813-a01f-9542b26ef437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42926de3707f4302a9b9ee96fb813ce4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:53.230722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e407e-7377-4d9e-9d39-55f04e931456 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:53.232351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e407e-7377-4d9e-9d39-55f04e931456 service swift] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:53.240547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1079/2155] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Aug 29 23:57:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:57:53.241762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3db4e-a31b-4f96-80d7-25546dc795d4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:53.242140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3db4e-a31b-4f96-80d7-25546dc795d4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:53.242499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3db4e-a31b-4f96-80d7-25546dc795d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:53.261313 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-7cc3db4e-a31b-4f96-80d7-25546dc795d4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:53.262507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7cc3db4e-a31b-4f96-80d7-25546dc795d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:53.271649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f6f1b411-b6b2-4813-a01f-9542b26ef437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42926de3707f4302a9b9ee96fb813ce4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:53.279671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f6f1b411-b6b2-4813-a01f-9542b26ef437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42926de3707f4302a9b9ee96fb813ce4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:53.283267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f6f1b411-b6b2-4813-a01f-9542b26ef437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42926de3707f4302a9b9ee96fb813ce4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:53.296232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f6f1b411-b6b2-4813-a01f-9542b26ef437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42926de3707f4302a9b9ee96fb813ce4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:53.312321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1077/2156] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:52 2022] DELETE /identity/v3/users/42926de3707f4302a9b9ee96fb813ce4 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:53.312321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc5eda-f798-4e83-a1c0-9977509ef972 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:53.312321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc5eda-f798-4e83-a1c0-9977509ef972 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:53.312321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc5eda-f798-4e83-a1c0-9977509ef972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:53.336784 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-64bc5eda-f798-4e83-a1c0-9977509ef972 None None] MFA Rules not processed for user `e8be7e3f0ee64eaea38d319d43ca7e78`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:53.338411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-64bc5eda-f798-4e83-a1c0-9977509ef972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:53.339911 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1080/2157] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:53.356866 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3db4e-a31b-4f96-80d7-25546dc795d4 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:53.358730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7cc3db4e-a31b-4f96-80d7-25546dc795d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:53.428412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1078/2158] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:53.433472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc5eda-f798-4e83-a1c0-9977509ef972 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:53.435269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-64bc5eda-f798-4e83-a1c0-9977509ef972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:53.447211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:53.451770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3db4e-a31b-4f96-80d7-25546dc795d4 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:53.507248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc5eda-f798-4e83-a1c0-9977509ef972 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:53.513554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd52c1b-75d3-46ad-bbea-0e62d95fdb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:53.514296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd52c1b-75d3-46ad-bbea-0e62d95fdb1b admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:53.514664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd52c1b-75d3-46ad-bbea-0e62d95fdb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:53.515059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd52c1b-75d3-46ad-bbea-0e62d95fdb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:53.515862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd52c1b-75d3-46ad-bbea-0e62d95fdb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:53.518036 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd52c1b-75d3-46ad-bbea-0e62d95fdb1b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:53.520208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8ca3-2519-4675-b29d-0676b7772efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:53.528457 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8ca3-2519-4675-b29d-0676b7772efa service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:53.528852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8ca3-2519-4675-b29d-0676b7772efa service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:53.529258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8ca3-2519-4675-b29d-0676b7772efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:53.547881 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c8ca3-2519-4675-b29d-0676b7772efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:53.554955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c8ca3-2519-4675-b29d-0676b7772efa service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:53.577811 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1081/2159] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:53.657247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1079/2160] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:53 2022] POST /identity/v3/projects => generated 355 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:53.661172 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8ca3-2519-4675-b29d-0676b7772efa service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:53.683947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8ca3-2519-4675-b29d-0676b7772efa service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:53.757292 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9a6c2-fd32-4e70-b4c1-c0175a3cbf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:53.762336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9a6c2-fd32-4e70-b4c1-c0175a3cbf8c admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:53.762336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9a6c2-fd32-4e70-b4c1-c0175a3cbf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:53.762336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9a6c2-fd32-4e70-b4c1-c0175a3cbf8c admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:53.762336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9a6c2-fd32-4e70-b4c1-c0175a3cbf8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:53.763809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9a6c2-fd32-4e70-b4c1-c0175a3cbf8c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:53.819995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd52c1b-75d3-46ad-bbea-0e62d95fdb1b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:53.822363 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8fd52c1b-75d3-46ad-bbea-0e62d95fdb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:53.858264 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd52c1b-75d3-46ad-bbea-0e62d95fdb1b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:53.866641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:53.867466 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:53.867803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:53.868396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] PATH_INFO: `/v3/projects/935a397a1e3d4a7e9d01418e2cf93b8d` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:53.870128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935a397a1e3d4a7e9d01418e2cf93b8d)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:53.872368 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:53.893911 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1082/2161] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:53 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:53.895019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9a6c2-fd32-4e70-b4c1-c0175a3cbf8c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:53.907925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9a6c2-fd32-4e70-b4c1-c0175a3cbf8c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:53.914242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11373a5-1ae9-4796-8861-8bb0c13c4a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:53.915032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11373a5-1ae9-4796-8861-8bb0c13c4a6a admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:53.915409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11373a5-1ae9-4796-8861-8bb0c13c4a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:53.915784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11373a5-1ae9-4796-8861-8bb0c13c4a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:53.916508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11373a5-1ae9-4796-8861-8bb0c13c4a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:53.921258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11373a5-1ae9-4796-8861-8bb0c13c4a6a admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:53.936626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1083/2162] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:53.937510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11373a5-1ae9-4796-8861-8bb0c13c4a6a admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:53.948578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11373a5-1ae9-4796-8861-8bb0c13c4a6a admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:53.953590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa60e-40c2-476b-84cb-3cbf04831731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:53.955974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa60e-40c2-476b-84cb-3cbf04831731 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:53.955974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa60e-40c2-476b-84cb-3cbf04831731 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:53.955974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa60e-40c2-476b-84cb-3cbf04831731 admin admin] PATH_INFO: `/v3/projects/f79128d25c434f92a168053f2ab97923/users/b702f7c3b60f458eae452ec75c3eb6af/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:53.986185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fa60e-40c2-476b-84cb-3cbf04831731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79128d25c434f92a168053f2ab97923, user_id=b702f7c3b60f458eae452ec75c3eb6af, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:53.990012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fa60e-40c2-476b-84cb-3cbf04831731 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:54.101707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1084/2163] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:53 2022] PUT /identity/v3/projects/f79128d25c434f92a168053f2ab97923/users/b702f7c3b60f458eae452ec75c3eb6af/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:54.105176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa60e-40c2-476b-84cb-3cbf04831731 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:54.106947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f99fa60e-40c2-476b-84cb-3cbf04831731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:54.114605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935a397a1e3d4a7e9d01418e2cf93b8d', 'request_id': 'req-819d6c92-48a2-41ec-915e-2dbd63868471'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.123104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935a397a1e3d4a7e9d01418e2cf93b8d', 'request_id': 'req-819d6c92-48a2-41ec-915e-2dbd63868471'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.131686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935a397a1e3d4a7e9d01418e2cf93b8d', 'request_id': 'req-819d6c92-48a2-41ec-915e-2dbd63868471'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.174759 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa60e-40c2-476b-84cb-3cbf04831731 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:54.232857 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:54.233496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:54.233776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:54.234109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] PATH_INFO: `/v3/projects/42818006170f41f4aded6b2aa47ca24c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:54.235268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42818006170f41f4aded6b2aa47ca24c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:54.237214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:54.255274 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] The token cache is being invalidate because project 935a397a1e3d4a7e9d01418e2cf93b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:54.262012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.262012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.262012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1080/2164] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:53 2022] DELETE /identity/v3/projects/935a397a1e3d4a7e9d01418e2cf93b8d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:54.262012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:54.262012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:54.273813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d6c92-48a2-41ec-915e-2dbd63868471 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:54.278339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ff394-9fda-402a-90d1-77720d45e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:54.278965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ff394-9fda-402a-90d1-77720d45e824 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:54.279246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ff394-9fda-402a-90d1-77720d45e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:54.279516 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ff394-9fda-402a-90d1-77720d45e824 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:54.280147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ff394-9fda-402a-90d1-77720d45e824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:54.281723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ff394-9fda-402a-90d1-77720d45e824 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:54.293296 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1081/2165] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:54.296223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00374d5c-2ecd-4260-9e6c-b4de7b1bdec0 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:54.296223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00374d5c-2ecd-4260-9e6c-b4de7b1bdec0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:54.296223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00374d5c-2ecd-4260-9e6c-b4de7b1bdec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:54.313472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-00374d5c-2ecd-4260-9e6c-b4de7b1bdec0 None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:54.315222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-00374d5c-2ecd-4260-9e6c-b4de7b1bdec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:54.321282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:54.369295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1082/2166] 10.222.0.73 () {58 vars in 967 bytes} [Mon Aug 29 23:57:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:54.370139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00374d5c-2ecd-4260-9e6c-b4de7b1bdec0 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:54.371604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-00374d5c-2ecd-4260-9e6c-b4de7b1bdec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:54.383070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42818006170f41f4aded6b2aa47ca24c', 'request_id': 'req-696a03fb-70b9-4fbe-bb17-ccda065ed439'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.386831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:54.389242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42818006170f41f4aded6b2aa47ca24c', 'request_id': 'req-696a03fb-70b9-4fbe-bb17-ccda065ed439'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.393503 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00374d5c-2ecd-4260-9e6c-b4de7b1bdec0 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:54.448601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd44a9-f058-4bd6-b4ba-6b6a1c132f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:54.449242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd44a9-f058-4bd6-b4ba-6b6a1c132f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:54.449539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd44a9-f058-4bd6-b4ba-6b6a1c132f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:54.449802 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd44a9-f058-4bd6-b4ba-6b6a1c132f3b admin admin] PATH_INFO: `/v3/users/4a81c657f34c4ff4abd1e46bdf438a82` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:54.450974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd44a9-f058-4bd6-b4ba-6b6a1c132f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a81c657f34c4ff4abd1e46bdf438a82)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:54.452883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd44a9-f058-4bd6-b4ba-6b6a1c132f3b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:54.476965 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42818006170f41f4aded6b2aa47ca24c', 'request_id': 'req-696a03fb-70b9-4fbe-bb17-ccda065ed439'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.491728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] The token cache is being invalidate because project 42818006170f41f4aded6b2aa47ca24c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:54.492072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.492852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.494455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1085/2167] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:54 2022] DELETE /identity/v3/projects/42818006170f41f4aded6b2aa47ca24c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:54.495330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:54.496545 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:54.509635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a03fb-70b9-4fbe-bb17-ccda065ed439 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:54.519616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da0ac9-35f7-4cc4-9bd7-a115ced8f899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:54.519616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da0ac9-35f7-4cc4-9bd7-a115ced8f899 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:54.519616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da0ac9-35f7-4cc4-9bd7-a115ced8f899 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:54.519616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da0ac9-35f7-4cc4-9bd7-a115ced8f899 admin admin] PATH_INFO: `/v3/projects/f79128d25c434f92a168053f2ab97923/users/b702f7c3b60f458eae452ec75c3eb6af/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:54.520259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da0ac9-35f7-4cc4-9bd7-a115ced8f899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79128d25c434f92a168053f2ab97923, user_id=b702f7c3b60f458eae452ec75c3eb6af, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:54.522996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da0ac9-35f7-4cc4-9bd7-a115ced8f899 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:54.533501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1086/2168] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:54 2022] PUT /identity/v3/projects/f79128d25c434f92a168053f2ab97923/users/b702f7c3b60f458eae452ec75c3eb6af/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:54.534291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da0ac9-35f7-4cc4-9bd7-a115ced8f899 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:54.535842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f5da0ac9-35f7-4cc4-9bd7-a115ced8f899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:54.624895 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da0ac9-35f7-4cc4-9bd7-a115ced8f899 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:54.628357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604903de-1eaa-4c9c-9838-2938869b7244 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:54.628979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604903de-1eaa-4c9c-9838-2938869b7244 service swift] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:54.629272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604903de-1eaa-4c9c-9838-2938869b7244 service swift] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:54.629538 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604903de-1eaa-4c9c-9838-2938869b7244 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:54.631936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-604903de-1eaa-4c9c-9838-2938869b7244 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:54.660700 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-04dd44a9-f058-4bd6-b4ba-6b6a1c132f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a81c657f34c4ff4abd1e46bdf438a82'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.706332 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604903de-1eaa-4c9c-9838-2938869b7244 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:54.708192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604903de-1eaa-4c9c-9838-2938869b7244 service swift] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:54.717321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1087/2169] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Aug 29 23:57:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:57:54.718248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604903de-1eaa-4c9c-9838-2938869b7244 service swift] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:54.719677 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-604903de-1eaa-4c9c-9838-2938869b7244 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:54.730113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-04dd44a9-f058-4bd6-b4ba-6b6a1c132f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a81c657f34c4ff4abd1e46bdf438a82'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.741299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-04dd44a9-f058-4bd6-b4ba-6b6a1c132f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a81c657f34c4ff4abd1e46bdf438a82'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.742002 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-04dd44a9-f058-4bd6-b4ba-6b6a1c132f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a81c657f34c4ff4abd1e46bdf438a82'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.761036 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-04dd44a9-f058-4bd6-b4ba-6b6a1c132f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a81c657f34c4ff4abd1e46bdf438a82'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:54.772591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1083/2170] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:54 2022] DELETE /identity/v3/users/4a81c657f34c4ff4abd1e46bdf438a82 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:54.772591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddad63-69c1-4ed7-b698-d12ace574313 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:54.772591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddad63-69c1-4ed7-b698-d12ace574313 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:54.772591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddad63-69c1-4ed7-b698-d12ace574313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:54.793160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604903de-1eaa-4c9c-9838-2938869b7244 service swift] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:54.802932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-c9ddad63-69c1-4ed7-b698-d12ace574313 None None] MFA Rules not processed for user `b702f7c3b60f458eae452ec75c3eb6af`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:54.804347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c9ddad63-69c1-4ed7-b698-d12ace574313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:54.862899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:54.863544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:54.863898 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:54.864830 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] PATH_INFO: `/v3/users/292a32318ed54f75a261aafe6859e479` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:54.866322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=292a32318ed54f75a261aafe6859e479)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:54.868620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:54.884996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1084/2171] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:54.897045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddad63-69c1-4ed7-b698-d12ace574313 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:54.898589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c9ddad63-69c1-4ed7-b698-d12ace574313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:54.955167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddad63-69c1-4ed7-b698-d12ace574313 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:54.958782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9fe4-e741-4712-bf60-f8f541dfb66b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:54.959675 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9fe4-e741-4712-bf60-f8f541dfb66b service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:54.959947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9fe4-e741-4712-bf60-f8f541dfb66b service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:54.960218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9fe4-e741-4712-bf60-f8f541dfb66b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:54.971803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee9fe4-e741-4712-bf60-f8f541dfb66b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:54.979780 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee9fe4-e741-4712-bf60-f8f541dfb66b service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:54.982767 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1085/2172] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:55.080119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292a32318ed54f75a261aafe6859e479'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:55.094743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292a32318ed54f75a261aafe6859e479'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:55.100557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292a32318ed54f75a261aafe6859e479'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:55.101271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292a32318ed54f75a261aafe6859e479'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:55.101912 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292a32318ed54f75a261aafe6859e479'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:55.185632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1088/2173] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:54 2022] DELETE /identity/v3/users/292a32318ed54f75a261aafe6859e479 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:55.215705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9fe4-e741-4712-bf60-f8f541dfb66b service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:55.217601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b2ee9fe4-e741-4712-bf60-f8f541dfb66b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:55.240896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9fe4-e741-4712-bf60-f8f541dfb66b service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:55.242109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:55.243741 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:55.306339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:55.319334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:55.319984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:55.320265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:55.320543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f admin admin] PATH_INFO: `/v3/projects/4a93fefbdef748e99a4dd4c30edd8603` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:55.321693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a93fefbdef748e99a4dd4c30edd8603)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:55.323812 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:55.328322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37e9eb-08c4-44bd-879a-f465f71112d5 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:55.332591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f842bd-b128-4f82-8cfc-9c9f0c226ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:55.333636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f842bd-b128-4f82-8cfc-9c9f0c226ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:55.333762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f842bd-b128-4f82-8cfc-9c9f0c226ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:55.334497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f842bd-b128-4f82-8cfc-9c9f0c226ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:55.336356 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-41f842bd-b128-4f82-8cfc-9c9f0c226ad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:55.382636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:55.403555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f842bd-b128-4f82-8cfc-9c9f0c226ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:55.408836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f842bd-b128-4f82-8cfc-9c9f0c226ad9 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:55.414150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1089/2174] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:57:55.469922 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a93fefbdef748e99a4dd4c30edd8603', 'request_id': 'req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:55.477460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a93fefbdef748e99a4dd4c30edd8603', 'request_id': 'req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:55.483141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a93fefbdef748e99a4dd4c30edd8603', 'request_id': 'req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:55.520620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2720c7-f780-49a1-a135-5f648d721a45 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:55.521561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2720c7-f780-49a1-a135-5f648d721a45 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:55.521838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2720c7-f780-49a1-a135-5f648d721a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:55.543468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-1d2720c7-f780-49a1-a135-5f648d721a45 None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:55.544746 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1d2720c7-f780-49a1-a135-5f648d721a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:55.609341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1090/2175] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Aug 29 23:57:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:55.623049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2720c7-f780-49a1-a135-5f648d721a45 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:55.624644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1d2720c7-f780-49a1-a135-5f648d721a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:55.688159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f admin admin] The token cache is being invalidate because project 4a93fefbdef748e99a4dd4c30edd8603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:55.688159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:55.688159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c1c12c40-3dac-4b45-8bfd-73fe21d2718f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:55.688159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1086/2176] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:55 2022] DELETE /identity/v3/projects/4a93fefbdef748e99a4dd4c30edd8603 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:55.700590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa225a-786d-4003-8265-f0d087c38129 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:55.701585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2720c7-f780-49a1-a135-5f648d721a45 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:55.702074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa225a-786d-4003-8265-f0d087c38129 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:55.711755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84cfcf-e5e7-4be2-9859-3684c2ec9573 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:55.711755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84cfcf-e5e7-4be2-9859-3684c2ec9573 service swift] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:55.711755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84cfcf-e5e7-4be2-9859-3684c2ec9573 service swift] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:55.711755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84cfcf-e5e7-4be2-9859-3684c2ec9573 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:55.715618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-af84cfcf-e5e7-4be2-9859-3684c2ec9573 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:55.716335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa225a-786d-4003-8265-f0d087c38129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:55.742025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84cfcf-e5e7-4be2-9859-3684c2ec9573 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:55.744332 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84cfcf-e5e7-4be2-9859-3684c2ec9573 service swift] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:55.768841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1091/2177] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Aug 29 23:57:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:57:55.769747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84cfcf-e5e7-4be2-9859-3684c2ec9573 service swift] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:55.772359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-dbaa225a-786d-4003-8265-f0d087c38129 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:55.773619 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-af84cfcf-e5e7-4be2-9859-3684c2ec9573 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:55.775095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-dbaa225a-786d-4003-8265-f0d087c38129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:55.862372 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1087/2178] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:55.872597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84cfcf-e5e7-4be2-9859-3684c2ec9573 service swift] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:55.873854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1a7f3-ab67-47d7-ae08-3033db59b4c4 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:55.874218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1a7f3-ab67-47d7-ae08-3033db59b4c4 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:55.874488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1a7f3-ab67-47d7-ae08-3033db59b4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:55.880106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4820c-59fa-4819-af75-e8ee653ea5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:55.881033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4820c-59fa-4819-af75-e8ee653ea5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:55.881892 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4820c-59fa-4819-af75-e8ee653ea5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:55.882423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4820c-59fa-4819-af75-e8ee653ea5bf admin admin] PATH_INFO: `/v3/projects/81dd24309a6e49e8b402fb543b1edd99` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:55.884948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4820c-59fa-4819-af75-e8ee653ea5bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=81dd24309a6e49e8b402fb543b1edd99)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:55.889279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4820c-59fa-4819-af75-e8ee653ea5bf admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:55.901947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5ca1a7f3-ab67-47d7-ae08-3033db59b4c4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:55.904180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5ca1a7f3-ab67-47d7-ae08-3033db59b4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:55.928041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1088/2179] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:55.932497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1a7f3-ab67-47d7-ae08-3033db59b4c4 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:55.962776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1a7f3-ab67-47d7-ae08-3033db59b4c4 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:55.971793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db3965-c813-4f72-bbe0-ba87210eee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:55.972504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db3965-c813-4f72-bbe0-ba87210eee20 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:55.972878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db3965-c813-4f72-bbe0-ba87210eee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:55.973161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db3965-c813-4f72-bbe0-ba87210eee20 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:55.973885 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db3965-c813-4f72-bbe0-ba87210eee20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:55.974229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db3965-c813-4f72-bbe0-ba87210eee20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:55.975912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db3965-c813-4f72-bbe0-ba87210eee20 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:55.994998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1089/2180] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:57:55.997018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db3965-c813-4f72-bbe0-ba87210eee20 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:56.013143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db3965-c813-4f72-bbe0-ba87210eee20 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:56.045948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-05f4820c-59fa-4819-af75-e8ee653ea5bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81dd24309a6e49e8b402fb543b1edd99', 'request_id': 'req-05f4820c-59fa-4819-af75-e8ee653ea5bf'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:56.068891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-05f4820c-59fa-4819-af75-e8ee653ea5bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81dd24309a6e49e8b402fb543b1edd99', 'request_id': 'req-05f4820c-59fa-4819-af75-e8ee653ea5bf'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:56.076395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:56.090538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc880cfb-403f-467c-a1d3-0d8ca95c4019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:56.091192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc880cfb-403f-467c-a1d3-0d8ca95c4019 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.091474 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc880cfb-403f-467c-a1d3-0d8ca95c4019 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.091776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc880cfb-403f-467c-a1d3-0d8ca95c4019 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.092402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc880cfb-403f-467c-a1d3-0d8ca95c4019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:56.094294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc880cfb-403f-467c-a1d3-0d8ca95c4019 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:56.174044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-05f4820c-59fa-4819-af75-e8ee653ea5bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81dd24309a6e49e8b402fb543b1edd99', 'request_id': 'req-05f4820c-59fa-4819-af75-e8ee653ea5bf'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:56.174558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:56.188109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-05f4820c-59fa-4819-af75-e8ee653ea5bf admin admin] The token cache is being invalidate because project 81dd24309a6e49e8b402fb543b1edd99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:56.190499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-05f4820c-59fa-4819-af75-e8ee653ea5bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:56.190499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-05f4820c-59fa-4819-af75-e8ee653ea5bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:56.194078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1092/2181] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:55 2022] DELETE /identity/v3/projects/81dd24309a6e49e8b402fb543b1edd99 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:56.195798 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0264-dfd2-4fd3-a663-59bf9f7f468c None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.196087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0264-dfd2-4fd3-a663-59bf9f7f468c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.196442 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0264-dfd2-4fd3-a663-59bf9f7f468c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.217077 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-bcbf0264-dfd2-4fd3-a663-59bf9f7f468c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:56.218260 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bcbf0264-dfd2-4fd3-a663-59bf9f7f468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:56.229724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1093/2182] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:56.237507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b495a-f506-4cd6-adfa-df8643b71fa6 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.238296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b495a-f506-4cd6-adfa-df8643b71fa6 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.238670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b495a-f506-4cd6-adfa-df8643b71fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.240504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1090/2183] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:55 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:56.241439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc880cfb-403f-467c-a1d3-0d8ca95c4019 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:56.243508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fc880cfb-403f-467c-a1d3-0d8ca95c4019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:56.259344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-289b495a-f506-4cd6-adfa-df8643b71fa6 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:56.260633 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-289b495a-f506-4cd6-adfa-df8643b71fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:56.319580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc880cfb-403f-467c-a1d3-0d8ca95c4019 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:56.327168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f424b52-e07c-4068-a12b-9c29ee68ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:56.334397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f424b52-e07c-4068-a12b-9c29ee68ee6e admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.334397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f424b52-e07c-4068-a12b-9c29ee68ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.334397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f424b52-e07c-4068-a12b-9c29ee68ee6e admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.334397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f424b52-e07c-4068-a12b-9c29ee68ee6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:56.335197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1094/2184] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:56.335295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f424b52-e07c-4068-a12b-9c29ee68ee6e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:56.335469 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b495a-f506-4cd6-adfa-df8643b71fa6 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:56.346578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b495a-f506-4cd6-adfa-df8643b71fa6 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:56.351609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228297a-0ab2-4ee4-af9c-fac37e391a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:56.352225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228297a-0ab2-4ee4-af9c-fac37e391a9e admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.352505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228297a-0ab2-4ee4-af9c-fac37e391a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.352781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228297a-0ab2-4ee4-af9c-fac37e391a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.353439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228297a-0ab2-4ee4-af9c-fac37e391a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:56.353744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228297a-0ab2-4ee4-af9c-fac37e391a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:56.356134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228297a-0ab2-4ee4-af9c-fac37e391a9e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:56.369084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1095/2185] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:57:56.373339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228297a-0ab2-4ee4-af9c-fac37e391a9e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:56.383932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228297a-0ab2-4ee4-af9c-fac37e391a9e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:56.389095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bde7c-6125-4973-a1b5-c6b7a0d3d91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:56.392353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bde7c-6125-4973-a1b5-c6b7a0d3d91c admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.392353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bde7c-6125-4973-a1b5-c6b7a0d3d91c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.392353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bde7c-6125-4973-a1b5-c6b7a0d3d91c admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.392353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bde7c-6125-4973-a1b5-c6b7a0d3d91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:56.394299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bde7c-6125-4973-a1b5-c6b7a0d3d91c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:56.434632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1091/2186] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:56 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:56.435780 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f424b52-e07c-4068-a12b-9c29ee68ee6e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:56.446488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f424b52-e07c-4068-a12b-9c29ee68ee6e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:56.451609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39d7a8-ea88-4458-914f-f5caae6ed0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:56.452039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d7a8-ea88-4458-914f-f5caae6ed0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.452322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d7a8-ea88-4458-914f-f5caae6ed0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.452598 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d7a8-ea88-4458-914f-f5caae6ed0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.453248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39d7a8-ea88-4458-914f-f5caae6ed0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:56.454860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39d7a8-ea88-4458-914f-f5caae6ed0c7 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:56.465252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1092/2187] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:56.466531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb51be-d910-480c-8dee-758c3b502251 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.466824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb51be-d910-480c-8dee-758c3b502251 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.467127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb51be-d910-480c-8dee-758c3b502251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.486339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-73cb51be-d910-480c-8dee-758c3b502251 None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:56.487639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-73cb51be-d910-480c-8dee-758c3b502251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:56.511160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1096/2188] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:56 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:56.511160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bde7c-6125-4973-a1b5-c6b7a0d3d91c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:56.567594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1093/2189] 10.222.0.73 () {58 vars in 967 bytes} [Mon Aug 29 23:57:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:56.568599 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb51be-d910-480c-8dee-758c3b502251 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:56.580177 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb51be-d910-480c-8dee-758c3b502251 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:56.582765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bde7c-6125-4973-a1b5-c6b7a0d3d91c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:56.585836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c77d59-001b-4d86-aff3-37bf2d928812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:56.586510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c77d59-001b-4d86-aff3-37bf2d928812 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.586793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c77d59-001b-4d86-aff3-37bf2d928812 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.587127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c77d59-001b-4d86-aff3-37bf2d928812 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.587761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c77d59-001b-4d86-aff3-37bf2d928812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:56.589697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c77d59-001b-4d86-aff3-37bf2d928812 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:56.589822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00051e-a029-4b6b-b506-b89a9102f66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:56.590356 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00051e-a029-4b6b-b506-b89a9102f66d admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.590639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00051e-a029-4b6b-b506-b89a9102f66d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.590945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00051e-a029-4b6b-b506-b89a9102f66d admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.591591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00051e-a029-4b6b-b506-b89a9102f66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:56.593170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00051e-a029-4b6b-b506-b89a9102f66d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:56.607761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1097/2190] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:56.607761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00051e-a029-4b6b-b506-b89a9102f66d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:56.607761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cf00051e-a029-4b6b-b506-b89a9102f66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:56.679150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00051e-a029-4b6b-b506-b89a9102f66d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:56.682383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea97ba-e351-4751-a7be-7d632d55ca2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:56.683036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea97ba-e351-4751-a7be-7d632d55ca2e service swift] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.683316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea97ba-e351-4751-a7be-7d632d55ca2e service swift] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.683591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea97ba-e351-4751-a7be-7d632d55ca2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.704844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1094/2191] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:56 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:56.706410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c77d59-001b-4d86-aff3-37bf2d928812 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:56.717842 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c77d59-001b-4d86-aff3-37bf2d928812 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:56.723432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaa08b-87e4-4e28-8d12-bfa87b646ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:56.724095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaa08b-87e4-4e28-8d12-bfa87b646ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.724380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaa08b-87e4-4e28-8d12-bfa87b646ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.724655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaa08b-87e4-4e28-8d12-bfa87b646ab3 admin admin] PATH_INFO: `/v3/projects/4a194187e68b4e61b2a5dc91f538ce1f/users/3efd5000a99e417da4211afd11a41bca/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.741089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaa08b-87e4-4e28-8d12-bfa87b646ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a194187e68b4e61b2a5dc91f538ce1f, user_id=3efd5000a99e417da4211afd11a41bca, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:56.743833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaa08b-87e4-4e28-8d12-bfa87b646ab3 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:56.747745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea97ba-e351-4751-a7be-7d632d55ca2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:56.749116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea97ba-e351-4751-a7be-7d632d55ca2e service swift] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:56.757364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1098/2192] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Aug 29 23:57:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:57:56.758148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea97ba-e351-4751-a7be-7d632d55ca2e service swift] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:56.767763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea97ba-e351-4751-a7be-7d632d55ca2e service swift] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:56.781295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4be6c-cb17-442f-9dd5-6c67f9c0f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:56.781295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4be6c-cb17-442f-9dd5-6c67f9c0f039 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.781295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4be6c-cb17-442f-9dd5-6c67f9c0f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.781295 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4be6c-cb17-442f-9dd5-6c67f9c0f039 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.781760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4be6c-cb17-442f-9dd5-6c67f9c0f039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:56.781760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4be6c-cb17-442f-9dd5-6c67f9c0f039 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:56.790609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1099/2193] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:56.792234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4be6c-cb17-442f-9dd5-6c67f9c0f039 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:56.802485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4be6c-cb17-442f-9dd5-6c67f9c0f039 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:56.807743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c28c73-e8e7-4f86-ba52-b91675cf03f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:56.808327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c28c73-e8e7-4f86-ba52-b91675cf03f1 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.809142 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c28c73-e8e7-4f86-ba52-b91675cf03f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.809142 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c28c73-e8e7-4f86-ba52-b91675cf03f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.809477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c28c73-e8e7-4f86-ba52-b91675cf03f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:56.811086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c28c73-e8e7-4f86-ba52-b91675cf03f1 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:56.820737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1100/2194] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:56.825034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c28c73-e8e7-4f86-ba52-b91675cf03f1 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:56.834794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c28c73-e8e7-4f86-ba52-b91675cf03f1 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:56.839471 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2fcf9-7726-4a6a-bb23-cb077abc00e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:56.840086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2fcf9-7726-4a6a-bb23-cb077abc00e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.840365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2fcf9-7726-4a6a-bb23-cb077abc00e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.840638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2fcf9-7726-4a6a-bb23-cb077abc00e9 admin admin] PATH_INFO: `/v3/projects/46cc850e7d0141b2b9ca2971a651dce6/users/c66b3833c3e0474b89620b5e82025ae0/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.856234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2fcf9-7726-4a6a-bb23-cb077abc00e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46cc850e7d0141b2b9ca2971a651dce6, user_id=c66b3833c3e0474b89620b5e82025ae0, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:56.859013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2fcf9-7726-4a6a-bb23-cb077abc00e9 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:56.867377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1095/2195] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:56 2022] PUT /identity/v3/projects/4a194187e68b4e61b2a5dc91f538ce1f/users/3efd5000a99e417da4211afd11a41bca/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:56.876823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4959e-8b36-40cc-81b7-c6342fcef71b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.877114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4959e-8b36-40cc-81b7-c6342fcef71b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.877394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4959e-8b36-40cc-81b7-c6342fcef71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:56.905220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-e2e4959e-8b36-40cc-81b7-c6342fcef71b None None] MFA Rules not processed for user `3efd5000a99e417da4211afd11a41bca`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:56.906448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e2e4959e-8b36-40cc-81b7-c6342fcef71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:56.970731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1096/2196] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:56.981148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1101/2197] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:56 2022] PUT /identity/v3/projects/46cc850e7d0141b2b9ca2971a651dce6/users/c66b3833c3e0474b89620b5e82025ae0/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:56.994668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f96147-fa3d-4b3d-b15b-17fbeb79e1bb None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:56.995053 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f96147-fa3d-4b3d-b15b-17fbeb79e1bb None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:56.995334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f96147-fa3d-4b3d-b15b-17fbeb79e1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:57.000128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2fcf9-7726-4a6a-bb23-cb077abc00e9 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:57.002090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-deb2fcf9-7726-4a6a-bb23-cb077abc00e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:57.041885 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-44f96147-fa3d-4b3d-b15b-17fbeb79e1bb None None] MFA Rules not processed for user `c66b3833c3e0474b89620b5e82025ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:57.042796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-44f96147-fa3d-4b3d-b15b-17fbeb79e1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:57.093906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2fcf9-7726-4a6a-bb23-cb077abc00e9 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:57.099998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851efb7-8a6b-4b16-b9ea-8feb99dd17a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:57.100665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851efb7-8a6b-4b16-b9ea-8feb99dd17a8 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:57.100942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851efb7-8a6b-4b16-b9ea-8feb99dd17a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:57.101216 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851efb7-8a6b-4b16-b9ea-8feb99dd17a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:57.118031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1097/2198] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:57.122945 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f96147-fa3d-4b3d-b15b-17fbeb79e1bb None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:57.164670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851efb7-8a6b-4b16-b9ea-8feb99dd17a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:57.166399 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851efb7-8a6b-4b16-b9ea-8feb99dd17a8 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:57.180914 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1102/2199] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:57.198146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f96147-fa3d-4b3d-b15b-17fbeb79e1bb None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:57.213440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a658bd9-7945-464b-a5f9-e72ef70e2fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:57.214387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a658bd9-7945-464b-a5f9-e72ef70e2fed admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:57.215357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a658bd9-7945-464b-a5f9-e72ef70e2fed admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:57.215918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a658bd9-7945-464b-a5f9-e72ef70e2fed admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:57.216643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a658bd9-7945-464b-a5f9-e72ef70e2fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:57.219914 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a658bd9-7945-464b-a5f9-e72ef70e2fed admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:57.227873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851efb7-8a6b-4b16-b9ea-8feb99dd17a8 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:57.240897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851efb7-8a6b-4b16-b9ea-8feb99dd17a8 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:57.245640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2688a-65e6-48f8-94c4-1c4b06ae460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:57.246317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2688a-65e6-48f8-94c4-1c4b06ae460d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:57.246566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2688a-65e6-48f8-94c4-1c4b06ae460d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:57.246841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2688a-65e6-48f8-94c4-1c4b06ae460d admin admin] PATH_INFO: `/v3/users/3efd5000a99e417da4211afd11a41bca` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:57.248023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2688a-65e6-48f8-94c4-1c4b06ae460d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3efd5000a99e417da4211afd11a41bca)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:57.249942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2688a-65e6-48f8-94c4-1c4b06ae460d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:57.301103 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:57.310678 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1098/2200] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:57 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:57.314450 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a658bd9-7945-464b-a5f9-e72ef70e2fed admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:57.393247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a658bd9-7945-464b-a5f9-e72ef70e2fed admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:57.415519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9179e-5f33-4745-9100-5c39ea2bdd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:57.415519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9179e-5f33-4745-9100-5c39ea2bdd12 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:57.415519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9179e-5f33-4745-9100-5c39ea2bdd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:57.415519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9179e-5f33-4745-9100-5c39ea2bdd12 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:57.415938 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9179e-5f33-4745-9100-5c39ea2bdd12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:57.415938 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9179e-5f33-4745-9100-5c39ea2bdd12 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:57.470539 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-48c2688a-65e6-48f8-94c4-1c4b06ae460d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3efd5000a99e417da4211afd11a41bca'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:57.483309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-48c2688a-65e6-48f8-94c4-1c4b06ae460d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3efd5000a99e417da4211afd11a41bca'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:57.483478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:57.493104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1099/2201] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:57 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:57:57.494411 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-48c2688a-65e6-48f8-94c4-1c4b06ae460d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3efd5000a99e417da4211afd11a41bca'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:57.495287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-48c2688a-65e6-48f8-94c4-1c4b06ae460d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3efd5000a99e417da4211afd11a41bca'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:57.495907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-48c2688a-65e6-48f8-94c4-1c4b06ae460d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3efd5000a99e417da4211afd11a41bca'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:57.497007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9179e-5f33-4745-9100-5c39ea2bdd12 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:57.498694 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-dcc9179e-5f33-4745-9100-5c39ea2bdd12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:57.511712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9179e-5f33-4745-9100-5c39ea2bdd12 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:57.518607 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a186fd-24d6-4b4a-ad28-ff9d8951c787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:57.519368 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a186fd-24d6-4b4a-ad28-ff9d8951c787 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:57.519640 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a186fd-24d6-4b4a-ad28-ff9d8951c787 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:57.519913 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a186fd-24d6-4b4a-ad28-ff9d8951c787 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:57.520556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a186fd-24d6-4b4a-ad28-ff9d8951c787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:57.522226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a186fd-24d6-4b4a-ad28-ff9d8951c787 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:57.550915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1100/2202] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:57:57.553772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a186fd-24d6-4b4a-ad28-ff9d8951c787 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:57.564659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a186fd-24d6-4b4a-ad28-ff9d8951c787 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:57.568656 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1103/2203] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:57:57 2022] DELETE /identity/v3/users/3efd5000a99e417da4211afd11a41bca => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:57.570336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf5384-e9df-409c-a884-40c81b10a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:57.571088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf5384-e9df-409c-a884-40c81b10a52e admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:57.571376 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf5384-e9df-409c-a884-40c81b10a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:57.571660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf5384-e9df-409c-a884-40c81b10a52e admin admin] PATH_INFO: `/v3/projects/c12e4f9d9490453183ef576d28d0045e/users/d75c99eb6b364b9fb086e22de98640e3/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:57.573450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca20f1b-bb08-40f4-a5da-312603510a08 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:57.573741 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca20f1b-bb08-40f4-a5da-312603510a08 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:57.574021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca20f1b-bb08-40f4-a5da-312603510a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:57.589237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf5384-e9df-409c-a884-40c81b10a52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12e4f9d9490453183ef576d28d0045e, user_id=d75c99eb6b364b9fb086e22de98640e3, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:57.592373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf5384-e9df-409c-a884-40c81b10a52e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:57.595707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-aca20f1b-bb08-40f4-a5da-312603510a08 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:57.602851 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-aca20f1b-bb08-40f4-a5da-312603510a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:57.669585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1104/2204] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:57:57.678980 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1101/2205] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:57 2022] PUT /identity/v3/projects/c12e4f9d9490453183ef576d28d0045e/users/d75c99eb6b364b9fb086e22de98640e3/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:57.680528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca20f1b-bb08-40f4-a5da-312603510a08 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:57.681871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf5384-e9df-409c-a884-40c81b10a52e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:57.683736 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-abcf5384-e9df-409c-a884-40c81b10a52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:57.694110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca20f1b-bb08-40f4-a5da-312603510a08 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:57.755474 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf5384-e9df-409c-a884-40c81b10a52e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:57.760078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d77b6e-a505-4323-ad87-a5d3f7ed20a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:57.760689 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77b6e-a505-4323-ad87-a5d3f7ed20a4 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:57.760966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77b6e-a505-4323-ad87-a5d3f7ed20a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:57.761236 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77b6e-a505-4323-ad87-a5d3f7ed20a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:57.763900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd335d-d800-4b32-8d69-cdc2c2a524d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:57.764524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd335d-d800-4b32-8d69-cdc2c2a524d9 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:57.764804 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd335d-d800-4b32-8d69-cdc2c2a524d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:57.765077 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd335d-d800-4b32-8d69-cdc2c2a524d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:57.765724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd335d-d800-4b32-8d69-cdc2c2a524d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:57.767403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd335d-d800-4b32-8d69-cdc2c2a524d9 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:57.772514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d77b6e-a505-4323-ad87-a5d3f7ed20a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:57.773968 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d77b6e-a505-4323-ad87-a5d3f7ed20a4 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:57.777845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1105/2206] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:57.781827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd335d-d800-4b32-8d69-cdc2c2a524d9 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:57.784822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1102/2207] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:57.792389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd335d-d800-4b32-8d69-cdc2c2a524d9 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:57.799456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8489c9-f7f3-4448-b559-a8baf7aac2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:57.799456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8489c9-f7f3-4448-b559-a8baf7aac2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:57.799456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8489c9-f7f3-4448-b559-a8baf7aac2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:57.799456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8489c9-f7f3-4448-b559-a8baf7aac2d1 admin admin] PATH_INFO: `/v3/projects/c12e4f9d9490453183ef576d28d0045e/users/d75c99eb6b364b9fb086e22de98640e3/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:57.801611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8489c9-f7f3-4448-b559-a8baf7aac2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12e4f9d9490453183ef576d28d0045e, user_id=d75c99eb6b364b9fb086e22de98640e3, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:57.804777 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8489c9-f7f3-4448-b559-a8baf7aac2d1 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:57.816324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1106/2208] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:57 2022] PUT /identity/v3/projects/c12e4f9d9490453183ef576d28d0045e/users/d75c99eb6b364b9fb086e22de98640e3/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:57.827665 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7b775-0437-4a43-8aed-8ec349fbff78 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:57.828378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7b775-0437-4a43-8aed-8ec349fbff78 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:57.828378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7b775-0437-4a43-8aed-8ec349fbff78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:57.859995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-cfe7b775-0437-4a43-8aed-8ec349fbff78 None None] MFA Rules not processed for user `d75c99eb6b364b9fb086e22de98640e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:57.861775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-cfe7b775-0437-4a43-8aed-8ec349fbff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:57.944028 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1103/2209] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:58.004546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8489c9-f7f3-4448-b559-a8baf7aac2d1 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:58.005798 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0f8489c9-f7f3-4448-b559-a8baf7aac2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:58.076129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8489c9-f7f3-4448-b559-a8baf7aac2d1 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:58.080136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec59f6-71b1-4046-b049-a351f5436549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:58.080753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec59f6-71b1-4046-b049-a351f5436549 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:58.081048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec59f6-71b1-4046-b049-a351f5436549 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:58.081436 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec59f6-71b1-4046-b049-a351f5436549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:58.091098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec59f6-71b1-4046-b049-a351f5436549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:58.092629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec59f6-71b1-4046-b049-a351f5436549 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:58.102958 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1107/2210] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:58.140257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:58.249369 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7b775-0437-4a43-8aed-8ec349fbff78 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:58.253714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-cfe7b775-0437-4a43-8aed-8ec349fbff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:58.330297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7b775-0437-4a43-8aed-8ec349fbff78 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:58.338390 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:58.339165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:58.339511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:58.339813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed admin admin] PATH_INFO: `/v3/projects/4a194187e68b4e61b2a5dc91f538ce1f` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:58.341163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a194187e68b4e61b2a5dc91f538ce1f)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:58.343257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:58.373077 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:58.509167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a194187e68b4e61b2a5dc91f538ce1f', 'request_id': 'req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:58.515518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a194187e68b4e61b2a5dc91f538ce1f', 'request_id': 'req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:58.522346 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a194187e68b4e61b2a5dc91f538ce1f', 'request_id': 'req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:58.651188 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed admin admin] The token cache is being invalidate because project 4a194187e68b4e61b2a5dc91f538ce1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:57:58.651188 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:58.653036 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-99f0e6b3-6d42-4ddf-847e-0d23f82376ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:57:58.655043 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1104/2211] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:57:58 2022] DELETE /identity/v3/projects/4a194187e68b4e61b2a5dc91f538ce1f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:57:58.660108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ef414-08ae-4736-ad71-bb5f6a9bc835 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:58.661049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ef414-08ae-4736-ad71-bb5f6a9bc835 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:58.661496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ef414-08ae-4736-ad71-bb5f6a9bc835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:58.670721 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:58.718812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-cd2ef414-08ae-4736-ad71-bb5f6a9bc835 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:58.720668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cd2ef414-08ae-4736-ad71-bb5f6a9bc835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:58.824597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1108/2212] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:58.835187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd3a07-9f0c-4fd4-b4ee-147306252bf2 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:58.835994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd3a07-9f0c-4fd4-b4ee-147306252bf2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:58.835994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd3a07-9f0c-4fd4-b4ee-147306252bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:58.856841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-affd3a07-9f0c-4fd4-b4ee-147306252bf2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:58.858301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-affd3a07-9f0c-4fd4-b4ee-147306252bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:58.867252 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1105/2213] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:58.872015 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ef414-08ae-4736-ad71-bb5f6a9bc835 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:58.884842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ef414-08ae-4736-ad71-bb5f6a9bc835 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:58.892898 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b83a6-175e-40bb-8767-aedaa7e05a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:58.893612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b83a6-175e-40bb-8767-aedaa7e05a87 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:58.893754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b83a6-175e-40bb-8767-aedaa7e05a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:58.894064 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b83a6-175e-40bb-8767-aedaa7e05a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:58.894841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b83a6-175e-40bb-8767-aedaa7e05a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:57:58.895368 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b83a6-175e-40bb-8767-aedaa7e05a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:58.900591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b83a6-175e-40bb-8767-aedaa7e05a87 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:58.923302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1109/2214] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:57:58.924543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd3a07-9f0c-4fd4-b4ee-147306252bf2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:58.934144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd3a07-9f0c-4fd4-b4ee-147306252bf2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:58.940129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48065386-4911-42de-9e2a-9a3e9e8b5a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:58.940670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48065386-4911-42de-9e2a-9a3e9e8b5a4e admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:58.940952 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48065386-4911-42de-9e2a-9a3e9e8b5a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:58.941229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48065386-4911-42de-9e2a-9a3e9e8b5a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:58.941858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48065386-4911-42de-9e2a-9a3e9e8b5a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:58.943819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48065386-4911-42de-9e2a-9a3e9e8b5a4e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:59.061946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1106/2215] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:57:58 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:59.066170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b83a6-175e-40bb-8767-aedaa7e05a87 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:59.076223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b83a6-175e-40bb-8767-aedaa7e05a87 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:59.136154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90673262-0a0b-4a6f-a896-1b6c36845867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:59.136765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90673262-0a0b-4a6f-a896-1b6c36845867 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:59.137049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90673262-0a0b-4a6f-a896-1b6c36845867 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:59.137324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90673262-0a0b-4a6f-a896-1b6c36845867 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:59.137947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90673262-0a0b-4a6f-a896-1b6c36845867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:59.139982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90673262-0a0b-4a6f-a896-1b6c36845867 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:59.289061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1110/2216] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:57:59 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:57:59.293147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48065386-4911-42de-9e2a-9a3e9e8b5a4e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:59.303433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48065386-4911-42de-9e2a-9a3e9e8b5a4e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:59.307946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062d209-d854-48fe-99ee-64e81608ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:59.308532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d209-d854-48fe-99ee-64e81608ccd8 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:59.308808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d209-d854-48fe-99ee-64e81608ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:59.309076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d209-d854-48fe-99ee-64e81608ccd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:59.309722 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062d209-d854-48fe-99ee-64e81608ccd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:59.311339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062d209-d854-48fe-99ee-64e81608ccd8 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:59.321598 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1107/2217] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:59.325772 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90673262-0a0b-4a6f-a896-1b6c36845867 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:59.338788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90673262-0a0b-4a6f-a896-1b6c36845867 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:59.344372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d7ade-1739-45b2-8f3f-5c14991d45db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:59.345702 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d7ade-1739-45b2-8f3f-5c14991d45db admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:59.346541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d7ade-1739-45b2-8f3f-5c14991d45db admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:59.346665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d7ade-1739-45b2-8f3f-5c14991d45db admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:59.347393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d7ade-1739-45b2-8f3f-5c14991d45db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:59.349175 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d7ade-1739-45b2-8f3f-5c14991d45db admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:59.360740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1111/2218] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:57:59.375371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062d209-d854-48fe-99ee-64e81608ccd8 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:59.381040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062d209-d854-48fe-99ee-64e81608ccd8 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:59.385705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06baeee-a786-443c-ac8d-35c6e9d9bf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:59.397919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06baeee-a786-443c-ac8d-35c6e9d9bf00 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:59.397919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06baeee-a786-443c-ac8d-35c6e9d9bf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:59.397919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06baeee-a786-443c-ac8d-35c6e9d9bf00 admin admin] PATH_INFO: `/v3/projects/3b366808d22541c7a00205ac4d4319da/users/b80d92c0cbcd43cc80be855006da8539/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:59.406067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06baeee-a786-443c-ac8d-35c6e9d9bf00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b366808d22541c7a00205ac4d4319da, user_id=b80d92c0cbcd43cc80be855006da8539, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:59.409524 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06baeee-a786-443c-ac8d-35c6e9d9bf00 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:59.502676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1108/2219] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:57:59 2022] PUT /identity/v3/projects/3b366808d22541c7a00205ac4d4319da/users/b80d92c0cbcd43cc80be855006da8539/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:57:59.515554 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dd4da-28fa-4571-9c0b-d19b4e1e58ae None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:59.516167 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dd4da-28fa-4571-9c0b-d19b4e1e58ae None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:59.516167 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dd4da-28fa-4571-9c0b-d19b4e1e58ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:59.544602 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-791dd4da-28fa-4571-9c0b-d19b4e1e58ae None None] MFA Rules not processed for user `b80d92c0cbcd43cc80be855006da8539`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:57:59.545824 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-791dd4da-28fa-4571-9c0b-d19b4e1e58ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:59.612744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1112/2220] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:57:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:57:59.631547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:59.662936 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06baeee-a786-443c-ac8d-35c6e9d9bf00 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:57:59.664787 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a06baeee-a786-443c-ac8d-35c6e9d9bf00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:57:59.722740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06baeee-a786-443c-ac8d-35c6e9d9bf00 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:57:59.726387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e872d76-3de2-4ca7-af3c-9b9ab9ff58c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:57:59.727691 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e872d76-3de2-4ca7-af3c-9b9ab9ff58c1 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:57:59.727691 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e872d76-3de2-4ca7-af3c-9b9ab9ff58c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:57:59.727691 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e872d76-3de2-4ca7-af3c-9b9ab9ff58c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:57:59.740151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e872d76-3de2-4ca7-af3c-9b9ab9ff58c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:57:59.741818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e872d76-3de2-4ca7-af3c-9b9ab9ff58c1 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:57:59.753440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1109/2221] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:57:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:57:59.784469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:00.721878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:01.037165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:01.328843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dd4da-28fa-4571-9c0b-d19b4e1e58ae None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:01.330941 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-791dd4da-28fa-4571-9c0b-d19b4e1e58ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:01.401192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dd4da-28fa-4571-9c0b-d19b4e1e58ae None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:01.405826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:01.406464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:01.406761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:01.407164 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] PATH_INFO: `/v3/users/c66b3833c3e0474b89620b5e82025ae0` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:01.408817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66b3833c3e0474b89620b5e82025ae0)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:01.410754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:01.591490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66b3833c3e0474b89620b5e82025ae0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:01.604128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66b3833c3e0474b89620b5e82025ae0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:01.612201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66b3833c3e0474b89620b5e82025ae0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:01.612726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66b3833c3e0474b89620b5e82025ae0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:01.613425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66b3833c3e0474b89620b5e82025ae0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:01.620298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:01.702933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1113/2222] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:01 2022] DELETE /identity/v3/users/c66b3833c3e0474b89620b5e82025ae0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:01.707347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5ce18-375f-474f-bb09-c4ec10bc3b24 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:01.707680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5ce18-375f-474f-bb09-c4ec10bc3b24 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:01.707958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5ce18-375f-474f-bb09-c4ec10bc3b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:01.744183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-e2c5ce18-375f-474f-bb09-c4ec10bc3b24 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:01.749132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e2c5ce18-375f-474f-bb09-c4ec10bc3b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:01.843414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1110/2223] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:01.855766 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:01.857934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:01.920674 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541a676-c14d-479c-9877-7788cb4461c2 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:01.925022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2be201-fe1a-406f-a9da-8d61eed98917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:01.925662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2be201-fe1a-406f-a9da-8d61eed98917 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:01.925939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2be201-fe1a-406f-a9da-8d61eed98917 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:01.926235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2be201-fe1a-406f-a9da-8d61eed98917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:01.935659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2be201-fe1a-406f-a9da-8d61eed98917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:01.937322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2be201-fe1a-406f-a9da-8d61eed98917 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:01.948476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1114/2224] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:02.121849 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:02.222511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5ce18-375f-474f-bb09-c4ec10bc3b24 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:02.224216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e2c5ce18-375f-474f-bb09-c4ec10bc3b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:02.238836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5ce18-375f-474f-bb09-c4ec10bc3b24 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:02.257865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe98c3-083d-4511-b3ab-a735e9800ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:02.258609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe98c3-083d-4511-b3ab-a735e9800ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:02.259247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe98c3-083d-4511-b3ab-a735e9800ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:02.259584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe98c3-083d-4511-b3ab-a735e9800ea1 admin admin] PATH_INFO: `/v3/users/a4804ea558eb4514bd7a76db7fe055bf` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:02.261497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe98c3-083d-4511-b3ab-a735e9800ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4804ea558eb4514bd7a76db7fe055bf)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:02.266634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe98c3-083d-4511-b3ab-a735e9800ea1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:02.409170 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2be201-fe1a-406f-a9da-8d61eed98917 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:02.409582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-af2be201-fe1a-406f-a9da-8d61eed98917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:02.440360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2be201-fe1a-406f-a9da-8d61eed98917 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:02.447248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:02.447894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:02.448178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:02.448468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] PATH_INFO: `/v3/projects/46cc850e7d0141b2b9ca2971a651dce6` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:02.450118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46cc850e7d0141b2b9ca2971a651dce6)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:02.452162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:02.486683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2afe98c3-083d-4511-b3ab-a735e9800ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4804ea558eb4514bd7a76db7fe055bf'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:02.589872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2afe98c3-083d-4511-b3ab-a735e9800ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4804ea558eb4514bd7a76db7fe055bf'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:02.599534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2afe98c3-083d-4511-b3ab-a735e9800ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4804ea558eb4514bd7a76db7fe055bf'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:02.600243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2afe98c3-083d-4511-b3ab-a735e9800ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4804ea558eb4514bd7a76db7fe055bf'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:02.610406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46cc850e7d0141b2b9ca2971a651dce6', 'request_id': 'req-da720d59-293d-44bf-844b-9cc1e8da6f26'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:02.616597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46cc850e7d0141b2b9ca2971a651dce6', 'request_id': 'req-da720d59-293d-44bf-844b-9cc1e8da6f26'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:02.616927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2afe98c3-083d-4511-b3ab-a735e9800ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4804ea558eb4514bd7a76db7fe055bf'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:02.623702 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1111/2225] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:02 2022] DELETE /identity/v3/users/a4804ea558eb4514bd7a76db7fe055bf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:02.628371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97f4f2-8d42-4cab-a36a-85159f0475f0 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:02.628660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97f4f2-8d42-4cab-a36a-85159f0475f0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:02.628933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97f4f2-8d42-4cab-a36a-85159f0475f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:02.647667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-1d97f4f2-8d42-4cab-a36a-85159f0475f0 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:02.648869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1d97f4f2-8d42-4cab-a36a-85159f0475f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:02.708494 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1112/2226] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:58:02.718166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97f4f2-8d42-4cab-a36a-85159f0475f0 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:02.719595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1d97f4f2-8d42-4cab-a36a-85159f0475f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:02.733043 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46cc850e7d0141b2b9ca2971a651dce6', 'request_id': 'req-da720d59-293d-44bf-844b-9cc1e8da6f26'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:02.755040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] The token cache is being invalidate because project 46cc850e7d0141b2b9ca2971a651dce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:02.755572 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:02.756327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:02.758174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1115/2227] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:02 2022] DELETE /identity/v3/projects/46cc850e7d0141b2b9ca2971a651dce6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:58:02.762147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:02.763894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:02.795318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97f4f2-8d42-4cab-a36a-85159f0475f0 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:02.799001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60d5ae-05e0-4d1f-8418-0823e8a63cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:02.799755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60d5ae-05e0-4d1f-8418-0823e8a63cae service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:02.800032 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60d5ae-05e0-4d1f-8418-0823e8a63cae service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:02.800300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60d5ae-05e0-4d1f-8418-0823e8a63cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:02.802347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7a60d5ae-05e0-4d1f-8418-0823e8a63cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:02.815364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60d5ae-05e0-4d1f-8418-0823e8a63cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:02.816835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60d5ae-05e0-4d1f-8418-0823e8a63cae service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:02.827289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1113/2228] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:58:02.850243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da720d59-293d-44bf-844b-9cc1e8da6f26 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:02.855530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:02.856237 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:02.856809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:02.856809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] PATH_INFO: `/v3/users/d75c99eb6b364b9fb086e22de98640e3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:02.858018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75c99eb6b364b9fb086e22de98640e3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:02.860677 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:02.927880 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:03.085209 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75c99eb6b364b9fb086e22de98640e3'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:03.097688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75c99eb6b364b9fb086e22de98640e3'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:03.106624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:03.116939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60d5ae-05e0-4d1f-8418-0823e8a63cae service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:03.116939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7a60d5ae-05e0-4d1f-8418-0823e8a63cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:03.122969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75c99eb6b364b9fb086e22de98640e3'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:03.124658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75c99eb6b364b9fb086e22de98640e3'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:03.126799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75c99eb6b364b9fb086e22de98640e3'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:03.132392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60d5ae-05e0-4d1f-8418-0823e8a63cae service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:03.155057 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43da40-62cf-479b-85ef-2ca50631d41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:03.155881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43da40-62cf-479b-85ef-2ca50631d41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:03.156255 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43da40-62cf-479b-85ef-2ca50631d41e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:03.156465 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43da40-62cf-479b-85ef-2ca50631d41e admin admin] PATH_INFO: `/v3/projects/9efcd6bdb0d04037a7f5e5218a2539d9` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:03.158098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43da40-62cf-479b-85ef-2ca50631d41e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9efcd6bdb0d04037a7f5e5218a2539d9)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:03.160666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43da40-62cf-479b-85ef-2ca50631d41e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:03.226076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1116/2229] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:02 2022] DELETE /identity/v3/users/d75c99eb6b364b9fb086e22de98640e3 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:58:03.267901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0c43da40-62cf-479b-85ef-2ca50631d41e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efcd6bdb0d04037a7f5e5218a2539d9', 'request_id': 'req-0c43da40-62cf-479b-85ef-2ca50631d41e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:03.274762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0c43da40-62cf-479b-85ef-2ca50631d41e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efcd6bdb0d04037a7f5e5218a2539d9', 'request_id': 'req-0c43da40-62cf-479b-85ef-2ca50631d41e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:03.281065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0c43da40-62cf-479b-85ef-2ca50631d41e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efcd6bdb0d04037a7f5e5218a2539d9', 'request_id': 'req-0c43da40-62cf-479b-85ef-2ca50631d41e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:03.397429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0c43da40-62cf-479b-85ef-2ca50631d41e admin admin] The token cache is being invalidate because project 9efcd6bdb0d04037a7f5e5218a2539d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:03.397791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0c43da40-62cf-479b-85ef-2ca50631d41e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:03.398434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0c43da40-62cf-479b-85ef-2ca50631d41e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:03.400222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1114/2230] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:03 2022] DELETE /identity/v3/projects/9efcd6bdb0d04037a7f5e5218a2539d9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:58:03.794543 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:03.798291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:03.881088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd911d-08ee-42bd-9565-0463390173e5 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:03.944335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f52548-5251-4ea7-b0f3-49ef2ef7750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:03.944335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f52548-5251-4ea7-b0f3-49ef2ef7750a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:03.944335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f52548-5251-4ea7-b0f3-49ef2ef7750a admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:03.944335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f52548-5251-4ea7-b0f3-49ef2ef7750a admin admin] PATH_INFO: `/v3/projects/c12e4f9d9490453183ef576d28d0045e` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:03.944686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f52548-5251-4ea7-b0f3-49ef2ef7750a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12e4f9d9490453183ef576d28d0045e)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:03.944686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f52548-5251-4ea7-b0f3-49ef2ef7750a admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:04.116611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-08f52548-5251-4ea7-b0f3-49ef2ef7750a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12e4f9d9490453183ef576d28d0045e', 'request_id': 'req-08f52548-5251-4ea7-b0f3-49ef2ef7750a'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:04.125169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-08f52548-5251-4ea7-b0f3-49ef2ef7750a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12e4f9d9490453183ef576d28d0045e', 'request_id': 'req-08f52548-5251-4ea7-b0f3-49ef2ef7750a'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:04.202502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-08f52548-5251-4ea7-b0f3-49ef2ef7750a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12e4f9d9490453183ef576d28d0045e', 'request_id': 'req-08f52548-5251-4ea7-b0f3-49ef2ef7750a'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:04.216524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-08f52548-5251-4ea7-b0f3-49ef2ef7750a admin admin] The token cache is being invalidate because project c12e4f9d9490453183ef576d28d0045e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:04.216820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-08f52548-5251-4ea7-b0f3-49ef2ef7750a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:04.217484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-08f52548-5251-4ea7-b0f3-49ef2ef7750a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:04.219012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1117/2231] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:03 2022] DELETE /identity/v3/projects/c12e4f9d9490453183ef576d28d0045e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:04.224881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c8be-c608-4ab6-98f3-53129513f62b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:04.225336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c8be-c608-4ab6-98f3-53129513f62b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:04.225426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c8be-c608-4ab6-98f3-53129513f62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:04.245109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-bc47c8be-c608-4ab6-98f3-53129513f62b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:04.246314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-bc47c8be-c608-4ab6-98f3-53129513f62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:04.305091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1115/2232] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:04.313954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e7d21-e0da-455c-ba40-04632dc27c0f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:04.314301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e7d21-e0da-455c-ba40-04632dc27c0f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:04.314638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e7d21-e0da-455c-ba40-04632dc27c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:04.335122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-ca7e7d21-e0da-455c-ba40-04632dc27c0f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:04.336429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ca7e7d21-e0da-455c-ba40-04632dc27c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:04.344713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1118/2233] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:04.348991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47c8be-c608-4ab6-98f3-53129513f62b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:04.358444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47c8be-c608-4ab6-98f3-53129513f62b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:04.363120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e9b06-5f87-4937-ac98-75095a20c5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:04.363712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e9b06-5f87-4937-ac98-75095a20c5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:04.363986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e9b06-5f87-4937-ac98-75095a20c5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:04.364253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e9b06-5f87-4937-ac98-75095a20c5a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:04.364887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e9b06-5f87-4937-ac98-75095a20c5a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:58:04.365182 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e9b06-5f87-4937-ac98-75095a20c5a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:04.366759 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e9b06-5f87-4937-ac98-75095a20c5a4 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:04.378537 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1116/2234] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:58:04.382922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e7d21-e0da-455c-ba40-04632dc27c0f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:04.393203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e7d21-e0da-455c-ba40-04632dc27c0f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:04.400653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750864a-8077-4f39-812c-035531644b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:04.403108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750864a-8077-4f39-812c-035531644b09 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:04.403108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750864a-8077-4f39-812c-035531644b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:04.403108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750864a-8077-4f39-812c-035531644b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:04.403108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750864a-8077-4f39-812c-035531644b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:04.404581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750864a-8077-4f39-812c-035531644b09 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:04.420475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:04.528510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1119/2235] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:58:04 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:04.532840 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e9b06-5f87-4937-ac98-75095a20c5a4 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:04.543097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e9b06-5f87-4937-ac98-75095a20c5a4 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:04.605337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa154fd-48be-44c9-9e30-0a09e4ea8ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:04.605948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa154fd-48be-44c9-9e30-0a09e4ea8ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:04.606257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa154fd-48be-44c9-9e30-0a09e4ea8ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:04.606557 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa154fd-48be-44c9-9e30-0a09e4ea8ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:04.607225 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa154fd-48be-44c9-9e30-0a09e4ea8ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:04.609397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa154fd-48be-44c9-9e30-0a09e4ea8ac1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:04.692831 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:04.699194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1117/2236] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:58:04 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:04.703313 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750864a-8077-4f39-812c-035531644b09 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:04.717591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750864a-8077-4f39-812c-035531644b09 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:04.723200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349355c-ea45-4d3f-a349-f6d007cd1eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:04.723806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349355c-ea45-4d3f-a349-f6d007cd1eba admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:04.724083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349355c-ea45-4d3f-a349-f6d007cd1eba admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:04.724533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349355c-ea45-4d3f-a349-f6d007cd1eba admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:04.732124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349355c-ea45-4d3f-a349-f6d007cd1eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:04.732124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349355c-ea45-4d3f-a349-f6d007cd1eba admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:04.738013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1120/2237] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:58:04.742351 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa154fd-48be-44c9-9e30-0a09e4ea8ac1 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:04.752969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa154fd-48be-44c9-9e30-0a09e4ea8ac1 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:04.757793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6486984-d93b-4e47-b093-ae77f6ccb3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:04.760819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6486984-d93b-4e47-b093-ae77f6ccb3ba admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:04.760819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6486984-d93b-4e47-b093-ae77f6ccb3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:04.760819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6486984-d93b-4e47-b093-ae77f6ccb3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:04.760819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6486984-d93b-4e47-b093-ae77f6ccb3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:04.761657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6486984-d93b-4e47-b093-ae77f6ccb3ba admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:04.778223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1118/2238] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:04.780396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349355c-ea45-4d3f-a349-f6d007cd1eba admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:04.791673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349355c-ea45-4d3f-a349-f6d007cd1eba admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:04.796589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df60954-bf88-4ce5-a457-f2f8a38e880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:04.797250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df60954-bf88-4ce5-a457-f2f8a38e880f admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:04.797562 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df60954-bf88-4ce5-a457-f2f8a38e880f admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:04.798031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df60954-bf88-4ce5-a457-f2f8a38e880f admin admin] PATH_INFO: `/v3/projects/bab51c2ec987465391428078f5d1da47/users/b4b2e79a572f47c29d5ff13dcb1e46df/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:04.822391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df60954-bf88-4ce5-a457-f2f8a38e880f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab51c2ec987465391428078f5d1da47, user_id=b4b2e79a572f47c29d5ff13dcb1e46df, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:04.822391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df60954-bf88-4ce5-a457-f2f8a38e880f admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:04.951856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1121/2239] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:04 2022] PUT /identity/v3/projects/bab51c2ec987465391428078f5d1da47/users/b4b2e79a572f47c29d5ff13dcb1e46df/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:04.963544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03259f-bcc3-456c-97dd-1dfc73cbc293 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:04.963840 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03259f-bcc3-456c-97dd-1dfc73cbc293 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:04.964116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03259f-bcc3-456c-97dd-1dfc73cbc293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:04.992152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-eb03259f-bcc3-456c-97dd-1dfc73cbc293 None None] MFA Rules not processed for user `b4b2e79a572f47c29d5ff13dcb1e46df`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:04.993394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-eb03259f-bcc3-456c-97dd-1dfc73cbc293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:05.056164 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1119/2240] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:05.067745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df60954-bf88-4ce5-a457-f2f8a38e880f admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:05.069587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2df60954-bf88-4ce5-a457-f2f8a38e880f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:05.144848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df60954-bf88-4ce5-a457-f2f8a38e880f admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:05.148950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614da98-cbc2-4daa-9535-b79231e1bf3f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a10328a436c4159b6519e5493ba57f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:05.149339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614da98-cbc2-4daa-9535-b79231e1bf3f service glance] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:05.149607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614da98-cbc2-4daa-9535-b79231e1bf3f service glance] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:05.149883 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614da98-cbc2-4daa-9535-b79231e1bf3f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:05.159337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614da98-cbc2-4daa-9535-b79231e1bf3f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:05.161188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614da98-cbc2-4daa-9535-b79231e1bf3f service glance] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:05.173753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1122/2241] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:05.226430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:05.369247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:05.411909 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03259f-bcc3-456c-97dd-1dfc73cbc293 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:05.413478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-eb03259f-bcc3-456c-97dd-1dfc73cbc293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:05.483109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03259f-bcc3-456c-97dd-1dfc73cbc293 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:05.488022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:05.488740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:05.489319 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:05.489631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] PATH_INFO: `/v3/users/6545091c85f047bca3771dba7c70a9c3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:05.490847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] RBAC: Authorizing `identity:delete_user(user_id=6545091c85f047bca3771dba7c70a9c3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:05.493102 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:05.772978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6545091c85f047bca3771dba7c70a9c3'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:05.915391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6545091c85f047bca3771dba7c70a9c3'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:05.923880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6545091c85f047bca3771dba7c70a9c3'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:05.924555 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6545091c85f047bca3771dba7c70a9c3'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:05.937941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6545091c85f047bca3771dba7c70a9c3'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:05.945001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1120/2242] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:05 2022] DELETE /identity/v3/users/6545091c85f047bca3771dba7c70a9c3 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:05.949644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938824-c6cc-4965-98c2-d6f261c7bdf5 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:05.949928 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938824-c6cc-4965-98c2-d6f261c7bdf5 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:05.950202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938824-c6cc-4965-98c2-d6f261c7bdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:05.968925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-79938824-c6cc-4965-98c2-d6f261c7bdf5 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:05.970114 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-79938824-c6cc-4965-98c2-d6f261c7bdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:06.028379 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1123/2243] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:06.038407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:06.040222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:06.100457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f9c8a-0193-4ec2-920f-86751c0eadea admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:06.104447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1322064-4f34-4343-8092-dda4ac7139cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:06.105101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1322064-4f34-4343-8092-dda4ac7139cf service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:06.105370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1322064-4f34-4343-8092-dda4ac7139cf service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:06.105712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1322064-4f34-4343-8092-dda4ac7139cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:06.116047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1322064-4f34-4343-8092-dda4ac7139cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:06.117467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1322064-4f34-4343-8092-dda4ac7139cf service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:06.127848 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1121/2244] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:06.550560 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:06.720129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938824-c6cc-4965-98c2-d6f261c7bdf5 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:06.721602 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-79938824-c6cc-4965-98c2-d6f261c7bdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:06.743995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938824-c6cc-4965-98c2-d6f261c7bdf5 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:06.751796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5672a2e-cd57-48ff-a23c-a3bd772d9558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:06.753574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5672a2e-cd57-48ff-a23c-a3bd772d9558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:06.754052 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5672a2e-cd57-48ff-a23c-a3bd772d9558 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:06.754740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5672a2e-cd57-48ff-a23c-a3bd772d9558 admin admin] PATH_INFO: `/v3/projects/f2c89ef3c4cb4d3191382b01a9cb15e0` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:06.756326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5672a2e-cd57-48ff-a23c-a3bd772d9558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c89ef3c4cb4d3191382b01a9cb15e0)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:06.758776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5672a2e-cd57-48ff-a23c-a3bd772d9558 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:06.800809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:06.931140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e5672a2e-cd57-48ff-a23c-a3bd772d9558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c89ef3c4cb4d3191382b01a9cb15e0', 'request_id': 'req-e5672a2e-cd57-48ff-a23c-a3bd772d9558'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:06.943600 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e5672a2e-cd57-48ff-a23c-a3bd772d9558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c89ef3c4cb4d3191382b01a9cb15e0', 'request_id': 'req-e5672a2e-cd57-48ff-a23c-a3bd772d9558'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:07.040980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e5672a2e-cd57-48ff-a23c-a3bd772d9558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c89ef3c4cb4d3191382b01a9cb15e0', 'request_id': 'req-e5672a2e-cd57-48ff-a23c-a3bd772d9558'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:07.048856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e5672a2e-cd57-48ff-a23c-a3bd772d9558 admin admin] The token cache is being invalidate because project f2c89ef3c4cb4d3191382b01a9cb15e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:07.049146 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e5672a2e-cd57-48ff-a23c-a3bd772d9558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:07.049801 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-e5672a2e-cd57-48ff-a23c-a3bd772d9558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:07.051377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1124/2245] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:06 2022] DELETE /identity/v3/projects/f2c89ef3c4cb4d3191382b01a9cb15e0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:07.056306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fbcd0-d635-4a63-b431-a9efa1f2063b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:07.056662 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fbcd0-d635-4a63-b431-a9efa1f2063b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:07.057138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fbcd0-d635-4a63-b431-a9efa1f2063b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:07.079906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-569fbcd0-d635-4a63-b431-a9efa1f2063b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:07.081463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-569fbcd0-d635-4a63-b431-a9efa1f2063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:07.149690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1122/2246] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:07.158196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18135fe-f128-4864-9f5c-1b85e98e538a None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:07.158480 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18135fe-f128-4864-9f5c-1b85e98e538a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:07.159253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18135fe-f128-4864-9f5c-1b85e98e538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:07.183058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d18135fe-f128-4864-9f5c-1b85e98e538a None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:07.184476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d18135fe-f128-4864-9f5c-1b85e98e538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:07.197288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1125/2247] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:07.198622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fbcd0-d635-4a63-b431-a9efa1f2063b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:07.210313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fbcd0-d635-4a63-b431-a9efa1f2063b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:07.215582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213adfb-59a3-4c5a-8666-fc9ab5fc8d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:07.216285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213adfb-59a3-4c5a-8666-fc9ab5fc8d7f admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:07.218568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213adfb-59a3-4c5a-8666-fc9ab5fc8d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:07.218568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213adfb-59a3-4c5a-8666-fc9ab5fc8d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:07.218568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213adfb-59a3-4c5a-8666-fc9ab5fc8d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:58:07.218568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213adfb-59a3-4c5a-8666-fc9ab5fc8d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:07.220883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213adfb-59a3-4c5a-8666-fc9ab5fc8d7f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:07.235920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1123/2248] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:58:07.241338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18135fe-f128-4864-9f5c-1b85e98e538a None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:07.252462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18135fe-f128-4864-9f5c-1b85e98e538a None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:07.257772 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab5e8-5826-4166-a723-937a0aff5389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:07.258697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab5e8-5826-4166-a723-937a0aff5389 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:07.259162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab5e8-5826-4166-a723-937a0aff5389 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:07.259582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab5e8-5826-4166-a723-937a0aff5389 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:07.260430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ab5e8-5826-4166-a723-937a0aff5389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:07.262623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ab5e8-5826-4166-a723-937a0aff5389 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:07.343121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1126/2249] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:58:07 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:07.347232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213adfb-59a3-4c5a-8666-fc9ab5fc8d7f admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:07.357917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213adfb-59a3-4c5a-8666-fc9ab5fc8d7f admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:07.421279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043aec8-e76d-4ff9-9fc3-9828876e2ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:07.421886 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043aec8-e76d-4ff9-9fc3-9828876e2ffc admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:07.422164 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043aec8-e76d-4ff9-9fc3-9828876e2ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:07.422978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043aec8-e76d-4ff9-9fc3-9828876e2ffc admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:07.423648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043aec8-e76d-4ff9-9fc3-9828876e2ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:07.425561 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043aec8-e76d-4ff9-9fc3-9828876e2ffc admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:07.517769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1124/2250] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:58:07 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:07.523091 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab5e8-5826-4166-a723-937a0aff5389 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:07.533891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab5e8-5826-4166-a723-937a0aff5389 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:07.538842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef07a14-786c-40f8-a35f-ab15a73749ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:07.539765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef07a14-786c-40f8-a35f-ab15a73749ec admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:07.540222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef07a14-786c-40f8-a35f-ab15a73749ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:07.540572 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:07.540821 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef07a14-786c-40f8-a35f-ab15a73749ec admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:07.541618 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef07a14-786c-40f8-a35f-ab15a73749ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:07.543404 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef07a14-786c-40f8-a35f-ab15a73749ec admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:07.554348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1127/2251] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:07.559147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043aec8-e76d-4ff9-9fc3-9828876e2ffc admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:07.572784 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043aec8-e76d-4ff9-9fc3-9828876e2ffc admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:07.577007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096000d5-60bc-4cae-ac2e-f230979e0526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:07.577649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096000d5-60bc-4cae-ac2e-f230979e0526 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:07.577934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096000d5-60bc-4cae-ac2e-f230979e0526 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:07.578210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096000d5-60bc-4cae-ac2e-f230979e0526 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:07.578949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096000d5-60bc-4cae-ac2e-f230979e0526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:07.580531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096000d5-60bc-4cae-ac2e-f230979e0526 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:07.593109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1125/2252] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:07.604571 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef07a14-786c-40f8-a35f-ab15a73749ec admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:07.617415 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef07a14-786c-40f8-a35f-ab15a73749ec admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:07.622496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4d4ba-67ee-46a1-ad3f-0b7df45faa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:07.623267 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4d4ba-67ee-46a1-ad3f-0b7df45faa21 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:07.623550 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4d4ba-67ee-46a1-ad3f-0b7df45faa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:07.623828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4d4ba-67ee-46a1-ad3f-0b7df45faa21 admin admin] PATH_INFO: `/v3/projects/df53a7eab90c4d2ca708042f543c8c5f/users/815c86f9dc164450b13adae1fbd02875/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:07.640512 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4d4ba-67ee-46a1-ad3f-0b7df45faa21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df53a7eab90c4d2ca708042f543c8c5f, user_id=815c86f9dc164450b13adae1fbd02875, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:07.643845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4d4ba-67ee-46a1-ad3f-0b7df45faa21 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:07.710495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1128/2253] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:07 2022] PUT /identity/v3/projects/df53a7eab90c4d2ca708042f543c8c5f/users/815c86f9dc164450b13adae1fbd02875/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:07.721093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7dce6-545b-48fe-bfdc-afdf6a732bed None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:07.721376 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7dce6-545b-48fe-bfdc-afdf6a732bed None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:07.721652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7dce6-545b-48fe-bfdc-afdf6a732bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:07.753253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-59e7dce6-545b-48fe-bfdc-afdf6a732bed None None] MFA Rules not processed for user `815c86f9dc164450b13adae1fbd02875`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:07.755330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-59e7dce6-545b-48fe-bfdc-afdf6a732bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:07.885276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1126/2254] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:07.910216 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4d4ba-67ee-46a1-ad3f-0b7df45faa21 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:07.910216 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2ed4d4ba-67ee-46a1-ad3f-0b7df45faa21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:07.927474 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:08.025209 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4d4ba-67ee-46a1-ad3f-0b7df45faa21 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:08.041134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1e774-39d1-4095-98e5-12a7cf82e597 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a10328a436c4159b6519e5493ba57f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:08.042606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1e774-39d1-4095-98e5-12a7cf82e597 service glance] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:08.043056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1e774-39d1-4095-98e5-12a7cf82e597 service glance] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:08.043524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1e774-39d1-4095-98e5-12a7cf82e597 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:08.054844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1e774-39d1-4095-98e5-12a7cf82e597 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:08.056520 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1e774-39d1-4095-98e5-12a7cf82e597 service glance] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:08.078714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1129/2255] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:08.138871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:08.619892 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:08.894149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:09.574569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:09.613791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:09.886442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:09.973530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:10.516930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:10.686849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:11.018238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:11.276667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:11.316282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:11.465248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:11.602464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:11.716829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:11.802477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:11.877218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:11.945932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:12.299825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:12.355158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:12.625787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:12.825029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:13.099842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:13.242176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:13.265648 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:13.268796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7dce6-545b-48fe-bfdc-afdf6a732bed None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:13.270205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-59e7dce6-545b-48fe-bfdc-afdf6a732bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:13.336360 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:13.340621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7dce6-545b-48fe-bfdc-afdf6a732bed None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:13.345799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:13.346452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:13.346729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:13.347080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] PATH_INFO: `/v3/users/b80d92c0cbcd43cc80be855006da8539` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:13.348227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b80d92c0cbcd43cc80be855006da8539)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:13.350181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:13.356632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:13.509644 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:13.514759 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b80d92c0cbcd43cc80be855006da8539'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:13.595320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b80d92c0cbcd43cc80be855006da8539'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:13.603430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b80d92c0cbcd43cc80be855006da8539'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:13.604116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b80d92c0cbcd43cc80be855006da8539'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:13.616528 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b80d92c0cbcd43cc80be855006da8539'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:13.622440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1127/2256] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:13 2022] DELETE /identity/v3/users/b80d92c0cbcd43cc80be855006da8539 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:13.631153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51268f6b-5e08-4b8e-b128-aa858b668627 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:13.631583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51268f6b-5e08-4b8e-b128-aa858b668627 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:13.631866 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51268f6b-5e08-4b8e-b128-aa858b668627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:13.653095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-51268f6b-5e08-4b8e-b128-aa858b668627 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:13.654318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-51268f6b-5e08-4b8e-b128-aa858b668627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:13.724076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1130/2257] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:13.734251 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:13.734458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:13.736009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:13.797320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:13.808863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16212a61-bffa-4142-8ad4-72bbc7d6f4fa admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:13.813256 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb888423-5b36-4e6a-b175-4bdba7a5af35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:13.813866 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb888423-5b36-4e6a-b175-4bdba7a5af35 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:13.814141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb888423-5b36-4e6a-b175-4bdba7a5af35 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:13.814405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb888423-5b36-4e6a-b175-4bdba7a5af35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:13.823766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb888423-5b36-4e6a-b175-4bdba7a5af35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:13.825177 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb888423-5b36-4e6a-b175-4bdba7a5af35 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:13.836354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1128/2258] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:14.093431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:14.116449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:14.331444 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51268f6b-5e08-4b8e-b128-aa858b668627 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:14.333635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-51268f6b-5e08-4b8e-b128-aa858b668627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:14.351363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51268f6b-5e08-4b8e-b128-aa858b668627 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:14.357067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87065f-fa48-49ad-8d58-a156b20c1158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:14.359199 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87065f-fa48-49ad-8d58-a156b20c1158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:14.359199 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87065f-fa48-49ad-8d58-a156b20c1158 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:14.360278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87065f-fa48-49ad-8d58-a156b20c1158 admin admin] PATH_INFO: `/v3/projects/3b366808d22541c7a00205ac4d4319da` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:14.363116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87065f-fa48-49ad-8d58-a156b20c1158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b366808d22541c7a00205ac4d4319da)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:14.366162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87065f-fa48-49ad-8d58-a156b20c1158 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:14.497271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cd87065f-fa48-49ad-8d58-a156b20c1158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b366808d22541c7a00205ac4d4319da', 'request_id': 'req-cd87065f-fa48-49ad-8d58-a156b20c1158'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:14.514367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cd87065f-fa48-49ad-8d58-a156b20c1158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b366808d22541c7a00205ac4d4319da', 'request_id': 'req-cd87065f-fa48-49ad-8d58-a156b20c1158'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:14.596326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cd87065f-fa48-49ad-8d58-a156b20c1158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b366808d22541c7a00205ac4d4319da', 'request_id': 'req-cd87065f-fa48-49ad-8d58-a156b20c1158'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:14.607873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:14.611931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cd87065f-fa48-49ad-8d58-a156b20c1158 admin admin] The token cache is being invalidate because project 3b366808d22541c7a00205ac4d4319da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:14.614255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cd87065f-fa48-49ad-8d58-a156b20c1158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:14.614255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cd87065f-fa48-49ad-8d58-a156b20c1158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:14.614460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1131/2259] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:14 2022] DELETE /identity/v3/projects/3b366808d22541c7a00205ac4d4319da => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:14.654140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:14.996650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:15.093703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:15.236518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:15.629710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb888423-5b36-4e6a-b175-4bdba7a5af35 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:15.631992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fb888423-5b36-4e6a-b175-4bdba7a5af35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:15.645028 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb888423-5b36-4e6a-b175-4bdba7a5af35 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:15.718771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:15.719565 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:15.719924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:15.720269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] PATH_INFO: `/v3/users/e8be7e3f0ee64eaea38d319d43ca7e78` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:15.721557 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8be7e3f0ee64eaea38d319d43ca7e78)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:15.723710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:15.929571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:15.942757 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8be7e3f0ee64eaea38d319d43ca7e78'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:16.051722 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8be7e3f0ee64eaea38d319d43ca7e78'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:16.060753 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8be7e3f0ee64eaea38d319d43ca7e78'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:16.061428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8be7e3f0ee64eaea38d319d43ca7e78'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:16.073932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8be7e3f0ee64eaea38d319d43ca7e78'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:16.079865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1129/2260] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:15 2022] DELETE /identity/v3/users/e8be7e3f0ee64eaea38d319d43ca7e78 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:16.084742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5bb7-3624-4741-85fe-c462acfcc8a3 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:16.085282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5bb7-3624-4741-85fe-c462acfcc8a3 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:16.085377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5bb7-3624-4741-85fe-c462acfcc8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:16.105316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-93de5bb7-3624-4741-85fe-c462acfcc8a3 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:16.106714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-93de5bb7-3624-4741-85fe-c462acfcc8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:16.120729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:16.167222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1132/2261] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:16.177747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:16.179882 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:16.245176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36f8cc-694e-4d1a-9122-2d6ea301dc7e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:16.248854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293413a6-5cec-4ef0-8b0a-a2b62725b5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:16.249461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293413a6-5cec-4ef0-8b0a-a2b62725b5db service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:16.249742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293413a6-5cec-4ef0-8b0a-a2b62725b5db service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:16.250015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293413a6-5cec-4ef0-8b0a-a2b62725b5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:16.261823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293413a6-5cec-4ef0-8b0a-a2b62725b5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:16.263733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293413a6-5cec-4ef0-8b0a-a2b62725b5db service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:16.274771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1130/2262] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:16.699391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5bb7-3624-4741-85fe-c462acfcc8a3 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:16.700984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-93de5bb7-3624-4741-85fe-c462acfcc8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:16.714574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5bb7-3624-4741-85fe-c462acfcc8a3 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:16.719463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:16.720899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:16.721241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:16.721524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] PATH_INFO: `/v3/projects/f0a7616cfe3141b890b611c6724c4204` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:16.723353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a7616cfe3141b890b611c6724c4204)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:16.725759 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:16.845644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a7616cfe3141b890b611c6724c4204', 'request_id': 'req-41ad7ad5-45f1-42ed-8688-78a109bfe219'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:16.851990 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a7616cfe3141b890b611c6724c4204', 'request_id': 'req-41ad7ad5-45f1-42ed-8688-78a109bfe219'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:16.933349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a7616cfe3141b890b611c6724c4204', 'request_id': 'req-41ad7ad5-45f1-42ed-8688-78a109bfe219'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:16.968347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] The token cache is being invalidate because project f0a7616cfe3141b890b611c6724c4204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:16.968649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:16.969343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:16.971031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1133/2263] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:16 2022] DELETE /identity/v3/projects/f0a7616cfe3141b890b611c6724c4204 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:16.975633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293413a6-5cec-4ef0-8b0a-a2b62725b5db service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:16.986344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293413a6-5cec-4ef0-8b0a-a2b62725b5db service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:17.059242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c055dd-acde-4f96-9eb9-d6be2e1fa8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:17.059879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c055dd-acde-4f96-9eb9-d6be2e1fa8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:17.060159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c055dd-acde-4f96-9eb9-d6be2e1fa8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:17.060432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c055dd-acde-4f96-9eb9-d6be2e1fa8f1 admin admin] PATH_INFO: `/v3/users/b702f7c3b60f458eae452ec75c3eb6af` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:17.061548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c055dd-acde-4f96-9eb9-d6be2e1fa8f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b702f7c3b60f458eae452ec75c3eb6af)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:17.064070 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c055dd-acde-4f96-9eb9-d6be2e1fa8f1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:17.246478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c7c055dd-acde-4f96-9eb9-d6be2e1fa8f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b702f7c3b60f458eae452ec75c3eb6af'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:17.310228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c7c055dd-acde-4f96-9eb9-d6be2e1fa8f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b702f7c3b60f458eae452ec75c3eb6af'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:17.311902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:17.320085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c7c055dd-acde-4f96-9eb9-d6be2e1fa8f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b702f7c3b60f458eae452ec75c3eb6af'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:17.320838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c7c055dd-acde-4f96-9eb9-d6be2e1fa8f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b702f7c3b60f458eae452ec75c3eb6af'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:17.332989 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c7c055dd-acde-4f96-9eb9-d6be2e1fa8f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b702f7c3b60f458eae452ec75c3eb6af'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:17.339630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1131/2264] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:16 2022] DELETE /identity/v3/users/b702f7c3b60f458eae452ec75c3eb6af => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:17.802303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:17.803846 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:17.819296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad7ad5-45f1-42ed-8688-78a109bfe219 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:17.879807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1d42f-84eb-467f-b486-26b373f97ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:17.880516 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1d42f-84eb-467f-b486-26b373f97ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:17.880816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1d42f-84eb-467f-b486-26b373f97ade admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:17.881102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1d42f-84eb-467f-b486-26b373f97ade admin admin] PATH_INFO: `/v3/projects/f79128d25c434f92a168053f2ab97923` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:17.882305 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1d42f-84eb-467f-b486-26b373f97ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79128d25c434f92a168053f2ab97923)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:17.884381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1d42f-84eb-467f-b486-26b373f97ade admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:18.015288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:18.015288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a0e1d42f-84eb-467f-b486-26b373f97ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79128d25c434f92a168053f2ab97923', 'request_id': 'req-a0e1d42f-84eb-467f-b486-26b373f97ade'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:18.021742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a0e1d42f-84eb-467f-b486-26b373f97ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79128d25c434f92a168053f2ab97923', 'request_id': 'req-a0e1d42f-84eb-467f-b486-26b373f97ade'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:18.154640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a0e1d42f-84eb-467f-b486-26b373f97ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79128d25c434f92a168053f2ab97923', 'request_id': 'req-a0e1d42f-84eb-467f-b486-26b373f97ade'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:18.170760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a0e1d42f-84eb-467f-b486-26b373f97ade admin admin] The token cache is being invalidate because project f79128d25c434f92a168053f2ab97923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:18.171206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a0e1d42f-84eb-467f-b486-26b373f97ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:18.172041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a0e1d42f-84eb-467f-b486-26b373f97ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:18.173733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1134/2265] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:17 2022] DELETE /identity/v3/projects/f79128d25c434f92a168053f2ab97923 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:18.178742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e3cec-ad72-4fa4-a3d3-557bc52d4895 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:18.179279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e3cec-ad72-4fa4-a3d3-557bc52d4895 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:18.179530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e3cec-ad72-4fa4-a3d3-557bc52d4895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:18.200758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-966e3cec-ad72-4fa4-a3d3-557bc52d4895 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:18.202071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-966e3cec-ad72-4fa4-a3d3-557bc52d4895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:18.266357 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1132/2266] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:18.277463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f974570-7488-4093-92c0-25387c7295d4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:18.277756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f974570-7488-4093-92c0-25387c7295d4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:18.278038 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f974570-7488-4093-92c0-25387c7295d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:18.298348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-1f974570-7488-4093-92c0-25387c7295d4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:18.299602 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1f974570-7488-4093-92c0-25387c7295d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:18.307723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1135/2267] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:18.311991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e3cec-ad72-4fa4-a3d3-557bc52d4895 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:18.322331 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e3cec-ad72-4fa4-a3d3-557bc52d4895 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:18.330420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59117599-d463-435c-a892-6ab01a27da37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:18.330420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59117599-d463-435c-a892-6ab01a27da37 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:18.330420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59117599-d463-435c-a892-6ab01a27da37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:18.330420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59117599-d463-435c-a892-6ab01a27da37 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:18.330907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59117599-d463-435c-a892-6ab01a27da37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:58:18.330907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59117599-d463-435c-a892-6ab01a27da37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:18.331476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59117599-d463-435c-a892-6ab01a27da37 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:18.344336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1133/2268] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:58:18.349014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f974570-7488-4093-92c0-25387c7295d4 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:18.358388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f974570-7488-4093-92c0-25387c7295d4 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:18.363125 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf60b67-a39c-4f5c-bdb1-b8749b412595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:18.363724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf60b67-a39c-4f5c-bdb1-b8749b412595 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:18.364006 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf60b67-a39c-4f5c-bdb1-b8749b412595 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:18.364282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf60b67-a39c-4f5c-bdb1-b8749b412595 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:18.364906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf60b67-a39c-4f5c-bdb1-b8749b412595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:18.366838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf60b67-a39c-4f5c-bdb1-b8749b412595 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:18.453570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1136/2269] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:58:18 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:18.458508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59117599-d463-435c-a892-6ab01a27da37 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:18.469037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59117599-d463-435c-a892-6ab01a27da37 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:18.527289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573effc-910d-4098-a6c0-fceb030583ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:18.527828 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573effc-910d-4098-a6c0-fceb030583ca admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:18.528165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573effc-910d-4098-a6c0-fceb030583ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:18.528450 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573effc-910d-4098-a6c0-fceb030583ca admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:18.529108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573effc-910d-4098-a6c0-fceb030583ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:18.531126 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573effc-910d-4098-a6c0-fceb030583ca admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:18.647455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1134/2270] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:58:18 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:18.651765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf60b67-a39c-4f5c-bdb1-b8749b412595 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:18.661841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf60b67-a39c-4f5c-bdb1-b8749b412595 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:18.666527 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8104d1d-78c0-467d-9336-fa1930c18842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:18.667178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104d1d-78c0-467d-9336-fa1930c18842 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:18.667462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104d1d-78c0-467d-9336-fa1930c18842 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:18.673613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104d1d-78c0-467d-9336-fa1930c18842 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:18.673613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8104d1d-78c0-467d-9336-fa1930c18842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:18.673613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8104d1d-78c0-467d-9336-fa1930c18842 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:18.681240 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1137/2271] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:18.685527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573effc-910d-4098-a6c0-fceb030583ca admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:18.697741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573effc-910d-4098-a6c0-fceb030583ca admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:18.702603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d3294-ca06-447a-aa63-032ab5e09e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:18.703233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d3294-ca06-447a-aa63-032ab5e09e28 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:18.703509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d3294-ca06-447a-aa63-032ab5e09e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:18.703777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d3294-ca06-447a-aa63-032ab5e09e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:18.704442 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d3294-ca06-447a-aa63-032ab5e09e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:18.706019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d3294-ca06-447a-aa63-032ab5e09e28 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:18.721751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1135/2272] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:18.723544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8104d1d-78c0-467d-9336-fa1930c18842 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:18.734560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8104d1d-78c0-467d-9336-fa1930c18842 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:18.742127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995d779-f952-4d99-b291-688544e8a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:18.742871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995d779-f952-4d99-b291-688544e8a693 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:18.743174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995d779-f952-4d99-b291-688544e8a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:18.743445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995d779-f952-4d99-b291-688544e8a693 admin admin] PATH_INFO: `/v3/projects/e572e76ceb884d81b98a73de6c44b463/users/059c638d7e00420b866b143378cb7dea/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:18.759959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995d779-f952-4d99-b291-688544e8a693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e572e76ceb884d81b98a73de6c44b463, user_id=059c638d7e00420b866b143378cb7dea, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:18.762754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995d779-f952-4d99-b291-688544e8a693 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:18.837321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1138/2273] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:18 2022] PUT /identity/v3/projects/e572e76ceb884d81b98a73de6c44b463/users/059c638d7e00420b866b143378cb7dea/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:18.848194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89bf7e-8e86-4b55-97e3-6e818c038038 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:18.848482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89bf7e-8e86-4b55-97e3-6e818c038038 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:18.848764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89bf7e-8e86-4b55-97e3-6e818c038038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:18.878496 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-ce89bf7e-8e86-4b55-97e3-6e818c038038 None None] MFA Rules not processed for user `059c638d7e00420b866b143378cb7dea`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:18.880063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ce89bf7e-8e86-4b55-97e3-6e818c038038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:18.913291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:18.954618 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1136/2274] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:18.959744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995d779-f952-4d99-b291-688544e8a693 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:19.025364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995d779-f952-4d99-b291-688544e8a693 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:19.030152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bd71d-e839-4319-99ff-0299221b5e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:19.030763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bd71d-e839-4319-99ff-0299221b5e3a admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:19.031141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bd71d-e839-4319-99ff-0299221b5e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:19.031424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bd71d-e839-4319-99ff-0299221b5e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:19.032588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bd71d-e839-4319-99ff-0299221b5e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:19.034532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bd71d-e839-4319-99ff-0299221b5e3a admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:19.122922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1139/2275] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:58:18 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:19.130444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89bf7e-8e86-4b55-97e3-6e818c038038 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:19.141204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89bf7e-8e86-4b55-97e3-6e818c038038 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:19.201548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc7e12-cd13-4bf9-9e42-bc4ceebee30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:19.202244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc7e12-cd13-4bf9-9e42-bc4ceebee30f admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:19.202454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc7e12-cd13-4bf9-9e42-bc4ceebee30f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:19.202680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc7e12-cd13-4bf9-9e42-bc4ceebee30f admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:19.203344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc7e12-cd13-4bf9-9e42-bc4ceebee30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:19.205261 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc7e12-cd13-4bf9-9e42-bc4ceebee30f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:19.316787 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1137/2276] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:58:19 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:19.320533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bd71d-e839-4319-99ff-0299221b5e3a admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:19.335460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bd71d-e839-4319-99ff-0299221b5e3a admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:19.340899 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1175d99-b08f-4c53-a4da-e0701ffdcb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:19.341550 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1175d99-b08f-4c53-a4da-e0701ffdcb19 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:19.341831 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1175d99-b08f-4c53-a4da-e0701ffdcb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:19.342106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1175d99-b08f-4c53-a4da-e0701ffdcb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:19.342788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1175d99-b08f-4c53-a4da-e0701ffdcb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:19.344455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1175d99-b08f-4c53-a4da-e0701ffdcb19 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:19.357402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1140/2277] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:19.362121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc7e12-cd13-4bf9-9e42-bc4ceebee30f admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:19.372445 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc7e12-cd13-4bf9-9e42-bc4ceebee30f admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:19.377202 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f09a06-a3dc-45bb-945e-4382ff38fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:19.377858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f09a06-a3dc-45bb-945e-4382ff38fad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:19.378134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f09a06-a3dc-45bb-945e-4382ff38fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:19.378403 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f09a06-a3dc-45bb-945e-4382ff38fad3 admin admin] PATH_INFO: `/v3/projects/efe9117e012944b3a943f54d3d61fb17/users/738ca33be54241bf929aabc2c8ce1504/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:19.397347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f09a06-a3dc-45bb-945e-4382ff38fad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe9117e012944b3a943f54d3d61fb17, user_id=738ca33be54241bf929aabc2c8ce1504, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:19.400092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f09a06-a3dc-45bb-945e-4382ff38fad3 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:19.461231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1138/2278] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:19 2022] PUT /identity/v3/projects/efe9117e012944b3a943f54d3d61fb17/users/738ca33be54241bf929aabc2c8ce1504/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:19.465377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1175d99-b08f-4c53-a4da-e0701ffdcb19 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:19.476720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1175d99-b08f-4c53-a4da-e0701ffdcb19 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:19.528628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:19.549012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f26ba-2fa4-49bc-a5ef-b0a738b08903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:19.549544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f26ba-2fa4-49bc-a5ef-b0a738b08903 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:19.549827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f26ba-2fa4-49bc-a5ef-b0a738b08903 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:19.550104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f26ba-2fa4-49bc-a5ef-b0a738b08903 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:19.550781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f26ba-2fa4-49bc-a5ef-b0a738b08903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:19.552443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f26ba-2fa4-49bc-a5ef-b0a738b08903 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:19.562509 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1141/2279] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:58:19.566641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f09a06-a3dc-45bb-945e-4382ff38fad3 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:19.577882 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f09a06-a3dc-45bb-945e-4382ff38fad3 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:19.583280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c9149-07b5-4c87-985b-9ee060b26a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:19.584208 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9149-07b5-4c87-985b-9ee060b26a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:19.584489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9149-07b5-4c87-985b-9ee060b26a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:19.584764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9149-07b5-4c87-985b-9ee060b26a1b admin admin] PATH_INFO: `/v3/projects/efe9117e012944b3a943f54d3d61fb17/users/738ca33be54241bf929aabc2c8ce1504/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:19.586700 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c9149-07b5-4c87-985b-9ee060b26a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe9117e012944b3a943f54d3d61fb17, user_id=738ca33be54241bf929aabc2c8ce1504, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:19.589409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c9149-07b5-4c87-985b-9ee060b26a1b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:19.601217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1139/2280] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:19 2022] PUT /identity/v3/projects/efe9117e012944b3a943f54d3d61fb17/users/738ca33be54241bf929aabc2c8ce1504/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:19.612137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005b123-36cc-4843-9779-a835e846c3fc None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:19.612445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005b123-36cc-4843-9779-a835e846c3fc None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:19.612720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005b123-36cc-4843-9779-a835e846c3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:19.642841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-8005b123-36cc-4843-9779-a835e846c3fc None None] MFA Rules not processed for user `738ca33be54241bf929aabc2c8ce1504`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:19.644124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8005b123-36cc-4843-9779-a835e846c3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:19.717401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1142/2281] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:19.732376 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c9149-07b5-4c87-985b-9ee060b26a1b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:19.734132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-978c9149-07b5-4c87-985b-9ee060b26a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:19.794231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c9149-07b5-4c87-985b-9ee060b26a1b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:19.798058 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ca9db-eb5a-4d08-aa3f-ab426e7aa549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:19.798655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ca9db-eb5a-4d08-aa3f-ab426e7aa549 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:19.799144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ca9db-eb5a-4d08-aa3f-ab426e7aa549 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:19.799383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ca9db-eb5a-4d08-aa3f-ab426e7aa549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:19.834646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:19.859327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ca9db-eb5a-4d08-aa3f-ab426e7aa549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:19.860805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ca9db-eb5a-4d08-aa3f-ab426e7aa549 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:19.869902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1140/2282] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:21.646589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005b123-36cc-4843-9779-a835e846c3fc None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:21.647948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8005b123-36cc-4843-9779-a835e846c3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:21.659511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005b123-36cc-4843-9779-a835e846c3fc None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:21.663161 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd8a4c-50fe-4edf-9012-c45f96c8a0b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:21.663787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd8a4c-50fe-4edf-9012-c45f96c8a0b1 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:21.664046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd8a4c-50fe-4edf-9012-c45f96c8a0b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:21.664317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd8a4c-50fe-4edf-9012-c45f96c8a0b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:21.674118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd8a4c-50fe-4edf-9012-c45f96c8a0b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:21.675577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd8a4c-50fe-4edf-9012-c45f96c8a0b1 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:21.684825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1143/2283] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:26.125939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ca9db-eb5a-4d08-aa3f-ab426e7aa549 service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:26.224170 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ca9db-eb5a-4d08-aa3f-ab426e7aa549 service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:26.230316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:26.231003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:26.231285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:26.231558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] PATH_INFO: `/v3/users/059c638d7e00420b866b143378cb7dea` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:26.232710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=059c638d7e00420b866b143378cb7dea)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:26.234719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:26.928411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059c638d7e00420b866b143378cb7dea'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:27.069622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059c638d7e00420b866b143378cb7dea'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:27.078668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059c638d7e00420b866b143378cb7dea'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:27.083351 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059c638d7e00420b866b143378cb7dea'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:27.122093 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059c638d7e00420b866b143378cb7dea'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:27.134719 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd19bd-36d7-4427-aa60-94eb1eedd7d2 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:27.135287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd19bd-36d7-4427-aa60-94eb1eedd7d2 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:27.135287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd19bd-36d7-4427-aa60-94eb1eedd7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:27.138737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1141/2284] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:26 2022] DELETE /identity/v3/users/059c638d7e00420b866b143378cb7dea => generated 0 bytes in 1005 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:27.158235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-59bd19bd-36d7-4427-aa60-94eb1eedd7d2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:27.159338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-59bd19bd-36d7-4427-aa60-94eb1eedd7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:27.238386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1144/2285] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:27.248413 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:27.251343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:27.318121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194fde4-381d-4d7b-873d-385eff7add42 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:27.321792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d492bf0-4019-41ad-b241-8a8a903f0dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:27.322416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d492bf0-4019-41ad-b241-8a8a903f0dad service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:27.322735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d492bf0-4019-41ad-b241-8a8a903f0dad service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:27.323495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d492bf0-4019-41ad-b241-8a8a903f0dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:27.331420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:27.334235 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d492bf0-4019-41ad-b241-8a8a903f0dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:27.335745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d492bf0-4019-41ad-b241-8a8a903f0dad service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:27.345865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1142/2286] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:27.751589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd19bd-36d7-4427-aa60-94eb1eedd7d2 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:27.753535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-59bd19bd-36d7-4427-aa60-94eb1eedd7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:27.766250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd19bd-36d7-4427-aa60-94eb1eedd7d2 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:27.771791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:27.772450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:27.772736 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:27.773019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] PATH_INFO: `/v3/projects/e572e76ceb884d81b98a73de6c44b463` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:27.774294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e572e76ceb884d81b98a73de6c44b463)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:27.780631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:27.848587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dea9bf-3f75-4a21-bb79-10d3aed8edd4 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:27.849018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dea9bf-3f75-4a21-bb79-10d3aed8edd4 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:27.849115 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dea9bf-3f75-4a21-bb79-10d3aed8edd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:27.869177 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a5dea9bf-3f75-4a21-bb79-10d3aed8edd4 None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:27.870389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a5dea9bf-3f75-4a21-bb79-10d3aed8edd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:27.922023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:27.935454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1143/2287] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Aug 29 23:58:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:27.935774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e572e76ceb884d81b98a73de6c44b463', 'request_id': 'req-1254dd42-440e-4487-b0b9-a7abb183e97e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:27.945898 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e572e76ceb884d81b98a73de6c44b463', 'request_id': 'req-1254dd42-440e-4487-b0b9-a7abb183e97e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:27.948169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dea9bf-3f75-4a21-bb79-10d3aed8edd4 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:27.949583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a5dea9bf-3f75-4a21-bb79-10d3aed8edd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:28.023978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dea9bf-3f75-4a21-bb79-10d3aed8edd4 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:28.045466 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e572e76ceb884d81b98a73de6c44b463', 'request_id': 'req-1254dd42-440e-4487-b0b9-a7abb183e97e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:28.061082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] The token cache is being invalidate because project e572e76ceb884d81b98a73de6c44b463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:28.061886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:28.062842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:28.064454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1145/2288] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:27 2022] DELETE /identity/v3/projects/e572e76ceb884d81b98a73de6c44b463 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:28.068322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:28.069866 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:28.101435 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed2391-284a-4d88-b1cc-d34b9a7f60d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:28.102060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed2391-284a-4d88-b1cc-d34b9a7f60d3 service swift] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:28.102342 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed2391-284a-4d88-b1cc-d34b9a7f60d3 service swift] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:28.102622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed2391-284a-4d88-b1cc-d34b9a7f60d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:28.122904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b4ed2391-284a-4d88-b1cc-d34b9a7f60d3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:28.147163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254dd42-440e-4487-b0b9-a7abb183e97e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:28.153105 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979c72c-cd30-49fd-8b6b-cad7d039a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:28.153737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979c72c-cd30-49fd-8b6b-cad7d039a3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:28.154016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979c72c-cd30-49fd-8b6b-cad7d039a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:28.154284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979c72c-cd30-49fd-8b6b-cad7d039a3d3 admin admin] PATH_INFO: `/v3/users/738ca33be54241bf929aabc2c8ce1504` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:28.155547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979c72c-cd30-49fd-8b6b-cad7d039a3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=738ca33be54241bf929aabc2c8ce1504)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:28.157460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979c72c-cd30-49fd-8b6b-cad7d039a3d3 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:28.165275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:28.180535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed2391-284a-4d88-b1cc-d34b9a7f60d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:28.182250 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed2391-284a-4d88-b1cc-d34b9a7f60d3 service swift] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:28.191065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1144/2289] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Aug 29 23:58:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:58:28.397905 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f979c72c-cd30-49fd-8b6b-cad7d039a3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738ca33be54241bf929aabc2c8ce1504'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:28.457349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f979c72c-cd30-49fd-8b6b-cad7d039a3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738ca33be54241bf929aabc2c8ce1504'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:28.468537 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f979c72c-cd30-49fd-8b6b-cad7d039a3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738ca33be54241bf929aabc2c8ce1504'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:28.469388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f979c72c-cd30-49fd-8b6b-cad7d039a3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738ca33be54241bf929aabc2c8ce1504'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:28.470035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f979c72c-cd30-49fd-8b6b-cad7d039a3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738ca33be54241bf929aabc2c8ce1504'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:28.565993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1146/2290] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:28 2022] DELETE /identity/v3/users/738ca33be54241bf929aabc2c8ce1504 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:58:29.124525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed2391-284a-4d88-b1cc-d34b9a7f60d3 service swift] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:29.141558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed2391-284a-4d88-b1cc-d34b9a7f60d3 service swift] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:29.253047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f32ac0-d128-4a78-9ded-7a111de29cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:29.254569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f32ac0-d128-4a78-9ded-7a111de29cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:29.255141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f32ac0-d128-4a78-9ded-7a111de29cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:29.255624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f32ac0-d128-4a78-9ded-7a111de29cb7 admin admin] PATH_INFO: `/v3/projects/efe9117e012944b3a943f54d3d61fb17` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:29.258388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f32ac0-d128-4a78-9ded-7a111de29cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe9117e012944b3a943f54d3d61fb17)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:29.260540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f32ac0-d128-4a78-9ded-7a111de29cb7 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:29.451439 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-68f32ac0-d128-4a78-9ded-7a111de29cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe9117e012944b3a943f54d3d61fb17', 'request_id': 'req-68f32ac0-d128-4a78-9ded-7a111de29cb7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:29.461122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-68f32ac0-d128-4a78-9ded-7a111de29cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe9117e012944b3a943f54d3d61fb17', 'request_id': 'req-68f32ac0-d128-4a78-9ded-7a111de29cb7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:29.468812 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-68f32ac0-d128-4a78-9ded-7a111de29cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe9117e012944b3a943f54d3d61fb17', 'request_id': 'req-68f32ac0-d128-4a78-9ded-7a111de29cb7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:29.555448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-68f32ac0-d128-4a78-9ded-7a111de29cb7 admin admin] The token cache is being invalidate because project efe9117e012944b3a943f54d3d61fb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:29.556103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-68f32ac0-d128-4a78-9ded-7a111de29cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:29.557049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-68f32ac0-d128-4a78-9ded-7a111de29cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:29.558967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1145/2291] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:29 2022] DELETE /identity/v3/projects/efe9117e012944b3a943f54d3d61fb17 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:29.566863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a2c45-4761-4368-9cf9-e86244d7eaf8 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:29.566863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a2c45-4761-4368-9cf9-e86244d7eaf8 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:29.566863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a2c45-4761-4368-9cf9-e86244d7eaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:29.587460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-202a2c45-4761-4368-9cf9-e86244d7eaf8 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:29.589116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-202a2c45-4761-4368-9cf9-e86244d7eaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:29.663733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:29.684046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1147/2292] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:29.697308 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25c8bf-ab45-4479-acb2-025ca64cfbb2 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:29.698108 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25c8bf-ab45-4479-acb2-025ca64cfbb2 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:29.698568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25c8bf-ab45-4479-acb2-025ca64cfbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:29.725470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4f25c8bf-ab45-4479-acb2-025ca64cfbb2 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:29.726794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4f25c8bf-ab45-4479-acb2-025ca64cfbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:29.746859 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a2c45-4761-4368-9cf9-e86244d7eaf8 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:29.755216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1146/2293] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:29.759475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a2c45-4761-4368-9cf9-e86244d7eaf8 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:29.766537 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce684b-456f-45fd-b2c9-b4a541150d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:29.767429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce684b-456f-45fd-b2c9-b4a541150d6b admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:29.768163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce684b-456f-45fd-b2c9-b4a541150d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:29.768614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce684b-456f-45fd-b2c9-b4a541150d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:29.769437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce684b-456f-45fd-b2c9-b4a541150d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:58:29.769912 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce684b-456f-45fd-b2c9-b4a541150d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:29.771984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce684b-456f-45fd-b2c9-b4a541150d6b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:29.792871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1148/2294] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:58:29.794041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25c8bf-ab45-4479-acb2-025ca64cfbb2 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:29.810209 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25c8bf-ab45-4479-acb2-025ca64cfbb2 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:29.825006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c48af-24ab-45e7-a828-10803c60b6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:29.826068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c48af-24ab-45e7-a828-10803c60b6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:29.826504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c48af-24ab-45e7-a828-10803c60b6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:29.827003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c48af-24ab-45e7-a828-10803c60b6c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:29.827879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c48af-24ab-45e7-a828-10803c60b6c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:29.830952 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c48af-24ab-45e7-a828-10803c60b6c7 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:29.963902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1147/2295] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:58:29 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:29.968671 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce684b-456f-45fd-b2c9-b4a541150d6b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:29.980653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce684b-456f-45fd-b2c9-b4a541150d6b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:30.054491 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091de1-db2f-496b-b74f-7990f83e05aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:30.055242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091de1-db2f-496b-b74f-7990f83e05aa admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:30.055597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091de1-db2f-496b-b74f-7990f83e05aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:30.055954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091de1-db2f-496b-b74f-7990f83e05aa admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:30.056673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f091de1-db2f-496b-b74f-7990f83e05aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:30.058691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f091de1-db2f-496b-b74f-7990f83e05aa admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:30.190248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1149/2296] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:58:29 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:30.191299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c48af-24ab-45e7-a828-10803c60b6c7 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:30.222872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c48af-24ab-45e7-a828-10803c60b6c7 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:30.238475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc80c41-3c2d-450e-a366-e4d41e4c8c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:30.243940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc80c41-3c2d-450e-a366-e4d41e4c8c9a admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:30.243940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc80c41-3c2d-450e-a366-e4d41e4c8c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:30.243940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc80c41-3c2d-450e-a366-e4d41e4c8c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:30.243940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc80c41-3c2d-450e-a366-e4d41e4c8c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:30.243940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc80c41-3c2d-450e-a366-e4d41e4c8c9a admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:30.275139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1148/2297] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:58:30.279768 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091de1-db2f-496b-b74f-7990f83e05aa admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:30.298135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091de1-db2f-496b-b74f-7990f83e05aa admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:30.308963 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113ebd8-6a5a-4d91-8898-fbb079bf3b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:30.310086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113ebd8-6a5a-4d91-8898-fbb079bf3b35 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:30.310437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113ebd8-6a5a-4d91-8898-fbb079bf3b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:30.310829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113ebd8-6a5a-4d91-8898-fbb079bf3b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:30.314270 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113ebd8-6a5a-4d91-8898-fbb079bf3b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:30.320508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113ebd8-6a5a-4d91-8898-fbb079bf3b35 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:30.349212 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1150/2298] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:30.350194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc80c41-3c2d-450e-a366-e4d41e4c8c9a admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:30.374044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc80c41-3c2d-450e-a366-e4d41e4c8c9a admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:30.386397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c886c6-1431-4765-936a-47b9bf3ab131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:30.387996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c886c6-1431-4765-936a-47b9bf3ab131 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:30.402988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c886c6-1431-4765-936a-47b9bf3ab131 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:30.403900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c886c6-1431-4765-936a-47b9bf3ab131 admin admin] PATH_INFO: `/v3/projects/559fc04a60e4427cb3d936b51cb7d66a/users/4fc35b6301ee4fccb57ba85a97967654/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:30.459452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c886c6-1431-4765-936a-47b9bf3ab131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559fc04a60e4427cb3d936b51cb7d66a, user_id=4fc35b6301ee4fccb57ba85a97967654, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:30.463523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c886c6-1431-4765-936a-47b9bf3ab131 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:30.758187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1149/2299] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:30 2022] PUT /identity/v3/projects/559fc04a60e4427cb3d936b51cb7d66a/users/4fc35b6301ee4fccb57ba85a97967654/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:58:30.768324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd15a01-9f3b-4925-9d09-4518550cc299 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:30.768877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd15a01-9f3b-4925-9d09-4518550cc299 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:30.768877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd15a01-9f3b-4925-9d09-4518550cc299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:30.802577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-6fd15a01-9f3b-4925-9d09-4518550cc299 None None] MFA Rules not processed for user `4fc35b6301ee4fccb57ba85a97967654`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:30.803873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6fd15a01-9f3b-4925-9d09-4518550cc299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:30.893704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1151/2300] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:30.899316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c886c6-1431-4765-936a-47b9bf3ab131 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:30.918834 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:31.014409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c886c6-1431-4765-936a-47b9bf3ab131 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:31.025820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d694a-26a3-4d2d-b411-73f0615ae02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:31.027396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d694a-26a3-4d2d-b411-73f0615ae02e admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:31.027396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d694a-26a3-4d2d-b411-73f0615ae02e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:31.027396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d694a-26a3-4d2d-b411-73f0615ae02e admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:31.027963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d694a-26a3-4d2d-b411-73f0615ae02e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:31.029931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d694a-26a3-4d2d-b411-73f0615ae02e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:31.144317 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1150/2301] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:58:30 2022] POST /identity/v3/projects => generated 387 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:31.147336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd15a01-9f3b-4925-9d09-4518550cc299 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:31.157665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd15a01-9f3b-4925-9d09-4518550cc299 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:31.244943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:31.261074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0651c4-19c9-4145-acec-73076ff174de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:31.261837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0651c4-19c9-4145-acec-73076ff174de admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:31.262260 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0651c4-19c9-4145-acec-73076ff174de admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:31.262637 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0651c4-19c9-4145-acec-73076ff174de admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:31.263535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0651c4-19c9-4145-acec-73076ff174de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:31.265803 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0651c4-19c9-4145-acec-73076ff174de admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:31.391729 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1152/2302] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:58:31 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:58:31.396229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d694a-26a3-4d2d-b411-73f0615ae02e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:31.409354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d694a-26a3-4d2d-b411-73f0615ae02e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:31.414695 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf0620-2c45-40ed-a98b-3e7380c9005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:31.416280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0620-2c45-40ed-a98b-3e7380c9005c admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:31.416280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0620-2c45-40ed-a98b-3e7380c9005c admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:31.416280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0620-2c45-40ed-a98b-3e7380c9005c admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:31.417000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf0620-2c45-40ed-a98b-3e7380c9005c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:31.418910 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf0620-2c45-40ed-a98b-3e7380c9005c admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:31.434700 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1151/2303] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:58:31.439375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0651c4-19c9-4145-acec-73076ff174de admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:31.464259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0651c4-19c9-4145-acec-73076ff174de admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:31.471516 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c576c7-31b8-4229-aea2-b022b118acda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:31.472197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c576c7-31b8-4229-aea2-b022b118acda admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:31.472478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c576c7-31b8-4229-aea2-b022b118acda admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:31.472751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c576c7-31b8-4229-aea2-b022b118acda admin admin] PATH_INFO: `/v3/projects/ac85fd7f144a43979915e113f569ce30/users/cce58d7d8ebd482581740ed6acd5504e/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:31.493475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c576c7-31b8-4229-aea2-b022b118acda admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac85fd7f144a43979915e113f569ce30, user_id=cce58d7d8ebd482581740ed6acd5504e, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:31.496234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c576c7-31b8-4229-aea2-b022b118acda admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:31.585037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1153/2304] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:31 2022] PUT /identity/v3/projects/ac85fd7f144a43979915e113f569ce30/users/cce58d7d8ebd482581740ed6acd5504e/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:31.589121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf0620-2c45-40ed-a98b-3e7380c9005c admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:31.599342 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf0620-2c45-40ed-a98b-3e7380c9005c admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:31.689096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce3533-a1ab-4dce-bd63-f00ca446af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:31.690279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce3533-a1ab-4dce-bd63-f00ca446af46 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:31.690647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce3533-a1ab-4dce-bd63-f00ca446af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:31.691115 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce3533-a1ab-4dce-bd63-f00ca446af46 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:31.691801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce3533-a1ab-4dce-bd63-f00ca446af46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:31.693506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce3533-a1ab-4dce-bd63-f00ca446af46 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:31.704505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1152/2305] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:31.709247 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c576c7-31b8-4229-aea2-b022b118acda admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:31.720353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c576c7-31b8-4229-aea2-b022b118acda admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:31.727771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943a949-1306-419f-8b3a-8b18d620b618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:31.728701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943a949-1306-419f-8b3a-8b18d620b618 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:31.729044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943a949-1306-419f-8b3a-8b18d620b618 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:31.729387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943a949-1306-419f-8b3a-8b18d620b618 admin admin] PATH_INFO: `/v3/projects/ac85fd7f144a43979915e113f569ce30/users/cce58d7d8ebd482581740ed6acd5504e/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:31.732907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943a949-1306-419f-8b3a-8b18d620b618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac85fd7f144a43979915e113f569ce30, user_id=cce58d7d8ebd482581740ed6acd5504e, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:31.735930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943a949-1306-419f-8b3a-8b18d620b618 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:31.751371 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1154/2306] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:31 2022] PUT /identity/v3/projects/ac85fd7f144a43979915e113f569ce30/users/cce58d7d8ebd482581740ed6acd5504e/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:31.764059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718edb5-c140-44a2-866d-095935b3b162 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:31.764349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718edb5-c140-44a2-866d-095935b3b162 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:31.764622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718edb5-c140-44a2-866d-095935b3b162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:31.796276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a718edb5-c140-44a2-866d-095935b3b162 None None] MFA Rules not processed for user `cce58d7d8ebd482581740ed6acd5504e`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:31.874011 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a718edb5-c140-44a2-866d-095935b3b162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:31.957881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1153/2307] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:31.972008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943a949-1306-419f-8b3a-8b18d620b618 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:31.973745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b943a949-1306-419f-8b3a-8b18d620b618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:32.043036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943a949-1306-419f-8b3a-8b18d620b618 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:32.046835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54173ebe-9381-4b5b-97ac-73be316871fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:32.047473 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54173ebe-9381-4b5b-97ac-73be316871fc service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:32.047751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54173ebe-9381-4b5b-97ac-73be316871fc service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:32.048024 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54173ebe-9381-4b5b-97ac-73be316871fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:32.058486 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54173ebe-9381-4b5b-97ac-73be316871fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:32.059989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54173ebe-9381-4b5b-97ac-73be316871fc service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:32.071972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1155/2308] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:32.138454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718edb5-c140-44a2-866d-095935b3b162 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:32.148627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:32.211168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718edb5-c140-44a2-866d-095935b3b162 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:32.216066 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:32.218719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:32.218719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:32.218719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] PATH_INFO: `/v3/users/4fc35b6301ee4fccb57ba85a97967654` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:32.218719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc35b6301ee4fccb57ba85a97967654)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:32.221743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:32.421114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc35b6301ee4fccb57ba85a97967654'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:32.515121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc35b6301ee4fccb57ba85a97967654'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:32.524628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc35b6301ee4fccb57ba85a97967654'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:32.525427 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc35b6301ee4fccb57ba85a97967654'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:32.539882 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc35b6301ee4fccb57ba85a97967654'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:32.546723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1154/2309] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:32 2022] DELETE /identity/v3/users/4fc35b6301ee4fccb57ba85a97967654 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:58:32.552762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60b2d6-d225-4e54-a7a7-a7f85bb9a234 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:32.552762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60b2d6-d225-4e54-a7a7-a7f85bb9a234 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:32.552762 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60b2d6-d225-4e54-a7a7-a7f85bb9a234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:32.576168 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-bd60b2d6-d225-4e54-a7a7-a7f85bb9a234 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:32.581466 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bd60b2d6-d225-4e54-a7a7-a7f85bb9a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:32.648809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1156/2310] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:32.659327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:32.661140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:32.745652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1862ec-f9d7-40f5-bd3b-ab37cff20126 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:32.749690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749a3e-9ba2-4245-9b92-c6fe8d1ac7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:32.750401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749a3e-9ba2-4245-9b92-c6fe8d1ac7bd service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:32.750810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749a3e-9ba2-4245-9b92-c6fe8d1ac7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:32.751213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749a3e-9ba2-4245-9b92-c6fe8d1ac7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:32.763032 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f749a3e-9ba2-4245-9b92-c6fe8d1ac7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:32.764619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f749a3e-9ba2-4245-9b92-c6fe8d1ac7bd service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:32.786475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1155/2311] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:33.437195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60b2d6-d225-4e54-a7a7-a7f85bb9a234 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:33.439721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bd60b2d6-d225-4e54-a7a7-a7f85bb9a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:33.483953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60b2d6-d225-4e54-a7a7-a7f85bb9a234 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:33.501262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:33.501262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:33.501262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:33.501262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] PATH_INFO: `/v3/projects/559fc04a60e4427cb3d936b51cb7d66a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:33.502549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559fc04a60e4427cb3d936b51cb7d66a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:33.504675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:33.722266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:33.749352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559fc04a60e4427cb3d936b51cb7d66a', 'request_id': 'req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:33.761685 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559fc04a60e4427cb3d936b51cb7d66a', 'request_id': 'req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:33.854695 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559fc04a60e4427cb3d936b51cb7d66a', 'request_id': 'req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:33.878952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] The token cache is being invalidate because project 559fc04a60e4427cb3d936b51cb7d66a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:33.879507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:33.881913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:33.884250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1157/2312] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:33 2022] DELETE /identity/v3/projects/559fc04a60e4427cb3d936b51cb7d66a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:33.890480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749a3e-9ba2-4245-9b92-c6fe8d1ac7bd service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:33.902000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749a3e-9ba2-4245-9b92-c6fe8d1ac7bd service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:33.932064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:33.976084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add7245-fe69-4d73-8cd6-171c670bc212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:33.976819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add7245-fe69-4d73-8cd6-171c670bc212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:33.977152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add7245-fe69-4d73-8cd6-171c670bc212 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:33.977624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add7245-fe69-4d73-8cd6-171c670bc212 admin admin] PATH_INFO: `/v3/users/cce58d7d8ebd482581740ed6acd5504e` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:33.979758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add7245-fe69-4d73-8cd6-171c670bc212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce58d7d8ebd482581740ed6acd5504e)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:33.981753 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add7245-fe69-4d73-8cd6-171c670bc212 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:34.236173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9add7245-fe69-4d73-8cd6-171c670bc212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce58d7d8ebd482581740ed6acd5504e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:34.317880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9add7245-fe69-4d73-8cd6-171c670bc212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce58d7d8ebd482581740ed6acd5504e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:34.326902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9add7245-fe69-4d73-8cd6-171c670bc212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce58d7d8ebd482581740ed6acd5504e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:34.328346 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9add7245-fe69-4d73-8cd6-171c670bc212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce58d7d8ebd482581740ed6acd5504e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:34.364580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9add7245-fe69-4d73-8cd6-171c670bc212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce58d7d8ebd482581740ed6acd5504e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:34.374920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1156/2313] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:33 2022] DELETE /identity/v3/users/cce58d7d8ebd482581740ed6acd5504e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:34.865519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:34.871064 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:34.900200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895d3b3-b6bc-4a0c-8eea-b955deb70ed4 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:34.990198 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a4671-2540-4e87-9a87-0240085f1b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:34.990927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a4671-2540-4e87-9a87-0240085f1b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:34.991387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a4671-2540-4e87-9a87-0240085f1b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:34.991681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a4671-2540-4e87-9a87-0240085f1b63 admin admin] PATH_INFO: `/v3/projects/ac85fd7f144a43979915e113f569ce30` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:34.992865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a4671-2540-4e87-9a87-0240085f1b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac85fd7f144a43979915e113f569ce30)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:34.994985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a4671-2540-4e87-9a87-0240085f1b63 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:35.351175 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-801a4671-2540-4e87-9a87-0240085f1b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac85fd7f144a43979915e113f569ce30', 'request_id': 'req-801a4671-2540-4e87-9a87-0240085f1b63'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:35.365653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-801a4671-2540-4e87-9a87-0240085f1b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac85fd7f144a43979915e113f569ce30', 'request_id': 'req-801a4671-2540-4e87-9a87-0240085f1b63'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:35.822422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-801a4671-2540-4e87-9a87-0240085f1b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac85fd7f144a43979915e113f569ce30', 'request_id': 'req-801a4671-2540-4e87-9a87-0240085f1b63'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:35.838501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-801a4671-2540-4e87-9a87-0240085f1b63 admin admin] The token cache is being invalidate because project ac85fd7f144a43979915e113f569ce30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:35.838790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-801a4671-2540-4e87-9a87-0240085f1b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:35.839495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-801a4671-2540-4e87-9a87-0240085f1b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:35.841056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1158/2314] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:34 2022] DELETE /identity/v3/projects/ac85fd7f144a43979915e113f569ce30 => generated 0 bytes in 979 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:35.846711 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebc7db-be9b-4f9e-b393-7615c2af5f9f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:35.847324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebc7db-be9b-4f9e-b393-7615c2af5f9f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:35.847324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebc7db-be9b-4f9e-b393-7615c2af5f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:35.885667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-82ebc7db-be9b-4f9e-b393-7615c2af5f9f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:35.887350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-82ebc7db-be9b-4f9e-b393-7615c2af5f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:35.987591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1157/2315] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:35.995042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b56c-5616-4b0d-a5cb-7ef823beb037 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:35.995575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b56c-5616-4b0d-a5cb-7ef823beb037 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:35.995575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b56c-5616-4b0d-a5cb-7ef823beb037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:36.019044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a4a9b56c-5616-4b0d-a5cb-7ef823beb037 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:36.020445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a4a9b56c-5616-4b0d-a5cb-7ef823beb037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:36.030358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1159/2316] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:36.035327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebc7db-be9b-4f9e-b393-7615c2af5f9f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:36.046436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebc7db-be9b-4f9e-b393-7615c2af5f9f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:36.051437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de604913-2ba6-4a27-b99e-29e011da55e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:36.052050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de604913-2ba6-4a27-b99e-29e011da55e4 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:36.052353 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de604913-2ba6-4a27-b99e-29e011da55e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:36.052626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de604913-2ba6-4a27-b99e-29e011da55e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:36.053277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de604913-2ba6-4a27-b99e-29e011da55e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:58:36.053583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de604913-2ba6-4a27-b99e-29e011da55e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:36.055388 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de604913-2ba6-4a27-b99e-29e011da55e4 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:36.070531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1158/2317] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:58:36.074833 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b56c-5616-4b0d-a5cb-7ef823beb037 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:36.085861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b56c-5616-4b0d-a5cb-7ef823beb037 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:36.100735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339401a9-7024-4ef8-9c72-b1ddb0e57ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:36.103272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339401a9-7024-4ef8-9c72-b1ddb0e57ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:36.104895 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339401a9-7024-4ef8-9c72-b1ddb0e57ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:36.105827 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339401a9-7024-4ef8-9c72-b1ddb0e57ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:36.108949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339401a9-7024-4ef8-9c72-b1ddb0e57ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:36.112378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339401a9-7024-4ef8-9c72-b1ddb0e57ec5 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:36.238093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1160/2318] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:58:36 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:36.245868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de604913-2ba6-4a27-b99e-29e011da55e4 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:36.257414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de604913-2ba6-4a27-b99e-29e011da55e4 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:36.309700 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:36.379727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784ed2d-0bd9-4c11-9f87-b7d0c6640e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:36.380559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784ed2d-0bd9-4c11-9f87-b7d0c6640e35 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:36.380911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784ed2d-0bd9-4c11-9f87-b7d0c6640e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:36.381272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784ed2d-0bd9-4c11-9f87-b7d0c6640e35 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:36.389501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784ed2d-0bd9-4c11-9f87-b7d0c6640e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:36.390677 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784ed2d-0bd9-4c11-9f87-b7d0c6640e35 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:36.516172 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1159/2319] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:58:36 2022] POST /identity/v3/users => generated 286 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:36.517641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339401a9-7024-4ef8-9c72-b1ddb0e57ec5 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:36.532008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339401a9-7024-4ef8-9c72-b1ddb0e57ec5 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:36.538909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d15940-deab-4225-88a5-fe55ef51d2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:36.550658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d15940-deab-4225-88a5-fe55ef51d2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:36.551081 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d15940-deab-4225-88a5-fe55ef51d2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:36.551366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d15940-deab-4225-88a5-fe55ef51d2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:36.552089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d15940-deab-4225-88a5-fe55ef51d2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:36.554237 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d15940-deab-4225-88a5-fe55ef51d2d5 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:36.570193 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1161/2320] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:36.571025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784ed2d-0bd9-4c11-9f87-b7d0c6640e35 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:36.587211 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784ed2d-0bd9-4c11-9f87-b7d0c6640e35 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:36.600759 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f065a15-e6b1-4b64-840b-1a94baf65526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:36.603180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f065a15-e6b1-4b64-840b-1a94baf65526 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:36.603488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f065a15-e6b1-4b64-840b-1a94baf65526 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:36.603771 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f065a15-e6b1-4b64-840b-1a94baf65526 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:36.605404 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f065a15-e6b1-4b64-840b-1a94baf65526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:36.608203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f065a15-e6b1-4b64-840b-1a94baf65526 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:36.623734 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1160/2321] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:58:36.628649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d15940-deab-4225-88a5-fe55ef51d2d5 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:36.640443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d15940-deab-4225-88a5-fe55ef51d2d5 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:36.647934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a599-3227-46c8-98e8-9293cafc50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:36.647934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a599-3227-46c8-98e8-9293cafc50c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:36.647934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a599-3227-46c8-98e8-9293cafc50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:36.647934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a599-3227-46c8-98e8-9293cafc50c5 admin admin] PATH_INFO: `/v3/projects/a92c68bf86ae4fb7a46d60470f2ea821/users/0d3cedaad0bb4f7ea64a6af89afcc68f/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:36.678198 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998a599-3227-46c8-98e8-9293cafc50c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92c68bf86ae4fb7a46d60470f2ea821, user_id=0d3cedaad0bb4f7ea64a6af89afcc68f, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:36.681840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998a599-3227-46c8-98e8-9293cafc50c5 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:36.684722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:36.822116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1162/2322] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:36 2022] PUT /identity/v3/projects/a92c68bf86ae4fb7a46d60470f2ea821/users/0d3cedaad0bb4f7ea64a6af89afcc68f/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:36.843843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabaa14-f1c7-448b-ad32-4cb18c296b64 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:36.844047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabaa14-f1c7-448b-ad32-4cb18c296b64 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:36.845322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabaa14-f1c7-448b-ad32-4cb18c296b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:36.904131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-2cabaa14-f1c7-448b-ad32-4cb18c296b64 None None] MFA Rules not processed for user `0d3cedaad0bb4f7ea64a6af89afcc68f`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:36.906908 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2cabaa14-f1c7-448b-ad32-4cb18c296b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:36.998935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1161/2323] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:37.009022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a599-3227-46c8-98e8-9293cafc50c5 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:37.011312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e998a599-3227-46c8-98e8-9293cafc50c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:37.087316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a599-3227-46c8-98e8-9293cafc50c5 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:37.091585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967aef76-644b-42e2-9159-f7ff4c541cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:37.092308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aef76-644b-42e2-9159-f7ff4c541cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:37.092733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aef76-644b-42e2-9159-f7ff4c541cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:37.093099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aef76-644b-42e2-9159-f7ff4c541cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:37.104163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967aef76-644b-42e2-9159-f7ff4c541cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:37.105632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967aef76-644b-42e2-9159-f7ff4c541cf3 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:37.116723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1163/2324] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:37.148766 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabaa14-f1c7-448b-ad32-4cb18c296b64 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:37.238915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabaa14-f1c7-448b-ad32-4cb18c296b64 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:37.246185 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:37.248810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:37.248810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:37.248810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] PATH_INFO: `/v3/users/0d3cedaad0bb4f7ea64a6af89afcc68f` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:37.250052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3cedaad0bb4f7ea64a6af89afcc68f)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:37.252597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:37.507431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:37.510138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3cedaad0bb4f7ea64a6af89afcc68f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:37.584111 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3cedaad0bb4f7ea64a6af89afcc68f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:37.600907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3cedaad0bb4f7ea64a6af89afcc68f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:37.601806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3cedaad0bb4f7ea64a6af89afcc68f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:37.641573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3cedaad0bb4f7ea64a6af89afcc68f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:37.655304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1162/2325] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:37 2022] DELETE /identity/v3/users/0d3cedaad0bb4f7ea64a6af89afcc68f => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:37.660108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e785e-1b53-4230-a1c3-7352db5bc8e5 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:37.660490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e785e-1b53-4230-a1c3-7352db5bc8e5 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:37.660845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e785e-1b53-4230-a1c3-7352db5bc8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:37.681968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-1b5e785e-1b53-4230-a1c3-7352db5bc8e5 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:37.683390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1b5e785e-1b53-4230-a1c3-7352db5bc8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:37.777778 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1164/2326] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:58:37.790477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:37.791973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:37.817673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e785e-1b53-4230-a1c3-7352db5bc8e5 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:37.819287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1b5e785e-1b53-4230-a1c3-7352db5bc8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:37.837203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e785e-1b53-4230-a1c3-7352db5bc8e5 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:37.851688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:37.852359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:37.852648 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:37.852928 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] PATH_INFO: `/v3/users/b4b2e79a572f47c29d5ff13dcb1e46df` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:37.854177 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b2e79a572f47c29d5ff13dcb1e46df)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:37.856653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:37.899475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7e049-f012-4956-9e6c-9bb15a7965a5 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:37.904730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34d595-b7f9-4a0e-aa63-356b4605bc47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:37.905797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d595-b7f9-4a0e-aa63-356b4605bc47 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:37.906081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d595-b7f9-4a0e-aa63-356b4605bc47 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:37.906353 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d595-b7f9-4a0e-aa63-356b4605bc47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:37.919868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34d595-b7f9-4a0e-aa63-356b4605bc47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:37.921309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34d595-b7f9-4a0e-aa63-356b4605bc47 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:37.940746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1163/2327] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:38.046755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b2e79a572f47c29d5ff13dcb1e46df'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:38.074498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b2e79a572f47c29d5ff13dcb1e46df'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:38.084440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b2e79a572f47c29d5ff13dcb1e46df'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:38.088443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b2e79a572f47c29d5ff13dcb1e46df'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:38.088443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b2e79a572f47c29d5ff13dcb1e46df'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:38.171880 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1165/2328] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:37 2022] DELETE /identity/v3/users/b4b2e79a572f47c29d5ff13dcb1e46df => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:38.174104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c74b90-73d5-4188-a4e2-9e11d599a6fe None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:38.174395 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c74b90-73d5-4188-a4e2-9e11d599a6fe None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:38.174669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c74b90-73d5-4188-a4e2-9e11d599a6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:38.202529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a7c74b90-73d5-4188-a4e2-9e11d599a6fe None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:38.203925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a7c74b90-73d5-4188-a4e2-9e11d599a6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:38.314238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1164/2329] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:58:38.324498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:38.326121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:38.339308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:38.405083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee725e90-60fc-4d90-afdb-8837f7fd9464 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:38.411742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c161c-1cc8-45f8-950d-0fb042c0ac7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:38.412744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c161c-1cc8-45f8-950d-0fb042c0ac7c service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:38.413136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c161c-1cc8-45f8-950d-0fb042c0ac7c service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:38.413581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c161c-1cc8-45f8-950d-0fb042c0ac7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:38.426724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c161c-1cc8-45f8-950d-0fb042c0ac7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:38.427949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c161c-1cc8-45f8-950d-0fb042c0ac7c service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:38.442529 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1166/2330] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:38.596519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dc650-7bc1-4c62-a321-c1dd19517423 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:38.597052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dc650-7bc1-4c62-a321-c1dd19517423 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:38.597498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dc650-7bc1-4c62-a321-c1dd19517423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:38.620958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-ae9dc650-7bc1-4c62-a321-c1dd19517423 None None] MFA Rules not processed for user `3810bf4e4ea043ca9f12340498bf51c2`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:38.622422 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ae9dc650-7bc1-4c62-a321-c1dd19517423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:38.688785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1165/2331] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:38.769256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c161c-1cc8-45f8-950d-0fb042c0ac7c service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:38.769892 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a83c161c-1cc8-45f8-950d-0fb042c0ac7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:38.805588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c161c-1cc8-45f8-950d-0fb042c0ac7c service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:38.817111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff1fc1-a121-428d-a46c-8d7b93174c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:38.823395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff1fc1-a121-428d-a46c-8d7b93174c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:38.824053 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff1fc1-a121-428d-a46c-8d7b93174c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:38.824286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff1fc1-a121-428d-a46c-8d7b93174c9c admin admin] PATH_INFO: `/v3/projects/a92c68bf86ae4fb7a46d60470f2ea821` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:38.827904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff1fc1-a121-428d-a46c-8d7b93174c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92c68bf86ae4fb7a46d60470f2ea821)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:38.831434 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff1fc1-a121-428d-a46c-8d7b93174c9c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:39.031647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-abff1fc1-a121-428d-a46c-8d7b93174c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92c68bf86ae4fb7a46d60470f2ea821', 'request_id': 'req-abff1fc1-a121-428d-a46c-8d7b93174c9c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:39.046455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-abff1fc1-a121-428d-a46c-8d7b93174c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92c68bf86ae4fb7a46d60470f2ea821', 'request_id': 'req-abff1fc1-a121-428d-a46c-8d7b93174c9c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:39.117452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dc650-7bc1-4c62-a321-c1dd19517423 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:39.117942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ae9dc650-7bc1-4c62-a321-c1dd19517423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:39.142923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-abff1fc1-a121-428d-a46c-8d7b93174c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92c68bf86ae4fb7a46d60470f2ea821', 'request_id': 'req-abff1fc1-a121-428d-a46c-8d7b93174c9c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:39.150795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dc650-7bc1-4c62-a321-c1dd19517423 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:39.177201 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:39.177872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-abff1fc1-a121-428d-a46c-8d7b93174c9c admin admin] The token cache is being invalidate because project a92c68bf86ae4fb7a46d60470f2ea821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:39.178245 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-abff1fc1-a121-428d-a46c-8d7b93174c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:39.179465 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-abff1fc1-a121-428d-a46c-8d7b93174c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:39.181479 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1167/2332] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:38 2022] DELETE /identity/v3/projects/a92c68bf86ae4fb7a46d60470f2ea821 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:39.186223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b6849-da43-4f77-a708-3f94ea826771 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:39.186568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b6849-da43-4f77-a708-3f94ea826771 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:39.186894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b6849-da43-4f77-a708-3f94ea826771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:39.229334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-526b6849-da43-4f77-a708-3f94ea826771 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:39.230914 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-526b6849-da43-4f77-a708-3f94ea826771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:39.267338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1f0ae-6097-45ae-a3b3-3b1072200432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:39.267338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f0ae-6097-45ae-a3b3-3b1072200432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:39.267338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f0ae-6097-45ae-a3b3-3b1072200432 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:39.267338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f0ae-6097-45ae-a3b3-3b1072200432 admin admin] PATH_INFO: `/v3/projects/bab51c2ec987465391428078f5d1da47` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:39.267831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1f0ae-6097-45ae-a3b3-3b1072200432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab51c2ec987465391428078f5d1da47)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:39.267831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1f0ae-6097-45ae-a3b3-3b1072200432 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:39.314490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1168/2333] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:39.324180 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e574a-884b-46af-a0ee-336ea4ba60e0 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:39.324429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e574a-884b-46af-a0ee-336ea4ba60e0 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:39.324753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e574a-884b-46af-a0ee-336ea4ba60e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:39.356340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-766e574a-884b-46af-a0ee-336ea4ba60e0 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:39.357968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-766e574a-884b-46af-a0ee-336ea4ba60e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:39.367405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1169/2334] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:58:39.372108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e574a-884b-46af-a0ee-336ea4ba60e0 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:39.382329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e574a-884b-46af-a0ee-336ea4ba60e0 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:39.387692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa13a6-b2f3-41f3-896f-36e0b371c83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:39.388649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa13a6-b2f3-41f3-896f-36e0b371c83b admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:39.389030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa13a6-b2f3-41f3-896f-36e0b371c83b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:39.389377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa13a6-b2f3-41f3-896f-36e0b371c83b admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:39.390197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa13a6-b2f3-41f3-896f-36e0b371c83b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:58:39.390594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa13a6-b2f3-41f3-896f-36e0b371c83b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:39.392807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa13a6-b2f3-41f3-896f-36e0b371c83b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:39.410345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1170/2335] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:58:39.411339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa13a6-b2f3-41f3-896f-36e0b371c83b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:39.421383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa13a6-b2f3-41f3-896f-36e0b371c83b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:39.426720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c354909-6343-4c78-bb87-977f3a352fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:39.427418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c354909-6343-4c78-bb87-977f3a352fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:39.427705 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c354909-6343-4c78-bb87-977f3a352fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:39.427981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c354909-6343-4c78-bb87-977f3a352fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:39.428623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c354909-6343-4c78-bb87-977f3a352fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:39.430681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c354909-6343-4c78-bb87-977f3a352fa3 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:39.447642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:39.809343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a1b1f0ae-6097-45ae-a3b3-3b1072200432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab51c2ec987465391428078f5d1da47', 'request_id': 'req-a1b1f0ae-6097-45ae-a3b3-3b1072200432'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:39.809947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1171/2336] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:58:39 2022] POST /identity/v3/projects => generated 375 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:39.816556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a1b1f0ae-6097-45ae-a3b3-3b1072200432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab51c2ec987465391428078f5d1da47', 'request_id': 'req-a1b1f0ae-6097-45ae-a3b3-3b1072200432'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:39.818497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c354909-6343-4c78-bb87-977f3a352fa3 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:39.823407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a1b1f0ae-6097-45ae-a3b3-3b1072200432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab51c2ec987465391428078f5d1da47', 'request_id': 'req-a1b1f0ae-6097-45ae-a3b3-3b1072200432'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:39.910863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c354909-6343-4c78-bb87-977f3a352fa3 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:39.926131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fde28-d2d5-4338-9723-b6b94a0e9366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:39.929282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fde28-d2d5-4338-9723-b6b94a0e9366 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:39.929549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fde28-d2d5-4338-9723-b6b94a0e9366 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:39.929880 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fde28-d2d5-4338-9723-b6b94a0e9366 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:39.930767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fde28-d2d5-4338-9723-b6b94a0e9366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:39.932513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fde28-d2d5-4338-9723-b6b94a0e9366 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:39.983857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a1b1f0ae-6097-45ae-a3b3-3b1072200432 admin admin] The token cache is being invalidate because project bab51c2ec987465391428078f5d1da47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:39.998254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a1b1f0ae-6097-45ae-a3b3-3b1072200432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:39.998254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a1b1f0ae-6097-45ae-a3b3-3b1072200432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:40.000306 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1166/2337] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:39 2022] DELETE /identity/v3/projects/bab51c2ec987465391428078f5d1da47 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:58:40.006955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2d6d1-0e5d-4c33-9fb7-35b8445f4ff8 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.007418 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2d6d1-0e5d-4c33-9fb7-35b8445f4ff8 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.007861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2d6d1-0e5d-4c33-9fb7-35b8445f4ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.033476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-9eb2d6d1-0e5d-4c33-9fb7-35b8445f4ff8 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:40.033476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9eb2d6d1-0e5d-4c33-9fb7-35b8445f4ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:40.041695 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1167/2338] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:58:40.051555 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a1888-8623-41f4-8616-3d3e2096ec29 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.056147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a1888-8623-41f4-8616-3d3e2096ec29 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.056147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a1888-8623-41f4-8616-3d3e2096ec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.080836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-fe6a1888-8623-41f4-8616-3d3e2096ec29 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:40.082701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fe6a1888-8623-41f4-8616-3d3e2096ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:40.084046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1172/2339] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:58:39 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:58:40.087883 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fde28-d2d5-4338-9723-b6b94a0e9366 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:40.089808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-005fde28-d2d5-4338-9723-b6b94a0e9366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:40.099193 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1168/2340] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:40.112174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a1888-8623-41f4-8616-3d3e2096ec29 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:40.112844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fde28-d2d5-4338-9723-b6b94a0e9366 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:40.114138 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acf0ab-16b7-46c7-a7e3-2d5626585e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:40.115140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acf0ab-16b7-46c7-a7e3-2d5626585e72 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.115587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acf0ab-16b7-46c7-a7e3-2d5626585e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.115992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a1888-8623-41f4-8616-3d3e2096ec29 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:40.116201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acf0ab-16b7-46c7-a7e3-2d5626585e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.117162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acf0ab-16b7-46c7-a7e3-2d5626585e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:40.119167 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acf0ab-16b7-46c7-a7e3-2d5626585e72 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:40.123564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ea0a2-31a4-43ed-9fe7-614be8745680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:40.124463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ea0a2-31a4-43ed-9fe7-614be8745680 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.124886 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ea0a2-31a4-43ed-9fe7-614be8745680 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.125337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ea0a2-31a4-43ed-9fe7-614be8745680 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.126077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ea0a2-31a4-43ed-9fe7-614be8745680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:58:40.126978 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ea0a2-31a4-43ed-9fe7-614be8745680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:40.129226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ea0a2-31a4-43ed-9fe7-614be8745680 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:40.134913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1173/2341] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:40.138735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acf0ab-16b7-46c7-a7e3-2d5626585e72 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:40.157637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1169/2342] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:58:40.159304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ea0a2-31a4-43ed-9fe7-614be8745680 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:40.165087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acf0ab-16b7-46c7-a7e3-2d5626585e72 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:40.170594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d43cfd-2b57-46e4-a56c-a3695b741bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:40.170734 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ea0a2-31a4-43ed-9fe7-614be8745680 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:40.171248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d43cfd-2b57-46e4-a56c-a3695b741bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.171532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d43cfd-2b57-46e4-a56c-a3695b741bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.171811 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d43cfd-2b57-46e4-a56c-a3695b741bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.172756 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d43cfd-2b57-46e4-a56c-a3695b741bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:40.174440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d43cfd-2b57-46e4-a56c-a3695b741bd5 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:40.176529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc1875-e34c-4d46-bcd7-30c3a3607b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:40.180966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc1875-e34c-4d46-bcd7-30c3a3607b68 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.181652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc1875-e34c-4d46-bcd7-30c3a3607b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.182551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc1875-e34c-4d46-bcd7-30c3a3607b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.183247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc1875-e34c-4d46-bcd7-30c3a3607b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:40.184916 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc1875-e34c-4d46-bcd7-30c3a3607b68 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:40.192296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1174/2343] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:40.197487 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d43cfd-2b57-46e4-a56c-a3695b741bd5 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:40.211983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d43cfd-2b57-46e4-a56c-a3695b741bd5 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:40.218021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce76c2-ed67-4a33-befd-643548fe3cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:40.218698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce76c2-ed67-4a33-befd-643548fe3cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.219515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce76c2-ed67-4a33-befd-643548fe3cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.219825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce76c2-ed67-4a33-befd-643548fe3cbd admin admin] PATH_INFO: `/v3/projects/b4ddd1bd8d83434282305a0a8f0a2db9/users/58dd3dc8e5184fa484d53215c46e899e/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.238399 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce76c2-ed67-4a33-befd-643548fe3cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ddd1bd8d83434282305a0a8f0a2db9, user_id=58dd3dc8e5184fa484d53215c46e899e, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:40.241426 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce76c2-ed67-4a33-befd-643548fe3cbd admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:40.349198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1170/2344] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:58:40 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:40.350243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc1875-e34c-4d46-bcd7-30c3a3607b68 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:40.374496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1175/2345] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:40 2022] PUT /identity/v3/projects/b4ddd1bd8d83434282305a0a8f0a2db9/users/58dd3dc8e5184fa484d53215c46e899e/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:58:40.385810 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4c175-6e38-48ea-8ee1-80dc1029c90e None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.386072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4c175-6e38-48ea-8ee1-80dc1029c90e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.386343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4c175-6e38-48ea-8ee1-80dc1029c90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.420263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-76d4c175-6e38-48ea-8ee1-80dc1029c90e None None] MFA Rules not processed for user `58dd3dc8e5184fa484d53215c46e899e`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:40.421635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-76d4c175-6e38-48ea-8ee1-80dc1029c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:40.434166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:40.464197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc1875-e34c-4d46-bcd7-30c3a3607b68 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:40.513384 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1176/2346] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:40.519327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4c175-6e38-48ea-8ee1-80dc1029c90e None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:40.547847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dcb9d-d216-4717-83e1-220312dcb527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:40.548974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dcb9d-d216-4717-83e1-220312dcb527 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.549386 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dcb9d-d216-4717-83e1-220312dcb527 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.549613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dcb9d-d216-4717-83e1-220312dcb527 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.550300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336dcb9d-d216-4717-83e1-220312dcb527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:40.552262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336dcb9d-d216-4717-83e1-220312dcb527 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:40.559604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:40.607016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4c175-6e38-48ea-8ee1-80dc1029c90e None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:40.607465 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9451e4-9441-495c-a6c8-39e913696477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:40.608317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9451e4-9441-495c-a6c8-39e913696477 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.608791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9451e4-9441-495c-a6c8-39e913696477 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.609510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9451e4-9441-495c-a6c8-39e913696477 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.610291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9451e4-9441-495c-a6c8-39e913696477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:40.613355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9451e4-9441-495c-a6c8-39e913696477 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:40.730639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1171/2347] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:58:40 2022] POST /identity/v3/users => generated 291 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:40.732149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dcb9d-d216-4717-83e1-220312dcb527 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:40.745261 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dcb9d-d216-4717-83e1-220312dcb527 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:40.751113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb8142-4a80-43a3-a252-c6f101c16eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:40.751830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb8142-4a80-43a3-a252-c6f101c16eea admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.752112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb8142-4a80-43a3-a252-c6f101c16eea admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.752382 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb8142-4a80-43a3-a252-c6f101c16eea admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.753044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb8142-4a80-43a3-a252-c6f101c16eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:40.754677 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb8142-4a80-43a3-a252-c6f101c16eea admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:40.771234 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1172/2348] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:40.772086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb8142-4a80-43a3-a252-c6f101c16eea admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:40.781580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb8142-4a80-43a3-a252-c6f101c16eea admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:40.786754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf189a93-2d22-499b-92c4-39c7f0af03df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:40.787374 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf189a93-2d22-499b-92c4-39c7f0af03df admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.787653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf189a93-2d22-499b-92c4-39c7f0af03df admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.787925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf189a93-2d22-499b-92c4-39c7f0af03df admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.788547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf189a93-2d22-499b-92c4-39c7f0af03df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:40.790121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf189a93-2d22-499b-92c4-39c7f0af03df admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:40.801428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1173/2349] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:40.805507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf189a93-2d22-499b-92c4-39c7f0af03df admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:40.820486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf189a93-2d22-499b-92c4-39c7f0af03df admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:40.828506 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366f005-8a69-4bc4-aaff-9d0749c9cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:40.829192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366f005-8a69-4bc4-aaff-9d0749c9cc73 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.829500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366f005-8a69-4bc4-aaff-9d0749c9cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.829798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366f005-8a69-4bc4-aaff-9d0749c9cc73 admin admin] PATH_INFO: `/v3/projects/97b93bd4b3f64e87a22423eb9ca9c93c/users/fe2599b1dc8c426ea11049d842909fdf/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.845761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366f005-8a69-4bc4-aaff-9d0749c9cc73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b93bd4b3f64e87a22423eb9ca9c93c, user_id=fe2599b1dc8c426ea11049d842909fdf, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:40.848426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366f005-8a69-4bc4-aaff-9d0749c9cc73 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:40.855679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1177/2350] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:58:40 2022] POST /identity/v3/projects => generated 375 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:40.859711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9451e4-9441-495c-a6c8-39e913696477 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:40.912598 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1174/2351] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:40 2022] PUT /identity/v3/projects/97b93bd4b3f64e87a22423eb9ca9c93c/users/fe2599b1dc8c426ea11049d842909fdf/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:58:40.917228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c4792-3706-47ac-808b-ba78bdbe334d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.917515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c4792-3706-47ac-808b-ba78bdbe334d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.917786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c4792-3706-47ac-808b-ba78bdbe334d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.929066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9451e4-9441-495c-a6c8-39e913696477 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:40.937670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-ad8c4792-3706-47ac-808b-ba78bdbe334d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:40.938945 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ad8c4792-3706-47ac-808b-ba78bdbe334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:40.989750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff136-e2d6-4030-99b4-97a2c6a85423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:40.990378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff136-e2d6-4030-99b4-97a2c6a85423 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:40.990657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff136-e2d6-4030-99b4-97a2c6a85423 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:40.990962 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff136-e2d6-4030-99b4-97a2c6a85423 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:40.991593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bff136-e2d6-4030-99b4-97a2c6a85423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:40.993610 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bff136-e2d6-4030-99b4-97a2c6a85423 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:41.003079 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1175/2352] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:58:41.011302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c4792-3706-47ac-808b-ba78bdbe334d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:41.022126 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ad8c4792-3706-47ac-808b-ba78bdbe334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:41.069536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:41.086215 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c4792-3706-47ac-808b-ba78bdbe334d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:41.086215 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a876c18-5f8c-486f-83fe-209246ea312a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:41.086435 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a876c18-5f8c-486f-83fe-209246ea312a service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:41.086519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a876c18-5f8c-486f-83fe-209246ea312a service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:41.086785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a876c18-5f8c-486f-83fe-209246ea312a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:41.097018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a876c18-5f8c-486f-83fe-209246ea312a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:41.098438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a876c18-5f8c-486f-83fe-209246ea312a service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:41.113552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1176/2354] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:58:41.113657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1178/2354] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:58:40 2022] POST /identity/v3/users => generated 294 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:58:41.115925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a876c18-5f8c-486f-83fe-209246ea312a service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:41.125621 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a876c18-5f8c-486f-83fe-209246ea312a service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:41.130774 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4534a7-740f-4b1e-a26f-7c8f8674336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:41.131269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4534a7-740f-4b1e-a26f-7c8f8674336f admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:41.131550 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4534a7-740f-4b1e-a26f-7c8f8674336f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:41.131871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4534a7-740f-4b1e-a26f-7c8f8674336f admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:41.132631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4534a7-740f-4b1e-a26f-7c8f8674336f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:41.134170 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4534a7-740f-4b1e-a26f-7c8f8674336f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:41.145179 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1177/2355] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:41.149184 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff136-e2d6-4030-99b4-97a2c6a85423 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:41.160375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff136-e2d6-4030-99b4-97a2c6a85423 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:41.165639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0665b-ecc4-483b-88df-692f2dd89fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:41.166282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0665b-ecc4-483b-88df-692f2dd89fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:41.166559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0665b-ecc4-483b-88df-692f2dd89fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:41.166833 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0665b-ecc4-483b-88df-692f2dd89fe7 admin admin] PATH_INFO: `/v3/projects/70d70655556b4fa8b9a28138ccc98f4c/users/0424395034a54406982608fbbcfc18a4/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:41.190090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0665b-ecc4-483b-88df-692f2dd89fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d70655556b4fa8b9a28138ccc98f4c, user_id=0424395034a54406982608fbbcfc18a4, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:41.190090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0665b-ecc4-483b-88df-692f2dd89fe7 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:41.292770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1179/2356] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:41 2022] PUT /identity/v3/projects/70d70655556b4fa8b9a28138ccc98f4c/users/0424395034a54406982608fbbcfc18a4/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:41.296783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4534a7-740f-4b1e-a26f-7c8f8674336f admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:41.308624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4534a7-740f-4b1e-a26f-7c8f8674336f admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:41.368209 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde7198-d4cd-4c35-b3fa-cd0c610515e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:41.368754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde7198-d4cd-4c35-b3fa-cd0c610515e0 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:41.369037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde7198-d4cd-4c35-b3fa-cd0c610515e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:41.369312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde7198-d4cd-4c35-b3fa-cd0c610515e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:41.370017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde7198-d4cd-4c35-b3fa-cd0c610515e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:41.371659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde7198-d4cd-4c35-b3fa-cd0c610515e0 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:41.382283 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1178/2357] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:41.386716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0665b-ecc4-483b-88df-692f2dd89fe7 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:41.398597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0665b-ecc4-483b-88df-692f2dd89fe7 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:41.404588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44113ab2-bc2d-4726-8da7-1e48effcbc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:41.406339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44113ab2-bc2d-4726-8da7-1e48effcbc15 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:41.406623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44113ab2-bc2d-4726-8da7-1e48effcbc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:41.406986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44113ab2-bc2d-4726-8da7-1e48effcbc15 admin admin] PATH_INFO: `/v3/projects/70d70655556b4fa8b9a28138ccc98f4c/users/0424395034a54406982608fbbcfc18a4/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:41.410189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44113ab2-bc2d-4726-8da7-1e48effcbc15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d70655556b4fa8b9a28138ccc98f4c, user_id=0424395034a54406982608fbbcfc18a4, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:41.414252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44113ab2-bc2d-4726-8da7-1e48effcbc15 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:41.424637 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1180/2358] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:41 2022] PUT /identity/v3/projects/70d70655556b4fa8b9a28138ccc98f4c/users/0424395034a54406982608fbbcfc18a4/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:41.435216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8d3c5-9872-4596-96b0-57e410d18119 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:41.435536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8d3c5-9872-4596-96b0-57e410d18119 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:41.435796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8d3c5-9872-4596-96b0-57e410d18119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:41.465421 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-eff8d3c5-9872-4596-96b0-57e410d18119 None None] MFA Rules not processed for user `0424395034a54406982608fbbcfc18a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:41.466792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-eff8d3c5-9872-4596-96b0-57e410d18119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:41.544672 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1179/2359] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:58:41.555809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44113ab2-bc2d-4726-8da7-1e48effcbc15 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:41.557543 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-44113ab2-bc2d-4726-8da7-1e48effcbc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:41.573735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:41.627312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44113ab2-bc2d-4726-8da7-1e48effcbc15 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:41.639837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5502f-9e1d-4df9-88db-e20cd95fbd11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:41.639837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5502f-9e1d-4df9-88db-e20cd95fbd11 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:41.639837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5502f-9e1d-4df9-88db-e20cd95fbd11 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:41.639837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5502f-9e1d-4df9-88db-e20cd95fbd11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:41.705653 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5502f-9e1d-4df9-88db-e20cd95fbd11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:41.707244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5502f-9e1d-4df9-88db-e20cd95fbd11 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:41.716835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1181/2360] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:42.471659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6fe47-f925-4ba3-b2be-c6080f4b9c1b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:42.472604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6fe47-f925-4ba3-b2be-c6080f4b9c1b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:42.472933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6fe47-f925-4ba3-b2be-c6080f4b9c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:42.508017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f3d6fe47-f925-4ba3-b2be-c6080f4b9c1b None None] MFA Rules not processed for user `fe2599b1dc8c426ea11049d842909fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:42.509648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f3d6fe47-f925-4ba3-b2be-c6080f4b9c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:42.568516 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:42.591952 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1180/2361] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:58:42.613700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5502f-9e1d-4df9-88db-e20cd95fbd11 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:42.626397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5502f-9e1d-4df9-88db-e20cd95fbd11 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:42.637537 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ed847-e6d3-429e-806a-ec78c36d2b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:42.638826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ed847-e6d3-429e-806a-ec78c36d2b65 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:42.639361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ed847-e6d3-429e-806a-ec78c36d2b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:42.639996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ed847-e6d3-429e-806a-ec78c36d2b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:42.659641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ed847-e6d3-429e-806a-ec78c36d2b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:42.661076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ed847-e6d3-429e-806a-ec78c36d2b65 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:42.691298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1182/2362] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:43.482269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6fe47-f925-4ba3-b2be-c6080f4b9c1b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:43.483828 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f3d6fe47-f925-4ba3-b2be-c6080f4b9c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:43.551871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6fe47-f925-4ba3-b2be-c6080f4b9c1b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:43.556737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:43.557381 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:43.557660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:43.557932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] PATH_INFO: `/v3/users/815c86f9dc164450b13adae1fbd02875` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:43.559083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] RBAC: Authorizing `identity:delete_user(user_id=815c86f9dc164450b13adae1fbd02875)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:43.561066 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:43.762204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '815c86f9dc164450b13adae1fbd02875'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:43.863159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '815c86f9dc164450b13adae1fbd02875'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:43.870610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '815c86f9dc164450b13adae1fbd02875'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:43.873769 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '815c86f9dc164450b13adae1fbd02875'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:43.883430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '815c86f9dc164450b13adae1fbd02875'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:43.889243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1181/2363] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:43 2022] DELETE /identity/v3/users/815c86f9dc164450b13adae1fbd02875 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:43.893732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a3485-9e3e-4d7d-bf30-dcd2055f178e None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:43.894223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a3485-9e3e-4d7d-bf30-dcd2055f178e None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:43.894316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a3485-9e3e-4d7d-bf30-dcd2055f178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:43.914821 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-5e2a3485-9e3e-4d7d-bf30-dcd2055f178e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:43.916077 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5e2a3485-9e3e-4d7d-bf30-dcd2055f178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:43.980122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1183/2364] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:58:43.990626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:43.992398 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:44.049447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d3aa7-90ac-40a5-8839-6a8b586d77db admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:44.053288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073751a-996e-46dc-a5ef-1da27553f445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:44.053893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073751a-996e-46dc-a5ef-1da27553f445 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:44.054176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073751a-996e-46dc-a5ef-1da27553f445 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:44.054451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073751a-996e-46dc-a5ef-1da27553f445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:44.063764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073751a-996e-46dc-a5ef-1da27553f445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:44.065245 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073751a-996e-46dc-a5ef-1da27553f445 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:44.075420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1182/2365] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:44.592865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149d2c8-915b-47db-ba96-a3da7da056d8 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:44.593766 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149d2c8-915b-47db-ba96-a3da7da056d8 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:44.594049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149d2c8-915b-47db-ba96-a3da7da056d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:44.617066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-5149d2c8-915b-47db-ba96-a3da7da056d8 None None] MFA Rules not processed for user `fe2599b1dc8c426ea11049d842909fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:44.618500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5149d2c8-915b-47db-ba96-a3da7da056d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:44.667369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:44.681663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1184/2366] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:44.725941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073751a-996e-46dc-a5ef-1da27553f445 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:44.727703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3073751a-996e-46dc-a5ef-1da27553f445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:44.753703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073751a-996e-46dc-a5ef-1da27553f445 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:44.767931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:44.768751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:44.769126 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:44.769502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95 admin admin] PATH_INFO: `/v3/projects/df53a7eab90c4d2ca708042f543c8c5f` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:44.770814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df53a7eab90c4d2ca708042f543c8c5f)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:44.779174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:44.782382 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:44.950592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df53a7eab90c4d2ca708042f543c8c5f', 'request_id': 'req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:44.957969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df53a7eab90c4d2ca708042f543c8c5f', 'request_id': 'req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:44.966618 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df53a7eab90c4d2ca708042f543c8c5f', 'request_id': 'req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:45.010468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149d2c8-915b-47db-ba96-a3da7da056d8 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:45.013840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5149d2c8-915b-47db-ba96-a3da7da056d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:45.036310 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149d2c8-915b-47db-ba96-a3da7da056d8 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:45.065082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95 admin admin] The token cache is being invalidate because project df53a7eab90c4d2ca708042f543c8c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:45.067538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:45.067538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-ba1f8b2b-ac0e-443e-920e-7d6172bfcd95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:45.069307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1183/2367] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:44 2022] DELETE /identity/v3/projects/df53a7eab90c4d2ca708042f543c8c5f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:45.075375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fda41-4edd-4118-a3e4-4348cb3ca373 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:45.075873 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fda41-4edd-4118-a3e4-4348cb3ca373 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:45.076332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fda41-4edd-4118-a3e4-4348cb3ca373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:45.102935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5a9fda41-4edd-4118-a3e4-4348cb3ca373 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:45.104576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5a9fda41-4edd-4118-a3e4-4348cb3ca373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:45.129892 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61077980-c44f-4829-ace0-433022794da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:45.130638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61077980-c44f-4829-ace0-433022794da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:45.131019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61077980-c44f-4829-ace0-433022794da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:45.131360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61077980-c44f-4829-ace0-433022794da4 admin admin] PATH_INFO: `/v3/users/58dd3dc8e5184fa484d53215c46e899e` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:45.132575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61077980-c44f-4829-ace0-433022794da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58dd3dc8e5184fa484d53215c46e899e)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:45.134754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61077980-c44f-4829-ace0-433022794da4 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:45.228145 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1184/2368] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:45.238171 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70195a10-baf3-4cfa-8918-fd1cbe582072 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:45.238405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70195a10-baf3-4cfa-8918-fd1cbe582072 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:45.240448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70195a10-baf3-4cfa-8918-fd1cbe582072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:45.259724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-70195a10-baf3-4cfa-8918-fd1cbe582072 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:45.261082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-70195a10-baf3-4cfa-8918-fd1cbe582072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:45.269466 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1185/2369] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:58:45.274293 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70195a10-baf3-4cfa-8918-fd1cbe582072 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:45.285657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70195a10-baf3-4cfa-8918-fd1cbe582072 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:45.291033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e417021-47eb-4d8c-be5f-27c43cfe1ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:45.292152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e417021-47eb-4d8c-be5f-27c43cfe1ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:45.292152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e417021-47eb-4d8c-be5f-27c43cfe1ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:45.292359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e417021-47eb-4d8c-be5f-27c43cfe1ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:45.293019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e417021-47eb-4d8c-be5f-27c43cfe1ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:58:45.293322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e417021-47eb-4d8c-be5f-27c43cfe1ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:45.295790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e417021-47eb-4d8c-be5f-27c43cfe1ee8 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:45.313418 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1186/2370] 10.222.0.73 () {58 vars in 1153 bytes} [Mon Aug 29 23:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:58:45.318367 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e417021-47eb-4d8c-be5f-27c43cfe1ee8 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:45.329321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e417021-47eb-4d8c-be5f-27c43cfe1ee8 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:45.334345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcc909-154a-488c-837d-de22e30ace3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:45.335001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcc909-154a-488c-837d-de22e30ace3c admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:45.336019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcc909-154a-488c-837d-de22e30ace3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:45.336207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcc909-154a-488c-837d-de22e30ace3c admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:45.336806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcc909-154a-488c-837d-de22e30ace3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:45.338713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcc909-154a-488c-837d-de22e30ace3c admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:45.386919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-61077980-c44f-4829-ace0-433022794da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58dd3dc8e5184fa484d53215c46e899e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:45.411278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-61077980-c44f-4829-ace0-433022794da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58dd3dc8e5184fa484d53215c46e899e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:45.419505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-61077980-c44f-4829-ace0-433022794da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58dd3dc8e5184fa484d53215c46e899e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:45.420417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-61077980-c44f-4829-ace0-433022794da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58dd3dc8e5184fa484d53215c46e899e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:45.421487 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-61077980-c44f-4829-ace0-433022794da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58dd3dc8e5184fa484d53215c46e899e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:45.491359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1187/2371] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Aug 29 23:58:45 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:58:45.495378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcc909-154a-488c-837d-de22e30ace3c admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:45.496164 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1185/2372] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:45 2022] DELETE /identity/v3/users/58dd3dc8e5184fa484d53215c46e899e => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:45.497958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-abbcc909-154a-488c-837d-de22e30ace3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:45.500178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ff555-1b27-49b8-a003-fdfe1cbbd7b4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:45.500593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ff555-1b27-49b8-a003-fdfe1cbbd7b4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:45.500971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ff555-1b27-49b8-a003-fdfe1cbbd7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:45.562841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-823ff555-1b27-49b8-a003-fdfe1cbbd7b4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:45.568198 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-823ff555-1b27-49b8-a003-fdfe1cbbd7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:45.601563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:45.638153 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcc909-154a-488c-837d-de22e30ace3c admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:45.701202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1186/2373] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:45.769080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ff555-1b27-49b8-a003-fdfe1cbbd7b4 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:45.770421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-823ff555-1b27-49b8-a003-fdfe1cbbd7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:45.796377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5602fa6-8d08-4be7-98cf-360c77b70119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:45.797668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5602fa6-8d08-4be7-98cf-360c77b70119 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:45.798297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5602fa6-8d08-4be7-98cf-360c77b70119 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:45.798732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5602fa6-8d08-4be7-98cf-360c77b70119 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:45.799626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5602fa6-8d08-4be7-98cf-360c77b70119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:45.802424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5602fa6-8d08-4be7-98cf-360c77b70119 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:45.829820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:45.900634 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ff555-1b27-49b8-a003-fdfe1cbbd7b4 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:45.925266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30317435-1863-4817-a1db-e1a474a3eaa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:45.925407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1188/2374] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Aug 29 23:58:45 2022] POST /identity/v3/users => generated 287 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:58:45.925502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30317435-1863-4817-a1db-e1a474a3eaa8 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:45.925502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30317435-1863-4817-a1db-e1a474a3eaa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:45.925788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30317435-1863-4817-a1db-e1a474a3eaa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:45.927381 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5602fa6-8d08-4be7-98cf-360c77b70119 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:45.940517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5602fa6-8d08-4be7-98cf-360c77b70119 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:45.950825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50122-7952-4e72-8f4f-c745cde5928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:45.954968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30317435-1863-4817-a1db-e1a474a3eaa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:45.955114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50122-7952-4e72-8f4f-c745cde5928d admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:45.955114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50122-7952-4e72-8f4f-c745cde5928d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:45.955114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50122-7952-4e72-8f4f-c745cde5928d admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:45.955318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30317435-1863-4817-a1db-e1a474a3eaa8 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:45.955410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e50122-7952-4e72-8f4f-c745cde5928d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:45.957688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e50122-7952-4e72-8f4f-c745cde5928d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:45.972122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1189/2375] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:58:45.976449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50122-7952-4e72-8f4f-c745cde5928d admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:45.981528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1187/2376] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:58:45.989079 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50122-7952-4e72-8f4f-c745cde5928d admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:45.996121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffc6c9-890f-4f68-9ef1-f6c5abfe3a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:45.999717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffc6c9-890f-4f68-9ef1-f6c5abfe3a17 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:45.999717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffc6c9-890f-4f68-9ef1-f6c5abfe3a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:45.999717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffc6c9-890f-4f68-9ef1-f6c5abfe3a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:45.999717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffc6c9-890f-4f68-9ef1-f6c5abfe3a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:46.000129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffc6c9-890f-4f68-9ef1-f6c5abfe3a17 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:46.012808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1190/2377] 10.222.0.73 () {58 vars in 1122 bytes} [Mon Aug 29 23:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:58:46.018968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30317435-1863-4817-a1db-e1a474a3eaa8 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:46.038840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30317435-1863-4817-a1db-e1a474a3eaa8 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:46.048277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74421e21-9053-4123-887e-388392f4ebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:46.048966 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74421e21-9053-4123-887e-388392f4ebad admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:46.049248 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74421e21-9053-4123-887e-388392f4ebad admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:46.049523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74421e21-9053-4123-887e-388392f4ebad admin admin] PATH_INFO: `/v3/projects/f451bdb7b7d2499eae5aedcbde7d8e7e/users/f4bac28ad1294443a16bc4510a4d2fd1/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:46.066512 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74421e21-9053-4123-887e-388392f4ebad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f451bdb7b7d2499eae5aedcbde7d8e7e, user_id=f4bac28ad1294443a16bc4510a4d2fd1, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:46.069299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74421e21-9053-4123-887e-388392f4ebad admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:46.187343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1188/2378] 10.222.0.73 () {60 vars in 1483 bytes} [Mon Aug 29 23:58:46 2022] PUT /identity/v3/projects/f451bdb7b7d2499eae5aedcbde7d8e7e/users/f4bac28ad1294443a16bc4510a4d2fd1/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:46.198056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a57b27-2c55-424e-a26b-fd692fce1116 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:46.199001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a57b27-2c55-424e-a26b-fd692fce1116 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:46.199001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a57b27-2c55-424e-a26b-fd692fce1116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:46.232290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-43a57b27-2c55-424e-a26b-fd692fce1116 None None] MFA Rules not processed for user `f4bac28ad1294443a16bc4510a4d2fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:46.233615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-43a57b27-2c55-424e-a26b-fd692fce1116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:46.335950 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1191/2379] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:46.347959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74421e21-9053-4123-887e-388392f4ebad admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:46.350492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-74421e21-9053-4123-887e-388392f4ebad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:46.449713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74421e21-9053-4123-887e-388392f4ebad admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:46.453563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6d917-010e-40b7-8bb2-a774e0211298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:46.454206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6d917-010e-40b7-8bb2-a774e0211298 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:46.454498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6d917-010e-40b7-8bb2-a774e0211298 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:46.455108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6d917-010e-40b7-8bb2-a774e0211298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:46.463838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6d917-010e-40b7-8bb2-a774e0211298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:46.465363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6d917-010e-40b7-8bb2-a774e0211298 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:46.474503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1189/2380] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:58:46.500533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a57b27-2c55-424e-a26b-fd692fce1116 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:46.516256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6d917-010e-40b7-8bb2-a774e0211298 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:46.521367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-63b6d917-010e-40b7-8bb2-a774e0211298 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:46.592495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:46.605304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a57b27-2c55-424e-a26b-fd692fce1116 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:46.619468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc835d8-4dc8-4f7c-ba89-5d1d8d209b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:46.620476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc835d8-4dc8-4f7c-ba89-5d1d8d209b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:46.620835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc835d8-4dc8-4f7c-ba89-5d1d8d209b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:46.621052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc835d8-4dc8-4f7c-ba89-5d1d8d209b40 admin admin] PATH_INFO: `/v3/users/f4bac28ad1294443a16bc4510a4d2fd1` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:46.622786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc835d8-4dc8-4f7c-ba89-5d1d8d209b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4bac28ad1294443a16bc4510a4d2fd1)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:46.626095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6d917-010e-40b7-8bb2-a774e0211298 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:46.626195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc835d8-4dc8-4f7c-ba89-5d1d8d209b40 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:46.636748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:46.639004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:46.639785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:46.640217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] PATH_INFO: `/v3/projects/b4ddd1bd8d83434282305a0a8f0a2db9` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:46.642589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ddd1bd8d83434282305a0a8f0a2db9)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:46.645733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:46.900006 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:46.907535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ddd1bd8d83434282305a0a8f0a2db9', 'request_id': 'req-6107281a-034b-4d74-bdad-254e97fc9c8e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:46.915210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4bc835d8-4dc8-4f7c-ba89-5d1d8d209b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4bac28ad1294443a16bc4510a4d2fd1'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:46.923826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ddd1bd8d83434282305a0a8f0a2db9', 'request_id': 'req-6107281a-034b-4d74-bdad-254e97fc9c8e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.045694 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4bc835d8-4dc8-4f7c-ba89-5d1d8d209b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4bac28ad1294443a16bc4510a4d2fd1'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.053928 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4bc835d8-4dc8-4f7c-ba89-5d1d8d209b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4bac28ad1294443a16bc4510a4d2fd1'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.054570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4bc835d8-4dc8-4f7c-ba89-5d1d8d209b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4bac28ad1294443a16bc4510a4d2fd1'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.072523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4bc835d8-4dc8-4f7c-ba89-5d1d8d209b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4bac28ad1294443a16bc4510a4d2fd1'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.084250 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1192/2381] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:46 2022] DELETE /identity/v3/users/f4bac28ad1294443a16bc4510a4d2fd1 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:47.085251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03c5c5-8d99-45f7-bac2-e6c581e67cec None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:47.085545 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03c5c5-8d99-45f7-bac2-e6c581e67cec None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:47.086220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03c5c5-8d99-45f7-bac2-e6c581e67cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:47.107597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4f03c5c5-8d99-45f7-bac2-e6c581e67cec None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:47.109114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4f03c5c5-8d99-45f7-bac2-e6c581e67cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:47.172303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1193/2382] 10.222.0.73 () {58 vars in 958 bytes} [Mon Aug 29 23:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:58:47.186257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03c5c5-8d99-45f7-bac2-e6c581e67cec None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:47.188377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4f03c5c5-8d99-45f7-bac2-e6c581e67cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:47.240090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ddd1bd8d83434282305a0a8f0a2db9', 'request_id': 'req-6107281a-034b-4d74-bdad-254e97fc9c8e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.256800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] The token cache is being invalidate because project b4ddd1bd8d83434282305a0a8f0a2db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:47.257172 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.258036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.259867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1190/2383] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:46 2022] DELETE /identity/v3/projects/b4ddd1bd8d83434282305a0a8f0a2db9 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:47.264225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:47.265709 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:47.273459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03c5c5-8d99-45f7-bac2-e6c581e67cec None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:47.277184 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09838c5-acb2-4e96-8750-ee7452a557a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:47.278655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09838c5-acb2-4e96-8750-ee7452a557a3 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:47.278655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09838c5-acb2-4e96-8750-ee7452a557a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:47.278655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09838c5-acb2-4e96-8750-ee7452a557a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:47.280277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c09838c5-acb2-4e96-8750-ee7452a557a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:47.293919 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09838c5-acb2-4e96-8750-ee7452a557a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:47.295553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09838c5-acb2-4e96-8750-ee7452a557a3 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:47.311198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1194/2384] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:47.340659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107281a-034b-4d74-bdad-254e97fc9c8e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:47.346067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfae623-fadf-4748-9374-5b5fa0977feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:47.346619 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfae623-fadf-4748-9374-5b5fa0977feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:47.347042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfae623-fadf-4748-9374-5b5fa0977feb admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:47.347530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfae623-fadf-4748-9374-5b5fa0977feb admin admin] PATH_INFO: `/v3/users/0424395034a54406982608fbbcfc18a4` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:47.349034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfae623-fadf-4748-9374-5b5fa0977feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0424395034a54406982608fbbcfc18a4)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:47.351230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfae623-fadf-4748-9374-5b5fa0977feb admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:47.554214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0dfae623-fadf-4748-9374-5b5fa0977feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0424395034a54406982608fbbcfc18a4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.569286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0dfae623-fadf-4748-9374-5b5fa0977feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0424395034a54406982608fbbcfc18a4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.578841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0dfae623-fadf-4748-9374-5b5fa0977feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0424395034a54406982608fbbcfc18a4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.579668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0dfae623-fadf-4748-9374-5b5fa0977feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0424395034a54406982608fbbcfc18a4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.580337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0dfae623-fadf-4748-9374-5b5fa0977feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0424395034a54406982608fbbcfc18a4'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.697367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1191/2385] 10.222.0.73 () {58 vars in 1224 bytes} [Mon Aug 29 23:58:47 2022] DELETE /identity/v3/users/0424395034a54406982608fbbcfc18a4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:47.757465 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09838c5-acb2-4e96-8750-ee7452a557a3 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:47.758946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c09838c5-acb2-4e96-8750-ee7452a557a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:47.771338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09838c5-acb2-4e96-8750-ee7452a557a3 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:47.786944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:47.834223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:47.834869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:47.835178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:47.835469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] PATH_INFO: `/v3/projects/f451bdb7b7d2499eae5aedcbde7d8e7e` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:47.836577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f451bdb7b7d2499eae5aedcbde7d8e7e)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:47.838543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:47.968616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe4361-66ae-4594-b6cb-525b259627b9 None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:47.968900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe4361-66ae-4594-b6cb-525b259627b9 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:47.969178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe4361-66ae-4594-b6cb-525b259627b9 None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:47.971187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1192/2386] 10.222.0.73 () {54 vars in 921 bytes} [Mon Aug 29 23:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:58:47.979086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec542786-413c-4029-be17-716feaad42b4 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:47.979378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec542786-413c-4029-be17-716feaad42b4 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:47.979679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec542786-413c-4029-be17-716feaad42b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:47.986410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f451bdb7b7d2499eae5aedcbde7d8e7e', 'request_id': 'req-0e249b72-0790-45d9-ba15-546302892c40'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:47.995335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f451bdb7b7d2499eae5aedcbde7d8e7e', 'request_id': 'req-0e249b72-0790-45d9-ba15-546302892c40'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:48.005024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f451bdb7b7d2499eae5aedcbde7d8e7e', 'request_id': 'req-0e249b72-0790-45d9-ba15-546302892c40'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:48.010897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-ec542786-413c-4029-be17-716feaad42b4 None None] MFA Rules not processed for user `59a1b0b274294a288dbf07cd99f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:48.011954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ec542786-413c-4029-be17-716feaad42b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:48.090655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1193/2387] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Aug 29 23:58:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 23:58:48.103032 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] The token cache is being invalidate because project f451bdb7b7d2499eae5aedcbde7d8e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:48.103333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:48.103918 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec542786-413c-4029-be17-716feaad42b4 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:48.104867 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:48.105488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ec542786-413c-4029-be17-716feaad42b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:48.108543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1195/2388] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:47 2022] DELETE /identity/v3/projects/f451bdb7b7d2499eae5aedcbde7d8e7e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:58:48.167264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:48.184503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec542786-413c-4029-be17-716feaad42b4 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:48.188773 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a4f16-e7be-4536-ba92-54b898b0b55b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a10328a436c4159b6519e5493ba57f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:48.189406 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a4f16-e7be-4536-ba92-54b898b0b55b service glance] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:48.189687 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a4f16-e7be-4536-ba92-54b898b0b55b service glance] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:48.189966 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a4f16-e7be-4536-ba92-54b898b0b55b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:48.191829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-aa9a4f16-e7be-4536-ba92-54b898b0b55b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:48.207167 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a4f16-e7be-4536-ba92-54b898b0b55b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:48.208897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a4f16-e7be-4536-ba92-54b898b0b55b service glance] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:48.222485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1194/2389] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:48.243101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:48.245990 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:48.335371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e249b72-0790-45d9-ba15-546302892c40 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:48.340055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:48.340671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:48.340993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:48.341266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5 admin admin] PATH_INFO: `/v3/projects/70d70655556b4fa8b9a28138ccc98f4c` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:48.342386 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d70655556b4fa8b9a28138ccc98f4c)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:48.344449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:48.424818 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5975-f5de-41e5-99f6-67b7e6c03e9f None None] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:48.425430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5975-f5de-41e5-99f6-67b7e6c03e9f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:48.425693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5975-f5de-41e5-99f6-67b7e6c03e9f None None] PATH_INFO: `/` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:48.428013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1195/2390] 10.222.0.73 () {54 vars in 921 bytes} [Mon Aug 29 23:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:58:48.433070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba1c99-86b3-4e48-8d14-b35f66a31022 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:48.433518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba1c99-86b3-4e48-8d14-b35f66a31022 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:48.433833 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba1c99-86b3-4e48-8d14-b35f66a31022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:48.463083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d70655556b4fa8b9a28138ccc98f4c', 'request_id': 'req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:48.463195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-c4ba1c99-86b3-4e48-8d14-b35f66a31022 None None] MFA Rules not processed for user `707518bbe380425aa793f005548bc9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:48.463195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c4ba1c99-86b3-4e48-8d14-b35f66a31022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:48.466222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d70655556b4fa8b9a28138ccc98f4c', 'request_id': 'req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:48.472879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d70655556b4fa8b9a28138ccc98f4c', 'request_id': 'req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:48.516185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1196/2391] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Aug 29 23:58:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:48.528893 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba1c99-86b3-4e48-8d14-b35f66a31022 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:48.530360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c4ba1c99-86b3-4e48-8d14-b35f66a31022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:48.541303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba1c99-86b3-4e48-8d14-b35f66a31022 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:48.552832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5 admin admin] The token cache is being invalidate because project 70d70655556b4fa8b9a28138ccc98f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:58:48.552832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:48.552832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-ecacf92c-8bb7-4777-bbf2-a47f2cfca2d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:58:48.553151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5c70d-ffc5-4620-9cd6-8d35e55a279d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:48.553151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c70d-ffc5-4620-9cd6-8d35e55a279d service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:48.553151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c70d-ffc5-4620-9cd6-8d35e55a279d service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:48.553378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1196/2392] 10.222.0.73 () {58 vars in 1233 bytes} [Mon Aug 29 23:58:48 2022] DELETE /identity/v3/projects/70d70655556b4fa8b9a28138ccc98f4c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:58:48.553477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c70d-ffc5-4620-9cd6-8d35e55a279d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:48.553477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-55c5c70d-ffc5-4620-9cd6-8d35e55a279d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:48.564863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5c70d-ffc5-4620-9cd6-8d35e55a279d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:48.566360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5c70d-ffc5-4620-9cd6-8d35e55a279d service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:48.576038 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1197/2393] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:48.641394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:48.681718 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d58069-74ae-464c-9e2b-cc854fff561c None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:48.682074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d58069-74ae-464c-9e2b-cc854fff561c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:48.682350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d58069-74ae-464c-9e2b-cc854fff561c None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:48.683925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1197/2394] 10.222.0.73 () {54 vars in 921 bytes} [Mon Aug 29 23:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:58:48.690872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9015f-6110-43e7-8cc8-9d8e51f03812 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:48.691211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9015f-6110-43e7-8cc8-9d8e51f03812 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:48.691473 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9015f-6110-43e7-8cc8-9d8e51f03812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:48.721822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-4da9015f-6110-43e7-8cc8-9d8e51f03812 None None] MFA Rules not processed for user `59a1b0b274294a288dbf07cd99f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:48.723209 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4da9015f-6110-43e7-8cc8-9d8e51f03812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:48.805193 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1198/2395] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Aug 29 23:58:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:48.817480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d58069-74ae-464c-9e2b-cc854fff561c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:48.819223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-82d58069-74ae-464c-9e2b-cc854fff561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:48.833567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d58069-74ae-464c-9e2b-cc854fff561c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:48.837095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c16ce8-19fb-4729-a1f9-bea7b3706b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:48.837692 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c16ce8-19fb-4729-a1f9-bea7b3706b97 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:48.837975 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c16ce8-19fb-4729-a1f9-bea7b3706b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:48.838251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c16ce8-19fb-4729-a1f9-bea7b3706b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:48.848538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c16ce8-19fb-4729-a1f9-bea7b3706b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:48.850044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c16ce8-19fb-4729-a1f9-bea7b3706b97 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:48.862124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1198/2396] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:58:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:58:53.511556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4aa2d-72fd-4e03-a795-4c2e928ce96b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:53.512035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4aa2d-72fd-4e03-a795-4c2e928ce96b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:53.512496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4aa2d-72fd-4e03-a795-4c2e928ce96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:53.538564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e5a4aa2d-72fd-4e03-a795-4c2e928ce96b None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:58:53.538564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e5a4aa2d-72fd-4e03-a795-4c2e928ce96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:53.543134 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:53.595000 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1199/2397] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Aug 29 23:58:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:58:53.617000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c16ce8-19fb-4729-a1f9-bea7b3706b97 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:58:53.618484 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-89c16ce8-19fb-4729-a1f9-bea7b3706b97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:58:53.687202 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c16ce8-19fb-4729-a1f9-bea7b3706b97 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:58:53.692375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a531800-b787-44e8-8191-ce3a44b735b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:58:53.692980 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a531800-b787-44e8-8191-ce3a44b735b0 service swift] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:58:53.693358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a531800-b787-44e8-8191-ce3a44b735b0 service swift] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:58:53.693641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a531800-b787-44e8-8191-ce3a44b735b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:58:53.701713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a531800-b787-44e8-8191-ce3a44b735b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:58:53.703332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a531800-b787-44e8-8191-ce3a44b735b0 service swift] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:58:53.712226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1199/2398] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Aug 29 23:58:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:03.588538 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=20 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:03.712723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=3,keystone:SELECT=44,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:10.759308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ac17f-d804-4e7e-beab-f14c0aa2b1bf None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:10.759799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ac17f-d804-4e7e-beab-f14c0aa2b1bf None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:10.759895 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ac17f-d804-4e7e-beab-f14c0aa2b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:10.780615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-da7ac17f-d804-4e7e-beab-f14c0aa2b1bf None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:59:10.781855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-da7ac17f-d804-4e7e-beab-f14c0aa2b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:59:10.788873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1200/2399] 10.222.0.73 () {58 vars in 967 bytes} [Mon Aug 29 23:59:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:59:10.802779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a531800-b787-44e8-8191-ce3a44b735b0 service swift] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:59:10.814606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a531800-b787-44e8-8191-ce3a44b735b0 service swift] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:59:10.819757 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ef9b5-f7e8-442f-a75a-9b5edea5b4a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:59:10.820361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ef9b5-f7e8-442f-a75a-9b5edea5b4a0 service swift] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:10.820643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ef9b5-f7e8-442f-a75a-9b5edea5b4a0 service swift] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:10.820918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ef9b5-f7e8-442f-a75a-9b5edea5b4a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:10.829583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ef9b5-f7e8-442f-a75a-9b5edea5b4a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:59:10.831122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ef9b5-f7e8-442f-a75a-9b5edea5b4a0 service swift] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:59:10.839410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1200/2400] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Aug 29 23:59:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:59:20.774123 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:20.836114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=6 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:26.230661 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4236f-2b96-4a97-a48f-9f6cd0b0e442 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:26.231256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4236f-2b96-4a97-a48f-9f6cd0b0e442 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:26.231256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4236f-2b96-4a97-a48f-9f6cd0b0e442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:26.253211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-c8d4236f-2b96-4a97-a48f-9f6cd0b0e442 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:59:26.254443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c8d4236f-2b96-4a97-a48f-9f6cd0b0e442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:59:26.313453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1201/2401] 10.222.0.79 () {58 vars in 1016 bytes} [Mon Aug 29 23:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:59:26.328804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ef9b5-f7e8-442f-a75a-9b5edea5b4a0 service swift] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:59:26.330251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5d5ef9b5-f7e8-442f-a75a-9b5edea5b4a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:59:26.345238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ef9b5-f7e8-442f-a75a-9b5edea5b4a0 service swift] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:59:26.350514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83407d46-e265-4e0c-a0a8-605f59554f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:59:26.351136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83407d46-e265-4e0c-a0a8-605f59554f55 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:26.351415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83407d46-e265-4e0c-a0a8-605f59554f55 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:26.351682 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83407d46-e265-4e0c-a0a8-605f59554f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:26.359561 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83407d46-e265-4e0c-a0a8-605f59554f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:59:26.361113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83407d46-e265-4e0c-a0a8-605f59554f55 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:59:26.370753 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1201/2402] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:59:27.606193 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4236f-2b96-4a97-a48f-9f6cd0b0e442 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:59:27.607655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c8d4236f-2b96-4a97-a48f-9f6cd0b0e442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:59:27.678112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4236f-2b96-4a97-a48f-9f6cd0b0e442 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:59:27.683272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a2aaf-6041-4422-b0ee-b6d5df1fd91d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:59:27.683886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2aaf-6041-4422-b0ee-b6d5df1fd91d service placement] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:27.684253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2aaf-6041-4422-b0ee-b6d5df1fd91d service placement] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:27.684532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2aaf-6041-4422-b0ee-b6d5df1fd91d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:27.686270 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c34a2aaf-6041-4422-b0ee-b6d5df1fd91d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:59:27.698215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a2aaf-6041-4422-b0ee-b6d5df1fd91d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:59:27.699937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a2aaf-6041-4422-b0ee-b6d5df1fd91d service placement] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:59:27.709807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1202/2403] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:59:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:59:30.272375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a0e08-5926-4428-9049-ee08e0e70316 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:30.272907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a0e08-5926-4428-9049-ee08e0e70316 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:30.272907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a0e08-5926-4428-9049-ee08e0e70316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:30.294152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-bb3a0e08-5926-4428-9049-ee08e0e70316 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:59:30.295404 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-bb3a0e08-5926-4428-9049-ee08e0e70316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:59:30.303999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1202/2404] 10.222.0.79 () {58 vars in 1016 bytes} [Mon Aug 29 23:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:59:30.319443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a2aaf-6041-4422-b0ee-b6d5df1fd91d service placement] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:59:30.331789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a2aaf-6041-4422-b0ee-b6d5df1fd91d service placement] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:59:30.337499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e2b7d-14cb-4d9e-bf12-54f3568fbfc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:59:30.338082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e2b7d-14cb-4d9e-bf12-54f3568fbfc0 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:30.338361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e2b7d-14cb-4d9e-bf12-54f3568fbfc0 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:30.338634 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e2b7d-14cb-4d9e-bf12-54f3568fbfc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:30.347371 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e2b7d-14cb-4d9e-bf12-54f3568fbfc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:59:30.348927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e2b7d-14cb-4d9e-bf12-54f3568fbfc0 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:59:30.358126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1203/2405] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:59:33.792350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a2ed0-d104-4ae4-8688-e135a2a56cdf None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:33.792896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a2ed0-d104-4ae4-8688-e135a2a56cdf None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:33.792896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a2ed0-d104-4ae4-8688-e135a2a56cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:33.813489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4a2a2ed0-d104-4ae4-8688-e135a2a56cdf None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:59:33.814678 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4a2a2ed0-d104-4ae4-8688-e135a2a56cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:59:33.822945 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1203/2406] 10.222.0.79 () {58 vars in 1016 bytes} [Mon Aug 29 23:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:59:33.838335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e2b7d-14cb-4d9e-bf12-54f3568fbfc0 service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:59:33.839771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e83e2b7d-14cb-4d9e-bf12-54f3568fbfc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:59:33.854788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e2b7d-14cb-4d9e-bf12-54f3568fbfc0 service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:59:33.860321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fbf37-c902-4274-9d97-0de1ad6c3033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:59:33.862668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fbf37-c902-4274-9d97-0de1ad6c3033 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:33.862668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fbf37-c902-4274-9d97-0de1ad6c3033 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:33.862668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fbf37-c902-4274-9d97-0de1ad6c3033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:33.870041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fbf37-c902-4274-9d97-0de1ad6c3033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:59:33.871642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fbf37-c902-4274-9d97-0de1ad6c3033 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:59:33.880975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1204/2407] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:59:36.665818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca57cb-759b-4969-b7b2-9ba1a8200f69 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:36.666293 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca57cb-759b-4969-b7b2-9ba1a8200f69 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:36.666415 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca57cb-759b-4969-b7b2-9ba1a8200f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:36.685722 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-b9ca57cb-759b-4969-b7b2-9ba1a8200f69 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:59:36.686915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b9ca57cb-759b-4969-b7b2-9ba1a8200f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:59:36.695576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1204/2408] 10.222.0.79 () {58 vars in 1016 bytes} [Mon Aug 29 23:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:59:36.717387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fbf37-c902-4274-9d97-0de1ad6c3033 service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:59:36.728458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fbf37-c902-4274-9d97-0de1ad6c3033 service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:59:36.735852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a22694-0446-46b5-9594-2e28bcd2c472 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:59:36.735852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22694-0446-46b5-9594-2e28bcd2c472 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:36.735852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22694-0446-46b5-9594-2e28bcd2c472 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:36.735852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22694-0446-46b5-9594-2e28bcd2c472 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:36.744095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a22694-0446-46b5-9594-2e28bcd2c472 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:59:36.745663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a22694-0446-46b5-9594-2e28bcd2c472 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:59:36.755644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1205/2409] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:59:39.905159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652b338-7e23-4184-acc5-5d8b69ab541c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:39.905618 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652b338-7e23-4184-acc5-5d8b69ab541c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:39.905725 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652b338-7e23-4184-acc5-5d8b69ab541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:39.926836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-e652b338-7e23-4184-acc5-5d8b69ab541c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:59:39.928083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e652b338-7e23-4184-acc5-5d8b69ab541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:59:39.935973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1205/2410] 10.222.0.79 () {58 vars in 1016 bytes} [Mon Aug 29 23:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:59:39.963591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a22694-0446-46b5-9594-2e28bcd2c472 service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:59:39.974998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a22694-0446-46b5-9594-2e28bcd2c472 service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:59:39.980573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375799c-b0c8-4b57-a825-ad8f19fa952f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:59:39.981171 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375799c-b0c8-4b57-a825-ad8f19fa952f service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:39.981452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375799c-b0c8-4b57-a825-ad8f19fa952f service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:39.981731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375799c-b0c8-4b57-a825-ad8f19fa952f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:39.990040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375799c-b0c8-4b57-a825-ad8f19fa952f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:59:39.991692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375799c-b0c8-4b57-a825-ad8f19fa952f service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:59:40.001036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1206/2411] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:59:43.124240 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469feee7-e7b1-4206-b324-e6c7a3856f85 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:43.124761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469feee7-e7b1-4206-b324-e6c7a3856f85 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:43.124859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469feee7-e7b1-4206-b324-e6c7a3856f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:43.150265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-469feee7-e7b1-4206-b324-e6c7a3856f85 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:59:43.151513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-469feee7-e7b1-4206-b324-e6c7a3856f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:59:43.159371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1206/2412] 10.222.0.79 () {58 vars in 1016 bytes} [Mon Aug 29 23:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:59:43.175795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375799c-b0c8-4b57-a825-ad8f19fa952f service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:59:43.187271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375799c-b0c8-4b57-a825-ad8f19fa952f service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:59:43.193281 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a416b3-10a4-4c00-a9b0-641de68c79f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:59:43.193868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a416b3-10a4-4c00-a9b0-641de68c79f3 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:59:43.194150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a416b3-10a4-4c00-a9b0-641de68c79f3 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:59:43.194423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a416b3-10a4-4c00-a9b0-641de68c79f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:59:43.202515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a416b3-10a4-4c00-a9b0-641de68c79f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:59:43.204141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a416b3-10a4-4c00-a9b0-641de68c79f3 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:59:43.214321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1207/2413] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Aug 29 23:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:59:53.144886 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=21 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:53.210120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:01.408454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe3f5e-3807-425e-84f1-88279712665d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:01.408996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe3f5e-3807-425e-84f1-88279712665d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:01.408996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe3f5e-3807-425e-84f1-88279712665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:01.430808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4cbe3f5e-3807-425e-84f1-88279712665d None None] MFA Rules not processed for user `fe2599b1dc8c426ea11049d842909fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:00:01.432412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4cbe3f5e-3807-425e-84f1-88279712665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:00:01.578980 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1207/2414] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:00:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:00:05.545707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb32604-c481-4e8f-aa2f-98e9d08e8f85 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:05.546621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb32604-c481-4e8f-aa2f-98e9d08e8f85 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:05.547167 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb32604-c481-4e8f-aa2f-98e9d08e8f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:05.569775 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-2cb32604-c481-4e8f-aa2f-98e9d08e8f85 None None] MFA Rules not processed for user `3c8d932499ee46cb9179ef5b49c3dae1`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:00:05.571254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2cb32604-c481-4e8f-aa2f-98e9d08e8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:00:05.644895 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1208/2415] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:00:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:00:11.569909 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=25 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:14.930536 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe972a95-069b-4db9-9001-8c1c594fec1a None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:14.931207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe972a95-069b-4db9-9001-8c1c594fec1a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:14.931207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe972a95-069b-4db9-9001-8c1c594fec1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:14.951106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-fe972a95-069b-4db9-9001-8c1c594fec1a None None] MFA Rules not processed for user `4ebb392ea86a4ce9b14b619ad59e16ac`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:00:14.952347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fe972a95-069b-4db9-9001-8c1c594fec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:00:15.012515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1208/2416] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:00:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:00:15.632515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=25 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:17.364430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e2883-ed72-484e-bd3e-0cc0adca3972 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:17.365048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e2883-ed72-484e-bd3e-0cc0adca3972 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:17.365048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e2883-ed72-484e-bd3e-0cc0adca3972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:17.384339 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-3c7e2883-ed72-484e-bd3e-0cc0adca3972 None None] MFA Rules not processed for user `3810bf4e4ea043ca9f12340498bf51c2`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:00:17.385608 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-3c7e2883-ed72-484e-bd3e-0cc0adca3972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:00:17.441840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1209/2417] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:00:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:00:23.841016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ed00e-8320-43fd-baf0-d585ccd42098 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:23.841582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ed00e-8320-43fd-baf0-d585ccd42098 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:23.841582 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ed00e-8320-43fd-baf0-d585ccd42098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:23.862585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-7b6ed00e-8320-43fd-baf0-d585ccd42098 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:00:23.863833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7b6ed00e-8320-43fd-baf0-d585ccd42098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:00:23.872557 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1209/2418] 10.222.0.79 () {58 vars in 1016 bytes} [Tue Aug 30 00:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:00:23.886768 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e2883-ed72-484e-bd3e-0cc0adca3972 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:00:23.902382 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e2883-ed72-484e-bd3e-0cc0adca3972 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:00:23.909148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63192bd5-ae51-424b-86d8-6bd5c0915e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:00:23.910044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63192bd5-ae51-424b-86d8-6bd5c0915e38 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:23.910529 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63192bd5-ae51-424b-86d8-6bd5c0915e38 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:23.911159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63192bd5-ae51-424b-86d8-6bd5c0915e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:23.921913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63192bd5-ae51-424b-86d8-6bd5c0915e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:00:23.923918 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63192bd5-ae51-424b-86d8-6bd5c0915e38 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:00:23.936337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1210/2419] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:00:27.325692 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbf3ca-cca3-4990-890a-53a766dd198f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:27.326150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbf3ca-cca3-4990-890a-53a766dd198f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:27.326355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbf3ca-cca3-4990-890a-53a766dd198f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:27.346493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-e8cbf3ca-cca3-4990-890a-53a766dd198f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:00:27.347714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e8cbf3ca-cca3-4990-890a-53a766dd198f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:00:27.355477 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1210/2420] 10.222.0.79 () {58 vars in 1016 bytes} [Tue Aug 30 00:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:00:27.368647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63192bd5-ae51-424b-86d8-6bd5c0915e38 service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:00:27.379929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63192bd5-ae51-424b-86d8-6bd5c0915e38 service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:00:27.386014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360e9de-67ad-476d-a894-0bb84df6bc05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:00:27.386607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360e9de-67ad-476d-a894-0bb84df6bc05 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:27.386902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360e9de-67ad-476d-a894-0bb84df6bc05 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:27.387202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360e9de-67ad-476d-a894-0bb84df6bc05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:27.395260 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360e9de-67ad-476d-a894-0bb84df6bc05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:00:27.396831 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360e9de-67ad-476d-a894-0bb84df6bc05 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:00:27.406812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1211/2421] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:00:30.251820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79af561-2f6c-4f6d-a2cf-bb2fad445586 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:30.252347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79af561-2f6c-4f6d-a2cf-bb2fad445586 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:30.253121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79af561-2f6c-4f6d-a2cf-bb2fad445586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:30.272474 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d79af561-2f6c-4f6d-a2cf-bb2fad445586 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:00:30.273783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d79af561-2f6c-4f6d-a2cf-bb2fad445586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:00:30.282630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1211/2422] 10.222.0.79 () {58 vars in 1016 bytes} [Tue Aug 30 00:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:00:30.299992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360e9de-67ad-476d-a894-0bb84df6bc05 service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:00:30.311838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360e9de-67ad-476d-a894-0bb84df6bc05 service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:00:30.317073 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38c658-fb75-49ad-9c3c-31f21cb421e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:00:30.317861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38c658-fb75-49ad-9c3c-31f21cb421e2 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:30.318144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38c658-fb75-49ad-9c3c-31f21cb421e2 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:30.318589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38c658-fb75-49ad-9c3c-31f21cb421e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:30.328599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38c658-fb75-49ad-9c3c-31f21cb421e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:00:30.330108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38c658-fb75-49ad-9c3c-31f21cb421e2 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:00:30.341215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1212/2423] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:00:34.467941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f46372-1d59-4a76-b18f-27d7f2ed52e6 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:34.470062 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f46372-1d59-4a76-b18f-27d7f2ed52e6 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:34.470062 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f46372-1d59-4a76-b18f-27d7f2ed52e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:34.489143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d0f46372-1d59-4a76-b18f-27d7f2ed52e6 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:00:34.490364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d0f46372-1d59-4a76-b18f-27d7f2ed52e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:00:34.498156 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1212/2424] 10.222.0.79 () {58 vars in 1016 bytes} [Tue Aug 30 00:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:00:34.516688 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38c658-fb75-49ad-9c3c-31f21cb421e2 service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:00:34.528378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38c658-fb75-49ad-9c3c-31f21cb421e2 service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:00:34.534057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b6dd7-9143-4766-b4d2-7c03c0f6c825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:00:34.534663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b6dd7-9143-4766-b4d2-7c03c0f6c825 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:34.534984 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b6dd7-9143-4766-b4d2-7c03c0f6c825 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:34.535261 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b6dd7-9143-4766-b4d2-7c03c0f6c825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:34.544265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b6dd7-9143-4766-b4d2-7c03c0f6c825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:00:34.545847 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b6dd7-9143-4766-b4d2-7c03c0f6c825 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:00:34.555297 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1213/2425] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:00:37.710393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c387cf-d516-463c-afb6-3ee7f981216e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:37.714497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c387cf-d516-463c-afb6-3ee7f981216e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:37.714497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c387cf-d516-463c-afb6-3ee7f981216e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:37.731214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-91c387cf-d516-463c-afb6-3ee7f981216e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:00:37.732424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-91c387cf-d516-463c-afb6-3ee7f981216e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:00:37.740141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1213/2426] 10.222.0.79 () {58 vars in 1016 bytes} [Tue Aug 30 00:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:00:37.755925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b6dd7-9143-4766-b4d2-7c03c0f6c825 service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:00:37.767124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b6dd7-9143-4766-b4d2-7c03c0f6c825 service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:00:37.772665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3590-bad4-4895-ab11-3438c72bc8cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:00:37.773283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3590-bad4-4895-ab11-3438c72bc8cd service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:00:37.773564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3590-bad4-4895-ab11-3438c72bc8cd service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:00:37.773837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3590-bad4-4895-ab11-3438c72bc8cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:00:37.782508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e3590-bad4-4895-ab11-3438c72bc8cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:00:37.784111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e3590-bad4-4895-ab11-3438c72bc8cd service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:00:37.793981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1214/2427] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:00:47.725265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=40 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:47.789330 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=55 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:09.576159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c387cf-d516-463c-afb6-3ee7f981216e None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:09.579588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-91c387cf-d516-463c-afb6-3ee7f981216e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:09.594830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c387cf-d516-463c-afb6-3ee7f981216e None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:09.600015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:09.600720 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:09.601006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:09.601279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] PATH_INFO: `/v3/users/fe2599b1dc8c426ea11049d842909fdf` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:09.602455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2599b1dc8c426ea11049d842909fdf)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:09.604433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:09.791999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2599b1dc8c426ea11049d842909fdf'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:09.845157 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2599b1dc8c426ea11049d842909fdf'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:09.852944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2599b1dc8c426ea11049d842909fdf'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:09.857877 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2599b1dc8c426ea11049d842909fdf'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:09.866061 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2599b1dc8c426ea11049d842909fdf'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:09.873459 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1214/2428] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:01:09 2022] DELETE /identity/v3/users/fe2599b1dc8c426ea11049d842909fdf => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:10.132752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3590-bad4-4895-ab11-3438c72bc8cd service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:10.142445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3590-bad4-4895-ab11-3438c72bc8cd service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:10.202179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:10.202823 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:10.203128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:10.203397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] PATH_INFO: `/v3/projects/97b93bd4b3f64e87a22423eb9ca9c93c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:10.204512 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b93bd4b3f64e87a22423eb9ca9c93c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:10.206647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:10.304467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b93bd4b3f64e87a22423eb9ca9c93c', 'request_id': 'req-84359053-72d8-48ee-b638-f57e4bad7038'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:10.310138 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b93bd4b3f64e87a22423eb9ca9c93c', 'request_id': 'req-84359053-72d8-48ee-b638-f57e4bad7038'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:10.387535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b93bd4b3f64e87a22423eb9ca9c93c', 'request_id': 'req-84359053-72d8-48ee-b638-f57e4bad7038'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:10.400848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] The token cache is being invalidate because project 97b93bd4b3f64e87a22423eb9ca9c93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:01:10.401144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:10.401853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:10.403576 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1215/2429] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:01:10 2022] DELETE /identity/v3/projects/97b93bd4b3f64e87a22423eb9ca9c93c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:01:19.868937 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:20.397814 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:20.627590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:20.629028 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:20.685038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a9f1f-2501-4f04-82a4-d0ff924accb6 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:20.731872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042843eb-8fc6-4017-979b-a6bec4296557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:20.732471 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042843eb-8fc6-4017-979b-a6bec4296557 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:20.732750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042843eb-8fc6-4017-979b-a6bec4296557 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:20.733021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042843eb-8fc6-4017-979b-a6bec4296557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:20.734798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-042843eb-8fc6-4017-979b-a6bec4296557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:20.805803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042843eb-8fc6-4017-979b-a6bec4296557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:20.807295 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042843eb-8fc6-4017-979b-a6bec4296557 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:20.818808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1215/2430] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:21.140594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:21.142083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:21.154631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84359053-72d8-48ee-b638-f57e4bad7038 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:21.158658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eedaf9-c9bf-4278-a11e-a85194830ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:21.159308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eedaf9-c9bf-4278-a11e-a85194830ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:21.159593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eedaf9-c9bf-4278-a11e-a85194830ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:21.159870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eedaf9-c9bf-4278-a11e-a85194830ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:21.161655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d0eedaf9-c9bf-4278-a11e-a85194830ce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:21.176265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eedaf9-c9bf-4278-a11e-a85194830ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:21.177730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eedaf9-c9bf-4278-a11e-a85194830ce9 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:21.190654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1216/2431] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:22.653992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292678e-35e9-43c6-8a58-8896538f66f5 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:22.655217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292678e-35e9-43c6-8a58-8896538f66f5 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:22.655916 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292678e-35e9-43c6-8a58-8896538f66f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:22.680748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8292678e-35e9-43c6-8a58-8896538f66f5 None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:22.683111 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8292678e-35e9-43c6-8a58-8896538f66f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:22.758043 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1216/2432] 10.222.0.73 () {58 vars in 1009 bytes} [Tue Aug 30 00:01:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:22.958357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eedaf9-c9bf-4278-a11e-a85194830ce9 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:22.959825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d0eedaf9-c9bf-4278-a11e-a85194830ce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:23.036223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eedaf9-c9bf-4278-a11e-a85194830ce9 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:23.047887 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23f860-0c08-4b31-9947-15c46e7f5f95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:23.048609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23f860-0c08-4b31-9947-15c46e7f5f95 service swift] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:23.048891 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23f860-0c08-4b31-9947-15c46e7f5f95 service swift] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:23.049802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23f860-0c08-4b31-9947-15c46e7f5f95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:23.059901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23f860-0c08-4b31-9947-15c46e7f5f95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:23.061516 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23f860-0c08-4b31-9947-15c46e7f5f95 service swift] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:23.070916 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1217/2433] 10.222.0.73 () {60 vars in 1384 bytes} [Tue Aug 30 00:01:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:01:24.717994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292678e-35e9-43c6-8a58-8896538f66f5 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:24.723798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:24.738017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292678e-35e9-43c6-8a58-8896538f66f5 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:24.743225 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619db99-9eed-440b-9a6d-076ed0b39a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:24.743956 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619db99-9eed-440b-9a6d-076ed0b39a21 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:24.744222 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619db99-9eed-440b-9a6d-076ed0b39a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:24.744670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619db99-9eed-440b-9a6d-076ed0b39a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:24.746610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d619db99-9eed-440b-9a6d-076ed0b39a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:24.836159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619db99-9eed-440b-9a6d-076ed0b39a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:24.837657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619db99-9eed-440b-9a6d-076ed0b39a21 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:24.850641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1217/2434] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:29.852124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23f860-0c08-4b31-9947-15c46e7f5f95 service swift] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:29.854759 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-3f23f860-0c08-4b31-9947-15c46e7f5f95 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:29.888907 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23f860-0c08-4b31-9947-15c46e7f5f95 service swift] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:29.894930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536aed2d-cc92-423a-913f-39387e6f95c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:29.895865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536aed2d-cc92-423a-913f-39387e6f95c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:29.896392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536aed2d-cc92-423a-913f-39387e6f95c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:29.896812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536aed2d-cc92-423a-913f-39387e6f95c7 admin admin] PATH_INFO: `/v3/users/3810bf4e4ea043ca9f12340498bf51c2` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:29.898350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536aed2d-cc92-423a-913f-39387e6f95c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3810bf4e4ea043ca9f12340498bf51c2)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:29.900318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536aed2d-cc92-423a-913f-39387e6f95c7 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:30.139587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-536aed2d-cc92-423a-913f-39387e6f95c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3810bf4e4ea043ca9f12340498bf51c2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:30.178820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-536aed2d-cc92-423a-913f-39387e6f95c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3810bf4e4ea043ca9f12340498bf51c2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:30.202672 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-536aed2d-cc92-423a-913f-39387e6f95c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3810bf4e4ea043ca9f12340498bf51c2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:30.203487 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-536aed2d-cc92-423a-913f-39387e6f95c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3810bf4e4ea043ca9f12340498bf51c2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:30.204096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-536aed2d-cc92-423a-913f-39387e6f95c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3810bf4e4ea043ca9f12340498bf51c2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:30.310002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1218/2435] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:01:29 2022] DELETE /identity/v3/users/3810bf4e4ea043ca9f12340498bf51c2 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:30.630573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619db99-9eed-440b-9a6d-076ed0b39a21 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:30.653317 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619db99-9eed-440b-9a6d-076ed0b39a21 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:30.731935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:30.732645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:30.732927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:30.733231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8 admin admin] PATH_INFO: `/v3/projects/c06df691218141cb9fe9fc7cb440628c` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:30.734909 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06df691218141cb9fe9fc7cb440628c)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:30.737239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:30.852799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06df691218141cb9fe9fc7cb440628c', 'request_id': 'req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:30.859213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06df691218141cb9fe9fc7cb440628c', 'request_id': 'req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:30.867470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06df691218141cb9fe9fc7cb440628c', 'request_id': 'req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:30.959068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8 admin admin] The token cache is being invalidate because project c06df691218141cb9fe9fc7cb440628c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:01:30.959457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:30.960184 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-effcf2b5-8bd0-48db-bd90-ef045b84f6b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:30.965052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1218/2436] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:01:30 2022] DELETE /identity/v3/projects/c06df691218141cb9fe9fc7cb440628c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:30.966846 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb0561-9b25-4261-8941-f320eedc292b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:30.967357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb0561-9b25-4261-8941-f320eedc292b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:30.967458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb0561-9b25-4261-8941-f320eedc292b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:30.991840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d3fb0561-9b25-4261-8941-f320eedc292b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:30.993092 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d3fb0561-9b25-4261-8941-f320eedc292b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:31.042726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:31.067646 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1219/2437] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:31.069342 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a682f-5c92-4c8a-bbdf-9c230932dc3b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:31.069706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a682f-5c92-4c8a-bbdf-9c230932dc3b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:31.069947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a682f-5c92-4c8a-bbdf-9c230932dc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:31.095433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-999a682f-5c92-4c8a-bbdf-9c230932dc3b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:31.098606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-999a682f-5c92-4c8a-bbdf-9c230932dc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:31.106927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1219/2438] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:31.111315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb0561-9b25-4261-8941-f320eedc292b None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:31.121518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb0561-9b25-4261-8941-f320eedc292b None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:31.127392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4a479-042b-4bd4-aeee-a2bff504ffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:31.127960 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4a479-042b-4bd4-aeee-a2bff504ffb6 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:31.128242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4a479-042b-4bd4-aeee-a2bff504ffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:31.128519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4a479-042b-4bd4-aeee-a2bff504ffb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:31.129182 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4a479-042b-4bd4-aeee-a2bff504ffb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:31.129489 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4a479-042b-4bd4-aeee-a2bff504ffb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:31.131303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4a479-042b-4bd4-aeee-a2bff504ffb6 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:31.149403 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a682f-5c92-4c8a-bbdf-9c230932dc3b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:31.160147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1220/2439] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:31.160355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a682f-5c92-4c8a-bbdf-9c230932dc3b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:31.165344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930cdde-5a2e-437b-a64a-b0ffaf8dfe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:31.165964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930cdde-5a2e-437b-a64a-b0ffaf8dfe2e admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:31.166249 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930cdde-5a2e-437b-a64a-b0ffaf8dfe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:31.166530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930cdde-5a2e-437b-a64a-b0ffaf8dfe2e admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:31.167201 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930cdde-5a2e-437b-a64a-b0ffaf8dfe2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:31.169146 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930cdde-5a2e-437b-a64a-b0ffaf8dfe2e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:31.257904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:31.263632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1220/2440] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:01:31 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:31.268849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4a479-042b-4bd4-aeee-a2bff504ffb6 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:31.294903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4a479-042b-4bd4-aeee-a2bff504ffb6 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:31.377214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4203a-82f4-41c0-bdb1-8b6ff7527f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:31.377913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4203a-82f4-41c0-bdb1-8b6ff7527f4e admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:31.378128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4203a-82f4-41c0-bdb1-8b6ff7527f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:31.378398 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4203a-82f4-41c0-bdb1-8b6ff7527f4e admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:31.379133 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4203a-82f4-41c0-bdb1-8b6ff7527f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:31.381203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4203a-82f4-41c0-bdb1-8b6ff7527f4e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:31.468338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1221/2441] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:01:31 2022] POST /identity/v3/users => generated 282 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:01:31.472569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930cdde-5a2e-437b-a64a-b0ffaf8dfe2e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:31.485640 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930cdde-5a2e-437b-a64a-b0ffaf8dfe2e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:31.491549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b3f48-5e2f-45d8-8e63-7f21a4d4a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:31.492085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b3f48-5e2f-45d8-8e63-7f21a4d4a5ee admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:31.492440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b3f48-5e2f-45d8-8e63-7f21a4d4a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:31.492825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b3f48-5e2f-45d8-8e63-7f21a4d4a5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:31.493549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b3f48-5e2f-45d8-8e63-7f21a4d4a5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:31.496466 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b3f48-5e2f-45d8-8e63-7f21a4d4a5ee admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:31.510279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1221/2442] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:01:31.511429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4203a-82f4-41c0-bdb1-8b6ff7527f4e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:31.527029 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4203a-82f4-41c0-bdb1-8b6ff7527f4e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:31.534293 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045de1d-cdfd-4f30-beb8-f602a4769590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:31.534998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045de1d-cdfd-4f30-beb8-f602a4769590 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:31.535282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045de1d-cdfd-4f30-beb8-f602a4769590 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:31.535559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045de1d-cdfd-4f30-beb8-f602a4769590 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:31.536283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045de1d-cdfd-4f30-beb8-f602a4769590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:31.538006 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045de1d-cdfd-4f30-beb8-f602a4769590 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:31.552007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1222/2443] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:01:31.555925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b3f48-5e2f-45d8-8e63-7f21a4d4a5ee admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:31.576647 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b3f48-5e2f-45d8-8e63-7f21a4d4a5ee admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:31.587064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb72723-ce27-4d10-b3e8-948d81683b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:31.588420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb72723-ce27-4d10-b3e8-948d81683b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:31.589211 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb72723-ce27-4d10-b3e8-948d81683b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:31.589638 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb72723-ce27-4d10-b3e8-948d81683b0d admin admin] PATH_INFO: `/v3/projects/3d48a3e88e8e45e6982773f69c57626c/users/d92351454e934520bfa5b555e1382a12/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:31.618192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb72723-ce27-4d10-b3e8-948d81683b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d48a3e88e8e45e6982773f69c57626c, user_id=d92351454e934520bfa5b555e1382a12, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:31.624993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb72723-ce27-4d10-b3e8-948d81683b0d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:31.743513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1222/2444] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:31 2022] PUT /identity/v3/projects/3d48a3e88e8e45e6982773f69c57626c/users/d92351454e934520bfa5b555e1382a12/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:31.756162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5e074-2240-495f-9109-e65625acc4f3 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:31.756473 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5e074-2240-495f-9109-e65625acc4f3 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:31.756758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5e074-2240-495f-9109-e65625acc4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:31.794506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-feb5e074-2240-495f-9109-e65625acc4f3 None None] MFA Rules not processed for user `d92351454e934520bfa5b555e1382a12`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:31.796181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-feb5e074-2240-495f-9109-e65625acc4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:31.901613 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1223/2445] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:01:31.903007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb72723-ce27-4d10-b3e8-948d81683b0d admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.002500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb72723-ce27-4d10-b3e8-948d81683b0d admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.008627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063dd8-9ec1-4129-b675-8d790919b787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.009239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063dd8-9ec1-4129-b675-8d790919b787 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.009522 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063dd8-9ec1-4129-b675-8d790919b787 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.009796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063dd8-9ec1-4129-b675-8d790919b787 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.010565 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb063dd8-9ec1-4129-b675-8d790919b787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.012641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb063dd8-9ec1-4129-b675-8d790919b787 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.119335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1223/2446] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:01:31 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:01:32.119882 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5e074-2240-495f-9109-e65625acc4f3 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.134832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5e074-2240-495f-9109-e65625acc4f3 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.191727 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:32.214212 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d452656-404c-42f1-a253-1040585bdbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.215585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d452656-404c-42f1-a253-1040585bdbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.215941 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d452656-404c-42f1-a253-1040585bdbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.216327 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d452656-404c-42f1-a253-1040585bdbb3 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.228839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d452656-404c-42f1-a253-1040585bdbb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.231042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d452656-404c-42f1-a253-1040585bdbb3 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.374311 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1224/2447] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:01:32 2022] POST /identity/v3/users => generated 287 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:01:32.375394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063dd8-9ec1-4129-b675-8d790919b787 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.392242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063dd8-9ec1-4129-b675-8d790919b787 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.399637 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1383e-01b6-4a1a-b487-d2bfa3e41433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.400448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1383e-01b6-4a1a-b487-d2bfa3e41433 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.400753 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1383e-01b6-4a1a-b487-d2bfa3e41433 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.401028 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1383e-01b6-4a1a-b487-d2bfa3e41433 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.401688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1383e-01b6-4a1a-b487-d2bfa3e41433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.403336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1383e-01b6-4a1a-b487-d2bfa3e41433 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.436019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d452656-404c-42f1-a253-1040585bdbb3 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.446699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1224/2448] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:01:32.448612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d452656-404c-42f1-a253-1040585bdbb3 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.454972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e1801-b9ef-4363-bfae-925f8c6b2238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.455955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e1801-b9ef-4363-bfae-925f8c6b2238 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.456234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e1801-b9ef-4363-bfae-925f8c6b2238 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.456510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e1801-b9ef-4363-bfae-925f8c6b2238 admin admin] PATH_INFO: `/v3/projects/3b7166ea5b594c1a914f9a0e2cd4dc80/users/926453aa34184ae6a9d16060788ce0e5/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.496513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e1801-b9ef-4363-bfae-925f8c6b2238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7166ea5b594c1a914f9a0e2cd4dc80, user_id=926453aa34184ae6a9d16060788ce0e5, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.499397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e1801-b9ef-4363-bfae-925f8c6b2238 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.576868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1225/2449] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:32 2022] PUT /identity/v3/projects/3b7166ea5b594c1a914f9a0e2cd4dc80/users/926453aa34184ae6a9d16060788ce0e5/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:01:32.581421 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1383e-01b6-4a1a-b487-d2bfa3e41433 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.593630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1383e-01b6-4a1a-b487-d2bfa3e41433 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.655885 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae9be3-98a2-4cb7-8972-e59999749b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.656505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae9be3-98a2-4cb7-8972-e59999749b71 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.657085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae9be3-98a2-4cb7-8972-e59999749b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.657085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae9be3-98a2-4cb7-8972-e59999749b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.657690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae9be3-98a2-4cb7-8972-e59999749b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.659896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae9be3-98a2-4cb7-8972-e59999749b71 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.670575 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1225/2450] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:01:32.675602 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e1801-b9ef-4363-bfae-925f8c6b2238 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.687431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e1801-b9ef-4363-bfae-925f8c6b2238 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.692887 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4033260-b103-4a36-9758-ad6e0483016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.693537 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4033260-b103-4a36-9758-ad6e0483016e admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.693849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4033260-b103-4a36-9758-ad6e0483016e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.694167 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4033260-b103-4a36-9758-ad6e0483016e admin admin] PATH_INFO: `/v3/projects/3b7166ea5b594c1a914f9a0e2cd4dc80/users/926453aa34184ae6a9d16060788ce0e5/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.696491 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4033260-b103-4a36-9758-ad6e0483016e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7166ea5b594c1a914f9a0e2cd4dc80, user_id=926453aa34184ae6a9d16060788ce0e5, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.699371 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4033260-b103-4a36-9758-ad6e0483016e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.710151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1226/2451] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:32 2022] PUT /identity/v3/projects/3b7166ea5b594c1a914f9a0e2cd4dc80/users/926453aa34184ae6a9d16060788ce0e5/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:32.722389 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dffd4-ae88-4cf0-bedf-6f8c1331400b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.722680 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dffd4-ae88-4cf0-bedf-6f8c1331400b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.722988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dffd4-ae88-4cf0-bedf-6f8c1331400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.753861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d82dffd4-ae88-4cf0-bedf-6f8c1331400b None None] MFA Rules not processed for user `926453aa34184ae6a9d16060788ce0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:32.755167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d82dffd4-ae88-4cf0-bedf-6f8c1331400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:32.776444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:32.830768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1226/2452] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:32.842638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4033260-b103-4a36-9758-ad6e0483016e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.844363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e4033260-b103-4a36-9758-ad6e0483016e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:32.906623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4033260-b103-4a36-9758-ad6e0483016e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.911445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee2a42-e6ae-46a5-91a8-a95c22fcd900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.912069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee2a42-e6ae-46a5-91a8-a95c22fcd900 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.912401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee2a42-e6ae-46a5-91a8-a95c22fcd900 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.912651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee2a42-e6ae-46a5-91a8-a95c22fcd900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.921987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee2a42-e6ae-46a5-91a8-a95c22fcd900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.923570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee2a42-e6ae-46a5-91a8-a95c22fcd900 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.932838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1227/2453] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:33.441292 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dffd4-ae88-4cf0-bedf-6f8c1331400b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:33.451482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dffd4-ae88-4cf0-bedf-6f8c1331400b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:33.455657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652665d-e350-42a6-9128-2ea08cc7178b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:33.456316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652665d-e350-42a6-9128-2ea08cc7178b service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:33.456604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652665d-e350-42a6-9128-2ea08cc7178b service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:33.456875 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652665d-e350-42a6-9128-2ea08cc7178b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:33.532683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652665d-e350-42a6-9128-2ea08cc7178b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:33.534901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652665d-e350-42a6-9128-2ea08cc7178b service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:33.545247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1227/2454] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:36.647641 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee2a42-e6ae-46a5-91a8-a95c22fcd900 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:36.649742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-abee2a42-e6ae-46a5-91a8-a95c22fcd900 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:36.708981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee2a42-e6ae-46a5-91a8-a95c22fcd900 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:36.712734 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7556ea7-fb7b-40d4-8e17-2204d6cf362a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:36.713350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7556ea7-fb7b-40d4-8e17-2204d6cf362a service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:36.713632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7556ea7-fb7b-40d4-8e17-2204d6cf362a service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:36.713904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7556ea7-fb7b-40d4-8e17-2204d6cf362a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:36.715689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d7556ea7-fb7b-40d4-8e17-2204d6cf362a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:36.781392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:36.786538 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7556ea7-fb7b-40d4-8e17-2204d6cf362a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:36.788357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7556ea7-fb7b-40d4-8e17-2204d6cf362a service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:36.797861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1228/2455] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:37.212777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652665d-e350-42a6-9128-2ea08cc7178b service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:37.214965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8652665d-e350-42a6-9128-2ea08cc7178b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:37.306132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652665d-e350-42a6-9128-2ea08cc7178b service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:37.311939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89f983-750b-4323-9b77-6bf6afd5f82c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:37.312603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89f983-750b-4323-9b77-6bf6afd5f82c service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:37.312885 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89f983-750b-4323-9b77-6bf6afd5f82c service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:37.313301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89f983-750b-4323-9b77-6bf6afd5f82c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:37.315491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9a89f983-750b-4323-9b77-6bf6afd5f82c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:37.382052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:37.385805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89f983-750b-4323-9b77-6bf6afd5f82c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:37.390237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89f983-750b-4323-9b77-6bf6afd5f82c service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:37.397868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1228/2456] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:41.720985 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7556ea7-fb7b-40d4-8e17-2204d6cf362a service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:41.722533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d7556ea7-fb7b-40d4-8e17-2204d6cf362a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:41.733818 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7556ea7-fb7b-40d4-8e17-2204d6cf362a service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:41.737630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8fdf3-ea80-4f1f-857e-f050cb5a375b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:41.738534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8fdf3-ea80-4f1f-857e-f050cb5a375b service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:41.738820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8fdf3-ea80-4f1f-857e-f050cb5a375b service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:41.739140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8fdf3-ea80-4f1f-857e-f050cb5a375b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:41.740904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4ca8fdf3-ea80-4f1f-857e-f050cb5a375b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:41.750926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8fdf3-ea80-4f1f-857e-f050cb5a375b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:41.752858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8fdf3-ea80-4f1f-857e-f050cb5a375b service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:41.760999 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1229/2457] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:42.499230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89f983-750b-4323-9b77-6bf6afd5f82c service nova] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:42.508979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8fdf3-ea80-4f1f-857e-f050cb5a375b service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:42.512014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4ca8fdf3-ea80-4f1f-857e-f050cb5a375b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:42.567996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89f983-750b-4323-9b77-6bf6afd5f82c service nova] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:42.572619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:42.573285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:42.576335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:42.576335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] PATH_INFO: `/v3/users/d92351454e934520bfa5b555e1382a12` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:42.576335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d92351454e934520bfa5b555e1382a12)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:42.576930 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:42.582111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8fdf3-ea80-4f1f-857e-f050cb5a375b service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:42.587160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862061ec-eb59-4af1-8662-94465c7306fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:42.587774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862061ec-eb59-4af1-8662-94465c7306fd service placement] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:42.588046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862061ec-eb59-4af1-8662-94465c7306fd service placement] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:42.588314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862061ec-eb59-4af1-8662-94465c7306fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:42.590021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-862061ec-eb59-4af1-8662-94465c7306fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:42.602390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862061ec-eb59-4af1-8662-94465c7306fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:42.604002 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862061ec-eb59-4af1-8662-94465c7306fd service placement] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:42.614365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1230/2458] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:01:42.751976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd92351454e934520bfa5b555e1382a12'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:42.809077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd92351454e934520bfa5b555e1382a12'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:42.816423 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd92351454e934520bfa5b555e1382a12'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:42.817089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd92351454e934520bfa5b555e1382a12'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:42.828824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd92351454e934520bfa5b555e1382a12'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:42.835447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1229/2459] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:01:42 2022] DELETE /identity/v3/users/d92351454e934520bfa5b555e1382a12 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:42.840108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1caf0-4e90-4eee-b4b5-8d72f51c221b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:42.840585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1caf0-4e90-4eee-b4b5-8d72f51c221b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:42.840698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1caf0-4e90-4eee-b4b5-8d72f51c221b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:42.860904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-35a1caf0-4e90-4eee-b4b5-8d72f51c221b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:42.862128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-35a1caf0-4e90-4eee-b4b5-8d72f51c221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:42.921769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1231/2460] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:42.931735 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:42.933313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:43.001032 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416270c-9001-4c41-ab70-6cdd011d49cd admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:43.004999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cf28d-8e76-4a3f-9a7f-cbb24ebaf9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:43.005606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cf28d-8e76-4a3f-9a7f-cbb24ebaf9de service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:43.005934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cf28d-8e76-4a3f-9a7f-cbb24ebaf9de service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:43.006920 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cf28d-8e76-4a3f-9a7f-cbb24ebaf9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:43.017250 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cf28d-8e76-4a3f-9a7f-cbb24ebaf9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:43.020666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cf28d-8e76-4a3f-9a7f-cbb24ebaf9de service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:43.030863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1230/2461] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:43.489900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1caf0-4e90-4eee-b4b5-8d72f51c221b None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:43.492476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-35a1caf0-4e90-4eee-b4b5-8d72f51c221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:43.503732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1caf0-4e90-4eee-b4b5-8d72f51c221b None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:43.514713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:43.515369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:43.515645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:43.515923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] PATH_INFO: `/v3/projects/3d48a3e88e8e45e6982773f69c57626c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:43.517689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d48a3e88e8e45e6982773f69c57626c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:43.519541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:43.661314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d48a3e88e8e45e6982773f69c57626c', 'request_id': 'req-de63b096-1bbb-456d-978a-85d35c81f967'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:43.668047 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d48a3e88e8e45e6982773f69c57626c', 'request_id': 'req-de63b096-1bbb-456d-978a-85d35c81f967'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:43.786524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d48a3e88e8e45e6982773f69c57626c', 'request_id': 'req-de63b096-1bbb-456d-978a-85d35c81f967'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:43.788012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:43.799113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] The token cache is being invalidate because project 3d48a3e88e8e45e6982773f69c57626c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:01:43.799400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:43.800035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:43.801612 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1232/2462] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:01:43 2022] DELETE /identity/v3/projects/3d48a3e88e8e45e6982773f69c57626c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:43.805472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cf28d-8e76-4a3f-9a7f-cbb24ebaf9de service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:43.816127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cf28d-8e76-4a3f-9a7f-cbb24ebaf9de service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:43.827705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:44.000194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93332cea-6639-4c3b-99a0-5406e6c135a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:44.000825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93332cea-6639-4c3b-99a0-5406e6c135a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.001112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93332cea-6639-4c3b-99a0-5406e6c135a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.001372 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93332cea-6639-4c3b-99a0-5406e6c135a0 admin admin] PATH_INFO: `/v3/users/926453aa34184ae6a9d16060788ce0e5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.002632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93332cea-6639-4c3b-99a0-5406e6c135a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926453aa34184ae6a9d16060788ce0e5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:44.004981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93332cea-6639-4c3b-99a0-5406e6c135a0 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:44.183806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-93332cea-6639-4c3b-99a0-5406e6c135a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926453aa34184ae6a9d16060788ce0e5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:44.271941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-93332cea-6639-4c3b-99a0-5406e6c135a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926453aa34184ae6a9d16060788ce0e5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:44.279761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-93332cea-6639-4c3b-99a0-5406e6c135a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926453aa34184ae6a9d16060788ce0e5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:44.282096 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-93332cea-6639-4c3b-99a0-5406e6c135a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926453aa34184ae6a9d16060788ce0e5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:44.294443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-93332cea-6639-4c3b-99a0-5406e6c135a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926453aa34184ae6a9d16060788ce0e5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:44.303147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1231/2463] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:01:43 2022] DELETE /identity/v3/users/926453aa34184ae6a9d16060788ce0e5 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:44.406751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:44.408923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:44.467682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63b096-1bbb-456d-978a-85d35c81f967 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:44.526706 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c3690-3986-45c2-924a-e702aa6165f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:44.526706 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3690-3986-45c2-924a-e702aa6165f9 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.527221 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3690-3986-45c2-924a-e702aa6165f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.527615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3690-3986-45c2-924a-e702aa6165f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.529645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d66c3690-3986-45c2-924a-e702aa6165f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:44.609506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c3690-3986-45c2-924a-e702aa6165f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:44.611859 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c3690-3986-45c2-924a-e702aa6165f9 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:44.623831 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1233/2464] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:44.798821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b660692-0072-4333-9276-bc487ac0655f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.799128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b660692-0072-4333-9276-bc487ac0655f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.799398 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b660692-0072-4333-9276-bc487ac0655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.820720 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5b660692-0072-4333-9276-bc487ac0655f None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:44.825279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5b660692-0072-4333-9276-bc487ac0655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:44.845754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c3690-3986-45c2-924a-e702aa6165f9 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:44.847359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d66c3690-3986-45c2-924a-e702aa6165f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:44.868054 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c3690-3986-45c2-924a-e702aa6165f9 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:44.876870 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf6341-426d-4aba-8f0e-57114a7fe69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:44.879150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf6341-426d-4aba-8f0e-57114a7fe69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.879439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf6341-426d-4aba-8f0e-57114a7fe69e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.882731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf6341-426d-4aba-8f0e-57114a7fe69e admin admin] PATH_INFO: `/v3/projects/3b7166ea5b594c1a914f9a0e2cd4dc80` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.882731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf6341-426d-4aba-8f0e-57114a7fe69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7166ea5b594c1a914f9a0e2cd4dc80)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:44.883846 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf6341-426d-4aba-8f0e-57114a7fe69e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:44.915057 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1232/2465] 10.222.0.73 () {58 vars in 1009 bytes} [Tue Aug 30 00:01:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:44.928007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b660692-0072-4333-9276-bc487ac0655f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:44.929947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5b660692-0072-4333-9276-bc487ac0655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:44.980365 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:44.992390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bebf6341-426d-4aba-8f0e-57114a7fe69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7166ea5b594c1a914f9a0e2cd4dc80', 'request_id': 'req-bebf6341-426d-4aba-8f0e-57114a7fe69e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:44.997153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:45.003758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bebf6341-426d-4aba-8f0e-57114a7fe69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7166ea5b594c1a914f9a0e2cd4dc80', 'request_id': 'req-bebf6341-426d-4aba-8f0e-57114a7fe69e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:45.008466 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b660692-0072-4333-9276-bc487ac0655f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.069651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc21d1b-59c5-4ae9-a094-2947860ad472 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.070187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc21d1b-59c5-4ae9-a094-2947860ad472 service swift] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.070468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc21d1b-59c5-4ae9-a094-2947860ad472 service swift] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.070782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc21d1b-59c5-4ae9-a094-2947860ad472 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.089177 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bebf6341-426d-4aba-8f0e-57114a7fe69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7166ea5b594c1a914f9a0e2cd4dc80', 'request_id': 'req-bebf6341-426d-4aba-8f0e-57114a7fe69e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:45.102520 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bebf6341-426d-4aba-8f0e-57114a7fe69e admin admin] The token cache is being invalidate because project 3b7166ea5b594c1a914f9a0e2cd4dc80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:01:45.102912 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bebf6341-426d-4aba-8f0e-57114a7fe69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:45.110279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bebf6341-426d-4aba-8f0e-57114a7fe69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:45.110279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1234/2466] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:01:44 2022] DELETE /identity/v3/projects/3b7166ea5b594c1a914f9a0e2cd4dc80 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:01:45.112278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dc187-b0a1-4b90-9a10-5685efbf48cf None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.112676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dc187-b0a1-4b90-9a10-5685efbf48cf None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.113021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dc187-b0a1-4b90-9a10-5685efbf48cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.135204 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-5e4dc187-b0a1-4b90-9a10-5685efbf48cf None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:45.136510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5e4dc187-b0a1-4b90-9a10-5685efbf48cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:45.137806 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc21d1b-59c5-4ae9-a094-2947860ad472 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.139487 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc21d1b-59c5-4ae9-a094-2947860ad472 service swift] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.148382 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1233/2467] 10.222.0.73 () {60 vars in 1384 bytes} [Tue Aug 30 00:01:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 00:01:45.204865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1235/2468] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:01:45.213034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd457e-c231-4805-bcb9-bb0904d5ae35 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.215958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd457e-c231-4805-bcb9-bb0904d5ae35 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.215958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd457e-c231-4805-bcb9-bb0904d5ae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.232861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-eefd457e-c231-4805-bcb9-bb0904d5ae35 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:45.239081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-eefd457e-c231-4805-bcb9-bb0904d5ae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:45.243432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1234/2469] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:45.247949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dc187-b0a1-4b90-9a10-5685efbf48cf None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.264677 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dc187-b0a1-4b90-9a10-5685efbf48cf None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.271276 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115f440-17df-4e73-9c86-1b559440a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.272354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115f440-17df-4e73-9c86-1b559440a301 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.273075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115f440-17df-4e73-9c86-1b559440a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.273430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115f440-17df-4e73-9c86-1b559440a301 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.275979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115f440-17df-4e73-9c86-1b559440a301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:45.276361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115f440-17df-4e73-9c86-1b559440a301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.278817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115f440-17df-4e73-9c86-1b559440a301 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.301550 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1236/2470] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:45.302873 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd457e-c231-4805-bcb9-bb0904d5ae35 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.314947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd457e-c231-4805-bcb9-bb0904d5ae35 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.322654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3519d-e928-420d-98b9-b3aef69573dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.323078 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3519d-e928-420d-98b9-b3aef69573dc admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.323598 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3519d-e928-420d-98b9-b3aef69573dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.323835 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3519d-e928-420d-98b9-b3aef69573dc admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.325539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3519d-e928-420d-98b9-b3aef69573dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.327624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3519d-e928-420d-98b9-b3aef69573dc admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.420836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1235/2471] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:01:45 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:45.425623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115f440-17df-4e73-9c86-1b559440a301 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.436991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115f440-17df-4e73-9c86-1b559440a301 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.534046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a4e10-9d4a-4930-bbd6-a5a2278d11cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.534975 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a4e10-9d4a-4930-bbd6-a5a2278d11cc admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.535436 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a4e10-9d4a-4930-bbd6-a5a2278d11cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.535861 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a4e10-9d4a-4930-bbd6-a5a2278d11cc admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.536802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a4e10-9d4a-4930-bbd6-a5a2278d11cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.539452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a4e10-9d4a-4930-bbd6-a5a2278d11cc admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.665809 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3519d-e928-420d-98b9-b3aef69573dc admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.672066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1237/2472] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:01:45 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:45.680657 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3519d-e928-420d-98b9-b3aef69573dc admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.686401 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2649e-099c-4003-bd45-278a225b2393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.687341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2649e-099c-4003-bd45-278a225b2393 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.687778 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2649e-099c-4003-bd45-278a225b2393 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.688227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2649e-099c-4003-bd45-278a225b2393 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.689588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2649e-099c-4003-bd45-278a225b2393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.691429 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2649e-099c-4003-bd45-278a225b2393 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.719636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a4e10-9d4a-4930-bbd6-a5a2278d11cc admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.720076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1236/2473] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:01:45.748048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a4e10-9d4a-4930-bbd6-a5a2278d11cc admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.758042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaefe5-f558-44be-aa44-8e6a284248fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.758625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaefe5-f558-44be-aa44-8e6a284248fc admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.758945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaefe5-f558-44be-aa44-8e6a284248fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.759360 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaefe5-f558-44be-aa44-8e6a284248fc admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.760016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaefe5-f558-44be-aa44-8e6a284248fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.761651 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaefe5-f558-44be-aa44-8e6a284248fc admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.783791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1238/2474] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:01:45.785578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2649e-099c-4003-bd45-278a225b2393 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.796255 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2649e-099c-4003-bd45-278a225b2393 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.802025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ea273-c5b6-4043-9eaa-3e5352f139e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.802703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea273-c5b6-4043-9eaa-3e5352f139e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.803017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea273-c5b6-4043-9eaa-3e5352f139e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.803639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea273-c5b6-4043-9eaa-3e5352f139e0 admin admin] PATH_INFO: `/v3/projects/1dc61eba26fa4e2f9396500a1e14fdf2/users/96bd8116da8d4fbaa66a9c1606486fdb/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.827519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ea273-c5b6-4043-9eaa-3e5352f139e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc61eba26fa4e2f9396500a1e14fdf2, user_id=96bd8116da8d4fbaa66a9c1606486fdb, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.830462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ea273-c5b6-4043-9eaa-3e5352f139e0 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.901129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1237/2475] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:45 2022] PUT /identity/v3/projects/1dc61eba26fa4e2f9396500a1e14fdf2/users/96bd8116da8d4fbaa66a9c1606486fdb/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:45.904578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f6dbc-626b-4af7-837a-0d5adf2eadf7 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.904865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f6dbc-626b-4af7-837a-0d5adf2eadf7 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.905136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f6dbc-626b-4af7-837a-0d5adf2eadf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.947592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-564f6dbc-626b-4af7-837a-0d5adf2eadf7 None None] MFA Rules not processed for user `96bd8116da8d4fbaa66a9c1606486fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:45.949385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-564f6dbc-626b-4af7-837a-0d5adf2eadf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:46.030615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:46.099746 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1239/2476] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:46.100706 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ea273-c5b6-4043-9eaa-3e5352f139e0 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.132651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:46.197186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ea273-c5b6-4043-9eaa-3e5352f139e0 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.202451 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd53678-d94a-4f63-86f9-c33524192394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.203134 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd53678-d94a-4f63-86f9-c33524192394 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.203416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd53678-d94a-4f63-86f9-c33524192394 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.203742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd53678-d94a-4f63-86f9-c33524192394 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.205367 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd53678-d94a-4f63-86f9-c33524192394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.207636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd53678-d94a-4f63-86f9-c33524192394 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.302600 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1238/2477] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:01:46 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:46.306662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f6dbc-626b-4af7-837a-0d5adf2eadf7 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.321425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f6dbc-626b-4af7-837a-0d5adf2eadf7 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.404744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92212761-c28c-4dc8-8ede-955e90c69fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.405685 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92212761-c28c-4dc8-8ede-955e90c69fce admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.406070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92212761-c28c-4dc8-8ede-955e90c69fce admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.406446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92212761-c28c-4dc8-8ede-955e90c69fce admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.408734 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92212761-c28c-4dc8-8ede-955e90c69fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.412375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92212761-c28c-4dc8-8ede-955e90c69fce admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.504660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1240/2478] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:01:46 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:46.506724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd53678-d94a-4f63-86f9-c33524192394 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.524900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd53678-d94a-4f63-86f9-c33524192394 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.535947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0c814-e486-4eff-8d15-2a1ebc8f4fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.536580 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0c814-e486-4eff-8d15-2a1ebc8f4fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.536865 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0c814-e486-4eff-8d15-2a1ebc8f4fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.537141 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0c814-e486-4eff-8d15-2a1ebc8f4fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.537800 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0c814-e486-4eff-8d15-2a1ebc8f4fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.539434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0c814-e486-4eff-8d15-2a1ebc8f4fa8 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.564079 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1239/2479] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:01:46.565643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92212761-c28c-4dc8-8ede-955e90c69fce admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.582435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92212761-c28c-4dc8-8ede-955e90c69fce admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.607947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd7ca7-f9b5-47ab-96ad-a48d20d061cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.608962 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd7ca7-f9b5-47ab-96ad-a48d20d061cc admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.609390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd7ca7-f9b5-47ab-96ad-a48d20d061cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.609845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd7ca7-f9b5-47ab-96ad-a48d20d061cc admin admin] PATH_INFO: `/v3/projects/007d11d97dee44649e92eb1e2ad8cb14/users/7677023c1bda465e85280f0b4ef46793/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.646627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd7ca7-f9b5-47ab-96ad-a48d20d061cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=007d11d97dee44649e92eb1e2ad8cb14, user_id=7677023c1bda465e85280f0b4ef46793, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.649673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd7ca7-f9b5-47ab-96ad-a48d20d061cc admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.745163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1241/2480] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:46 2022] PUT /identity/v3/projects/007d11d97dee44649e92eb1e2ad8cb14/users/7677023c1bda465e85280f0b4ef46793/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:46.749128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0c814-e486-4eff-8d15-2a1ebc8f4fa8 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.762587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0c814-e486-4eff-8d15-2a1ebc8f4fa8 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.852407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d860899-6943-4e21-9320-832f598f1fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.853962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d860899-6943-4e21-9320-832f598f1fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.855106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d860899-6943-4e21-9320-832f598f1fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.860173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d860899-6943-4e21-9320-832f598f1fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.860173 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d860899-6943-4e21-9320-832f598f1fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.860925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d860899-6943-4e21-9320-832f598f1fe7 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.873836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1240/2481] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:01:46.878195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd7ca7-f9b5-47ab-96ad-a48d20d061cc admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.893288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd7ca7-f9b5-47ab-96ad-a48d20d061cc admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.898186 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7cd18-2b8a-4f1f-9dac-9f78d3b84da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.898860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7cd18-2b8a-4f1f-9dac-9f78d3b84da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.899171 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7cd18-2b8a-4f1f-9dac-9f78d3b84da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.899476 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7cd18-2b8a-4f1f-9dac-9f78d3b84da1 admin admin] PATH_INFO: `/v3/projects/007d11d97dee44649e92eb1e2ad8cb14/users/7677023c1bda465e85280f0b4ef46793/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.901439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7cd18-2b8a-4f1f-9dac-9f78d3b84da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=007d11d97dee44649e92eb1e2ad8cb14, user_id=7677023c1bda465e85280f0b4ef46793, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.904201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7cd18-2b8a-4f1f-9dac-9f78d3b84da1 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.936774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1242/2482] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:46 2022] PUT /identity/v3/projects/007d11d97dee44649e92eb1e2ad8cb14/users/7677023c1bda465e85280f0b4ef46793/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:46.947211 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d591799-2916-4c4c-8982-b57b40d086b6 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.947633 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d591799-2916-4c4c-8982-b57b40d086b6 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.948029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d591799-2916-4c4c-8982-b57b40d086b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.984497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8d591799-2916-4c4c-8982-b57b40d086b6 None None] MFA Rules not processed for user `7677023c1bda465e85280f0b4ef46793`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:46.986739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8d591799-2916-4c4c-8982-b57b40d086b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:47.148712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1241/2483] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:47.162139 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7cd18-2b8a-4f1f-9dac-9f78d3b84da1 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:47.163921 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-66d7cd18-2b8a-4f1f-9dac-9f78d3b84da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:47.304577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7cd18-2b8a-4f1f-9dac-9f78d3b84da1 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:47.310076 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97253fab-6005-4b93-bc70-bc9147b405b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:47.313021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97253fab-6005-4b93-bc70-bc9147b405b7 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:47.313838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97253fab-6005-4b93-bc70-bc9147b405b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:47.314307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97253fab-6005-4b93-bc70-bc9147b405b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:47.340045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97253fab-6005-4b93-bc70-bc9147b405b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:47.341777 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97253fab-6005-4b93-bc70-bc9147b405b7 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:47.371597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1243/2484] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:48.679455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d591799-2916-4c4c-8982-b57b40d086b6 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:48.692813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d591799-2916-4c4c-8982-b57b40d086b6 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:48.704723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cc679-eca9-465a-8876-4738fa0560f5 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7677023c1bda465e85280f0b4ef46793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '007d11d97dee44649e92eb1e2ad8cb14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:48.707294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cc679-eca9-465a-8876-4738fa0560f5 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:48.707294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cc679-eca9-465a-8876-4738fa0560f5 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:48.707294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cc679-eca9-465a-8876-4738fa0560f5 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:48.707294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cc679-eca9-465a-8876-4738fa0560f5 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:48.711137 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cc679-eca9-465a-8876-4738fa0560f5 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:48.725162 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cc679-eca9-465a-8876-4738fa0560f5 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:48.758281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1242/2485] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:48.759135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97253fab-6005-4b93-bc70-bc9147b405b7 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:48.792503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97253fab-6005-4b93-bc70-bc9147b405b7 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:48.810239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d143d53-029f-491d-bca0-67e0d836fb39 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7677023c1bda465e85280f0b4ef46793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '007d11d97dee44649e92eb1e2ad8cb14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:48.810967 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d143d53-029f-491d-bca0-67e0d836fb39 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:48.811315 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d143d53-029f-491d-bca0-67e0d836fb39 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:48.811596 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d143d53-029f-491d-bca0-67e0d836fb39 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:48.813074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d143d53-029f-491d-bca0-67e0d836fb39 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:48.816597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d143d53-029f-491d-bca0-67e0d836fb39 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:48.971607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1244/2486] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:01:48 2022] POST /identity/v3/projects => generated 352 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:01:48.975822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cc679-eca9-465a-8876-4738fa0560f5 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:48.981298 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:48.987105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cc679-eca9-465a-8876-4738fa0560f5 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:49.108213 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1efdb-aa45-48e0-abd4-61a8e59909a3 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7677023c1bda465e85280f0b4ef46793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '007d11d97dee44649e92eb1e2ad8cb14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:49.109115 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1efdb-aa45-48e0-abd4-61a8e59909a3 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.109405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1efdb-aa45-48e0-abd4-61a8e59909a3 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.109717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1efdb-aa45-48e0-abd4-61a8e59909a3 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.110486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1efdb-aa45-48e0-abd4-61a8e59909a3 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:49.110800 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1efdb-aa45-48e0-abd4-61a8e59909a3 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:49.112470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1efdb-aa45-48e0-abd4-61a8e59909a3 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:49.151010 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1243/2487] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:49.190316 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d143d53-029f-491d-bca0-67e0d836fb39 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:49.211711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d143d53-029f-491d-bca0-67e0d836fb39 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:49.224647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7677023c1bda465e85280f0b4ef46793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '007d11d97dee44649e92eb1e2ad8cb14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:49.225350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.230552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.230552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] PATH_INFO: `/v3/projects/6a0de3c105a84185a4f9a5cbd7c37504` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.230552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6a0de3c105a84185a4f9a5cbd7c37504)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:49.232392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:49.245246 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:49.430159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0de3c105a84185a4f9a5cbd7c37504', 'request_id': 'req-9b984417-bd7c-4cd1-823e-0571d70b0fc2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:49.447701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0de3c105a84185a4f9a5cbd7c37504', 'request_id': 'req-9b984417-bd7c-4cd1-823e-0571d70b0fc2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:49.540718 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0de3c105a84185a4f9a5cbd7c37504', 'request_id': 'req-9b984417-bd7c-4cd1-823e-0571d70b0fc2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:49.554674 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] The token cache is being invalidate because project 6a0de3c105a84185a4f9a5cbd7c37504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:01:49.555107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:49.555751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:49.558957 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d4a6c-d482-4d7d-886d-8dd528449af8 None None] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.558957 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d4a6c-d482-4d7d-886d-8dd528449af8 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.559205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d4a6c-d482-4d7d-886d-8dd528449af8 None None] PATH_INFO: `/` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.560703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1244/2488] 10.222.0.73 () {54 vars in 921 bytes} [Tue Aug 30 00:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:49.565475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1245/2489] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:01:49 2022] DELETE /identity/v3/projects/6a0de3c105a84185a4f9a5cbd7c37504 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:49.604272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde04d5-3255-470c-a38f-5a6ec461357c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.604554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde04d5-3255-470c-a38f-5a6ec461357c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.604821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde04d5-3255-470c-a38f-5a6ec461357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.638642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-2bde04d5-3255-470c-a38f-5a6ec461357c None None] MFA Rules not processed for user `ce79452e14fa4984875dca43672ed25a`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:49.640344 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2bde04d5-3255-470c-a38f-5a6ec461357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:49.723541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1245/2490] 10.222.0.73 () {58 vars in 1018 bytes} [Tue Aug 30 00:01:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:49.738732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:49.740226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:49.749870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde04d5-3255-470c-a38f-5a6ec461357c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:49.758497 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2bde04d5-3255-470c-a38f-5a6ec461357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:49.788514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde04d5-3255-470c-a38f-5a6ec461357c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:49.796589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4090c6-4ec1-4a48-995d-4e4db3ca659f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:49.797564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4090c6-4ec1-4a48-995d-4e4db3ca659f service placement] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.801067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4090c6-4ec1-4a48-995d-4e4db3ca659f service placement] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.801067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4090c6-4ec1-4a48-995d-4e4db3ca659f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.809031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4090c6-4ec1-4a48-995d-4e4db3ca659f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:49.810761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4090c6-4ec1-4a48-995d-4e4db3ca659f service placement] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:49.822803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1246/2491] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:49.885413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b984417-bd7c-4cd1-823e-0571d70b0fc2 tempest-VolumeQuotaClassesTest-380201682 tempest-VolumeQuotaClassesTest-380201682-project-admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:49.902960 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:49.903807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.904189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.905102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] PATH_INFO: `/v3/users/4ebb392ea86a4ce9b14b619ad59e16ac` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.906700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ebb392ea86a4ce9b14b619ad59e16ac)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:49.910685 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:50.216931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ebb392ea86a4ce9b14b619ad59e16ac'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:50.231626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ebb392ea86a4ce9b14b619ad59e16ac'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:50.244423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ebb392ea86a4ce9b14b619ad59e16ac'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:50.245209 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ebb392ea86a4ce9b14b619ad59e16ac'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:50.245925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ebb392ea86a4ce9b14b619ad59e16ac'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:50.338909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1246/2492] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:01:49 2022] DELETE /identity/v3/users/4ebb392ea86a4ce9b14b619ad59e16ac => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:50.455573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4090c6-4ec1-4a48-995d-4e4db3ca659f service placement] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:50.459778 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7f4090c6-4ec1-4a48-995d-4e4db3ca659f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:50.481868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4090c6-4ec1-4a48-995d-4e4db3ca659f service placement] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:50.554830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbf994-0223-4937-b299-6319008de342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:50.555587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbf994-0223-4937-b299-6319008de342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:50.555992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbf994-0223-4937-b299-6319008de342 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:50.556217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbf994-0223-4937-b299-6319008de342 admin admin] PATH_INFO: `/v3/users/96bd8116da8d4fbaa66a9c1606486fdb` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:50.557460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbf994-0223-4937-b299-6319008de342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96bd8116da8d4fbaa66a9c1606486fdb)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:50.559532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbf994-0223-4937-b299-6319008de342 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:50.577000 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:50.578554 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:50.586957 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:50.604819 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6817ee-59c2-40dd-90ba-13594995b122 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:50.612693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e62998-d629-4326-ae69-1ac55a1e01b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:50.613365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e62998-d629-4326-ae69-1ac55a1e01b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:50.613649 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e62998-d629-4326-ae69-1ac55a1e01b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:50.613931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e62998-d629-4326-ae69-1ac55a1e01b3 admin admin] PATH_INFO: `/v3/projects/0c7905da8a584914ada654260ee54d98` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:50.615252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e62998-d629-4326-ae69-1ac55a1e01b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7905da8a584914ada654260ee54d98)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:50.617204 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e62998-d629-4326-ae69-1ac55a1e01b3 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:50.634352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:50.745757 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-12cbf994-0223-4937-b299-6319008de342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96bd8116da8d4fbaa66a9c1606486fdb'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:50.760069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-c3e62998-d629-4326-ae69-1ac55a1e01b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7905da8a584914ada654260ee54d98', 'request_id': 'req-c3e62998-d629-4326-ae69-1ac55a1e01b3'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:50.765862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-c3e62998-d629-4326-ae69-1ac55a1e01b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7905da8a584914ada654260ee54d98', 'request_id': 'req-c3e62998-d629-4326-ae69-1ac55a1e01b3'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:51.648104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-12cbf994-0223-4937-b299-6319008de342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96bd8116da8d4fbaa66a9c1606486fdb'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:51.656525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-12cbf994-0223-4937-b299-6319008de342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96bd8116da8d4fbaa66a9c1606486fdb'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:51.657285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-12cbf994-0223-4937-b299-6319008de342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96bd8116da8d4fbaa66a9c1606486fdb'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:51.670489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-12cbf994-0223-4937-b299-6319008de342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96bd8116da8d4fbaa66a9c1606486fdb'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:51.677538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1247/2493] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:01:50 2022] DELETE /identity/v3/users/96bd8116da8d4fbaa66a9c1606486fdb => generated 0 bytes in 1223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:51.681918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75c2dc-1f77-47a3-9965-9a12323103bc None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.682212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75c2dc-1f77-47a3-9965-9a12323103bc None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.682491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75c2dc-1f77-47a3-9965-9a12323103bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.708317 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8a75c2dc-1f77-47a3-9965-9a12323103bc None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:51.709791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8a75c2dc-1f77-47a3-9965-9a12323103bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:51.733904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-c3e62998-d629-4326-ae69-1ac55a1e01b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7905da8a584914ada654260ee54d98', 'request_id': 'req-c3e62998-d629-4326-ae69-1ac55a1e01b3'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:51.749855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-c3e62998-d629-4326-ae69-1ac55a1e01b3 admin admin] The token cache is being invalidate because project 0c7905da8a584914ada654260ee54d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:01:51.750477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-c3e62998-d629-4326-ae69-1ac55a1e01b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:51.752555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-c3e62998-d629-4326-ae69-1ac55a1e01b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:51.754764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1247/2494] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:01:50 2022] DELETE /identity/v3/projects/0c7905da8a584914ada654260ee54d98 => generated 0 bytes in 1179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:51.760461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43025f6c-9556-42bc-8b53-2b44c9c5e611 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.774403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43025f6c-9556-42bc-8b53-2b44c9c5e611 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.774403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43025f6c-9556-42bc-8b53-2b44c9c5e611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.774755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1248/2495] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:01:51.785110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75c2dc-1f77-47a3-9965-9a12323103bc None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:51.786486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8a75c2dc-1f77-47a3-9965-9a12323103bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:51.790574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-43025f6c-9556-42bc-8b53-2b44c9c5e611 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:51.792642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-43025f6c-9556-42bc-8b53-2b44c9c5e611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:51.803686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1248/2496] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:01:51.816277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7236a6f-f8bc-4997-9599-9bc96738a1e6 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.816564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7236a6f-f8bc-4997-9599-9bc96738a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.816836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7236a6f-f8bc-4997-9599-9bc96738a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.837325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e7236a6f-f8bc-4997-9599-9bc96738a1e6 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:51.838659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e7236a6f-f8bc-4997-9599-9bc96738a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:51.848894 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1249/2497] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:01:51.854181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7236a6f-f8bc-4997-9599-9bc96738a1e6 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:51.857859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75c2dc-1f77-47a3-9965-9a12323103bc None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:51.875034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da8f17-e41c-4eb6-bdd3-f27a422da18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:51.875034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da8f17-e41c-4eb6-bdd3-f27a422da18d service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.875034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da8f17-e41c-4eb6-bdd3-f27a422da18d service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.875034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da8f17-e41c-4eb6-bdd3-f27a422da18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.875468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7236a6f-f8bc-4997-9599-9bc96738a1e6 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:51.875571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da8f17-e41c-4eb6-bdd3-f27a422da18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:51.875571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da8f17-e41c-4eb6-bdd3-f27a422da18d service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:51.878546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69e4c2-ef69-4ad1-81eb-c50b6b0d7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:51.879312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69e4c2-ef69-4ad1-81eb-c50b6b0d7138 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.879695 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69e4c2-ef69-4ad1-81eb-c50b6b0d7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.880067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69e4c2-ef69-4ad1-81eb-c50b6b0d7138 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.880796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69e4c2-ef69-4ad1-81eb-c50b6b0d7138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:51.881169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69e4c2-ef69-4ad1-81eb-c50b6b0d7138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:51.882936 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69e4c2-ef69-4ad1-81eb-c50b6b0d7138 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:51.885225 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1249/2498] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:01:51.896574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1250/2499] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:51.900949 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da8f17-e41c-4eb6-bdd3-f27a422da18d service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:51.912552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da8f17-e41c-4eb6-bdd3-f27a422da18d service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:51.917683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff96c3-7ec5-4c57-b95b-8ca374bca22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:51.918327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff96c3-7ec5-4c57-b95b-8ca374bca22c admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.920795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff96c3-7ec5-4c57-b95b-8ca374bca22c admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.920795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff96c3-7ec5-4c57-b95b-8ca374bca22c admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.920795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff96c3-7ec5-4c57-b95b-8ca374bca22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:51.921526 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff96c3-7ec5-4c57-b95b-8ca374bca22c admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.062933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1250/2500] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:01:51 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:01:52.067823 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69e4c2-ef69-4ad1-81eb-c50b6b0d7138 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.078160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69e4c2-ef69-4ad1-81eb-c50b6b0d7138 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:52.193080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8ceac-9d07-47f3-8f9f-8953a16f5fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:52.194495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8ceac-9d07-47f3-8f9f-8953a16f5fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.194772 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8ceac-9d07-47f3-8f9f-8953a16f5fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.195070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8ceac-9d07-47f3-8f9f-8953a16f5fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.195794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8ceac-9d07-47f3-8f9f-8953a16f5fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:52.198019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8ceac-9d07-47f3-8f9f-8953a16f5fd3 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.325071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1251/2501] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:01:52 2022] POST /identity/v3/users => generated 303 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:52.329841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff96c3-7ec5-4c57-b95b-8ca374bca22c admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.350334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff96c3-7ec5-4c57-b95b-8ca374bca22c admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:52.355103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb8265-36b9-4898-97c0-0509ec56263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:52.355724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb8265-36b9-4898-97c0-0509ec56263e admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.356025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb8265-36b9-4898-97c0-0509ec56263e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.356364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb8265-36b9-4898-97c0-0509ec56263e admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.356985 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb8265-36b9-4898-97c0-0509ec56263e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:52.359755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb8265-36b9-4898-97c0-0509ec56263e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.376216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1251/2502] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:01:52.380188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8ceac-9d07-47f3-8f9f-8953a16f5fd3 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.392990 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8ceac-9d07-47f3-8f9f-8953a16f5fd3 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:52.399682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eaeab-cf37-4420-8de7-d03cfa0bbb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:52.400413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eaeab-cf37-4420-8de7-d03cfa0bbb2f admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.400769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eaeab-cf37-4420-8de7-d03cfa0bbb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.401112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eaeab-cf37-4420-8de7-d03cfa0bbb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.401844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6eaeab-cf37-4420-8de7-d03cfa0bbb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:52.407631 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6eaeab-cf37-4420-8de7-d03cfa0bbb2f admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.420583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1252/2503] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:01:52.425380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb8265-36b9-4898-97c0-0509ec56263e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.437778 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb8265-36b9-4898-97c0-0509ec56263e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:52.446854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6da9dd-b858-4d63-a771-c634d4d08ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:52.447656 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6da9dd-b858-4d63-a771-c634d4d08ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.448282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6da9dd-b858-4d63-a771-c634d4d08ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.448556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6da9dd-b858-4d63-a771-c634d4d08ec2 admin admin] PATH_INFO: `/v3/projects/fa059ffed5e04057891898402f0674d0/users/568f267cadcf4cd28ea1644c2e838d4b/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.452756 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:52.468543 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eaeab-cf37-4420-8de7-d03cfa0bbb2f admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.472272 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-de6eaeab-cf37-4420-8de7-d03cfa0bbb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:52.474906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6da9dd-b858-4d63-a771-c634d4d08ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa059ffed5e04057891898402f0674d0, user_id=568f267cadcf4cd28ea1644c2e838d4b, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:52.478642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6da9dd-b858-4d63-a771-c634d4d08ec2 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.495279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eaeab-cf37-4420-8de7-d03cfa0bbb2f admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:52.508070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:52.508976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.509263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.509663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] PATH_INFO: `/v3/projects/1dc61eba26fa4e2f9396500a1e14fdf2` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.511288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc61eba26fa4e2f9396500a1e14fdf2)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:52.513471 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.564088 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1252/2504] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:52 2022] PUT /identity/v3/projects/fa059ffed5e04057891898402f0674d0/users/568f267cadcf4cd28ea1644c2e838d4b/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:01:52.570265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5a14c-20fd-4180-9ae4-451e20b38bb0 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.570739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5a14c-20fd-4180-9ae4-451e20b38bb0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.571036 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5a14c-20fd-4180-9ae4-451e20b38bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.591682 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-53c5a14c-20fd-4180-9ae4-451e20b38bb0 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:52.595206 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-53c5a14c-20fd-4180-9ae4-451e20b38bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:52.658594 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1253/2505] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:52.663770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:52.668209 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5a14c-20fd-4180-9ae4-451e20b38bb0 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.670968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc61eba26fa4e2f9396500a1e14fdf2', 'request_id': 'req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:52.680544 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc61eba26fa4e2f9396500a1e14fdf2', 'request_id': 'req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:52.735050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5a14c-20fd-4180-9ae4-451e20b38bb0 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:52.770166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc61eba26fa4e2f9396500a1e14fdf2', 'request_id': 'req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:52.786559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] The token cache is being invalidate because project 1dc61eba26fa4e2f9396500a1e14fdf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:01:52.786996 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:52.791039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:52.791039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1253/2506] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:01:52 2022] DELETE /identity/v3/projects/1dc61eba26fa4e2f9396500a1e14fdf2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:52.794065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.795716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:52.796330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050d156-442a-4173-856f-6f07fe0b0977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:52.797056 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d156-442a-4173-856f-6f07fe0b0977 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.797360 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d156-442a-4173-856f-6f07fe0b0977 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.797750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d156-442a-4173-856f-6f07fe0b0977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.799627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0050d156-442a-4173-856f-6f07fe0b0977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:52.867303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:52.881618 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050d156-442a-4173-856f-6f07fe0b0977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:52.881877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ee61f-cd2f-4fcb-98dd-db4f803e2778 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:52.883789 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050d156-442a-4173-856f-6f07fe0b0977 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.886792 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b1e85-36cb-4a59-91ea-a8ca93e5fe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:52.887670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b1e85-36cb-4a59-91ea-a8ca93e5fe04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.887951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b1e85-36cb-4a59-91ea-a8ca93e5fe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.888343 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b1e85-36cb-4a59-91ea-a8ca93e5fe04 admin admin] PATH_INFO: `/v3/users/7677023c1bda465e85280f0b4ef46793` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.889878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b1e85-36cb-4a59-91ea-a8ca93e5fe04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7677023c1bda465e85280f0b4ef46793)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:52.892761 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b1e85-36cb-4a59-91ea-a8ca93e5fe04 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.904846 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1254/2507] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:53.127392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0a8b1e85-36cb-4a59-91ea-a8ca93e5fe04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7677023c1bda465e85280f0b4ef46793'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:53.140183 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0a8b1e85-36cb-4a59-91ea-a8ca93e5fe04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7677023c1bda465e85280f0b4ef46793'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:53.148253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0a8b1e85-36cb-4a59-91ea-a8ca93e5fe04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7677023c1bda465e85280f0b4ef46793'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:53.149723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0a8b1e85-36cb-4a59-91ea-a8ca93e5fe04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7677023c1bda465e85280f0b4ef46793'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:53.150632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0a8b1e85-36cb-4a59-91ea-a8ca93e5fe04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7677023c1bda465e85280f0b4ef46793'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:53.222326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1254/2508] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:01:52 2022] DELETE /identity/v3/users/7677023c1bda465e85280f0b4ef46793 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:01:53.920814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050d156-442a-4173-856f-6f07fe0b0977 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:53.931323 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050d156-442a-4173-856f-6f07fe0b0977 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:53.997618 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:53.998169 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.998446 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.998718 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4 admin admin] PATH_INFO: `/v3/projects/007d11d97dee44649e92eb1e2ad8cb14` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.999874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=007d11d97dee44649e92eb1e2ad8cb14)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.001859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.116428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007d11d97dee44649e92eb1e2ad8cb14', 'request_id': 'req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:54.121981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007d11d97dee44649e92eb1e2ad8cb14', 'request_id': 'req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:54.128485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007d11d97dee44649e92eb1e2ad8cb14', 'request_id': 'req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:54.197413 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4 admin admin] The token cache is being invalidate because project 007d11d97dee44649e92eb1e2ad8cb14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:01:54.197722 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:54.198355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2aaba004-ac2e-4a58-818e-87c79bdd9bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:54.199945 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1255/2509] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:01:53 2022] DELETE /identity/v3/projects/007d11d97dee44649e92eb1e2ad8cb14 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:01:54.205770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21768c-be29-45d9-aa15-925fddcafa0c None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.206291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21768c-be29-45d9-aa15-925fddcafa0c None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.206643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21768c-be29-45d9-aa15-925fddcafa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.227993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-bb21768c-be29-45d9-aa15-925fddcafa0c None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:54.229204 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bb21768c-be29-45d9-aa15-925fddcafa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:54.274467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:54.289814 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1255/2510] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:54.297548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c68f4-cfa3-4e5e-acad-202a62b398d1 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.297839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c68f4-cfa3-4e5e-acad-202a62b398d1 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.298153 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c68f4-cfa3-4e5e-acad-202a62b398d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.317955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-fa8c68f4-cfa3-4e5e-acad-202a62b398d1 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:54.320452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fa8c68f4-cfa3-4e5e-acad-202a62b398d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:54.336050 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1256/2511] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:54.340923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21768c-be29-45d9-aa15-925fddcafa0c None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.351731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21768c-be29-45d9-aa15-925fddcafa0c None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.356530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8aec1-1e0f-4d94-b7ed-9321dd70c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.357174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8aec1-1e0f-4d94-b7ed-9321dd70c28d admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.357439 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8aec1-1e0f-4d94-b7ed-9321dd70c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.357711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8aec1-1e0f-4d94-b7ed-9321dd70c28d admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.358396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8aec1-1e0f-4d94-b7ed-9321dd70c28d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:54.358763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8aec1-1e0f-4d94-b7ed-9321dd70c28d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.360450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8aec1-1e0f-4d94-b7ed-9321dd70c28d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.373689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1256/2512] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:54.378952 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c68f4-cfa3-4e5e-acad-202a62b398d1 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.388876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c68f4-cfa3-4e5e-acad-202a62b398d1 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.394093 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23ecdf-868c-4c47-a873-f494c148493d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.405800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23ecdf-868c-4c47-a873-f494c148493d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.405961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087ca91-5bea-4107-a91f-b31f722104dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.406111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23ecdf-868c-4c47-a873-f494c148493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.406210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ca91-5bea-4107-a91f-b31f722104dc admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.406210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ca91-5bea-4107-a91f-b31f722104dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.406210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ca91-5bea-4107-a91f-b31f722104dc admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.406210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087ca91-5bea-4107-a91f-b31f722104dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.406210 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087ca91-5bea-4107-a91f-b31f722104dc admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.428911 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-cd23ecdf-868c-4c47-a873-f494c148493d None None] MFA Rules not processed for user `568f267cadcf4cd28ea1644c2e838d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:54.430226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cd23ecdf-868c-4c47-a873-f494c148493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:54.503302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1257/2513] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:54 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:54.503531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1257/2514] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:01:54 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:54.505676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23ecdf-868c-4c47-a873-f494c148493d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.507186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087ca91-5bea-4107-a91f-b31f722104dc admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.507708 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cd23ecdf-868c-4c47-a873-f494c148493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:54.523948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23ecdf-868c-4c47-a873-f494c148493d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.565554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:54.577553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087ca91-5bea-4107-a91f-b31f722104dc admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.583951 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c55d4-36cd-4b36-84ee-65f4e9c84653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.584829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c55d4-36cd-4b36-84ee-65f4e9c84653 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.585558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c55d4-36cd-4b36-84ee-65f4e9c84653 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.585915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c55d4-36cd-4b36-84ee-65f4e9c84653 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.586957 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c55d4-36cd-4b36-84ee-65f4e9c84653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.589005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c55d4-36cd-4b36-84ee-65f4e9c84653 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.592966 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535108e-63fe-4316-8880-e8ce4c4acf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.593587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535108e-63fe-4316-8880-e8ce4c4acf77 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.593868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535108e-63fe-4316-8880-e8ce4c4acf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.594142 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535108e-63fe-4316-8880-e8ce4c4acf77 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.594809 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535108e-63fe-4316-8880-e8ce4c4acf77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.596828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535108e-63fe-4316-8880-e8ce4c4acf77 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.700294 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1258/2515] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:01:54 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:54.703326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1258/2516] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:01:54 2022] POST /identity/v3/projects => generated 403 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:54.705392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c55d4-36cd-4b36-84ee-65f4e9c84653 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.707933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535108e-63fe-4316-8880-e8ce4c4acf77 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.717298 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c55d4-36cd-4b36-84ee-65f4e9c84653 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.777974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:54.791135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535108e-63fe-4316-8880-e8ce4c4acf77 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.796551 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22216529-f131-44e4-946b-8b318676b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.805823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ffaf7-b08b-448a-873e-bce440413c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.806268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22216529-f131-44e4-946b-8b318676b868 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.806268 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22216529-f131-44e4-946b-8b318676b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.806449 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ffaf7-b08b-448a-873e-bce440413c48 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.806548 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22216529-f131-44e4-946b-8b318676b868 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.806644 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ffaf7-b08b-448a-873e-bce440413c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.806644 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ffaf7-b08b-448a-873e-bce440413c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.806829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22216529-f131-44e4-946b-8b318676b868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.806956 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ffaf7-b08b-448a-873e-bce440413c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.806956 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ffaf7-b08b-448a-873e-bce440413c48 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.807143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22216529-f131-44e4-946b-8b318676b868 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.815298 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1259/2517] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:01:54.816228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ffaf7-b08b-448a-873e-bce440413c48 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.826779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ffaf7-b08b-448a-873e-bce440413c48 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.831831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42126d22-0dea-4132-ac33-7b43759545ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.834416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42126d22-0dea-4132-ac33-7b43759545ec admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.834416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42126d22-0dea-4132-ac33-7b43759545ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.834416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42126d22-0dea-4132-ac33-7b43759545ec admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.834416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42126d22-0dea-4132-ac33-7b43759545ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.835355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42126d22-0dea-4132-ac33-7b43759545ec admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.845046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1260/2518] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:01:54.849079 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42126d22-0dea-4132-ac33-7b43759545ec admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.858630 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42126d22-0dea-4132-ac33-7b43759545ec admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.863836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10538378-e65f-45e4-8158-c1de31b5ee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.864458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10538378-e65f-45e4-8158-c1de31b5ee67 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.864740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10538378-e65f-45e4-8158-c1de31b5ee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.865040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10538378-e65f-45e4-8158-c1de31b5ee67 admin admin] PATH_INFO: `/v3/projects/b77eb55e3503457a8e3da00d15b1a1b1/users/07668f21b1a846c88d3b7b0112b45930/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.880838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10538378-e65f-45e4-8158-c1de31b5ee67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77eb55e3503457a8e3da00d15b1a1b1, user_id=07668f21b1a846c88d3b7b0112b45930, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.883513 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10538378-e65f-45e4-8158-c1de31b5ee67 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.888732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1259/2519] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:01:54 2022] POST /identity/v3/users => generated 308 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:54.892719 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22216529-f131-44e4-946b-8b318676b868 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.902405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22216529-f131-44e4-946b-8b318676b868 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.907570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdffd3-5fd2-4aef-b870-cb42b9f5fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.908144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdffd3-5fd2-4aef-b870-cb42b9f5fae0 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.908422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdffd3-5fd2-4aef-b870-cb42b9f5fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.908692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdffd3-5fd2-4aef-b870-cb42b9f5fae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.909359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdffd3-5fd2-4aef-b870-cb42b9f5fae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.910969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdffd3-5fd2-4aef-b870-cb42b9f5fae0 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.921353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1260/2520] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:01:54.925775 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdffd3-5fd2-4aef-b870-cb42b9f5fae0 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.935506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdffd3-5fd2-4aef-b870-cb42b9f5fae0 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.940848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039d487-243c-46df-962d-1f4a01997f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.943468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039d487-243c-46df-962d-1f4a01997f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.943468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039d487-243c-46df-962d-1f4a01997f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.943468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039d487-243c-46df-962d-1f4a01997f4d admin admin] PATH_INFO: `/v3/projects/824562619c6c477d9904f9c939e8a94e/users/9490779137cf4838ad353c7c4ca60f78/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.956305 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039d487-243c-46df-962d-1f4a01997f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=824562619c6c477d9904f9c939e8a94e, user_id=9490779137cf4838ad353c7c4ca60f78, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.958945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039d487-243c-46df-962d-1f4a01997f4d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.968830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1261/2521] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:54 2022] PUT /identity/v3/projects/b77eb55e3503457a8e3da00d15b1a1b1/users/07668f21b1a846c88d3b7b0112b45930/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:01:54.980224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9a2ad-3f95-4cf7-85ce-f15b4c9fa57f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.980511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9a2ad-3f95-4cf7-85ce-f15b4c9fa57f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.980783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9a2ad-3f95-4cf7-85ce-f15b4c9fa57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.009272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-57f9a2ad-3f95-4cf7-85ce-f15b4c9fa57f None None] MFA Rules not processed for user `07668f21b1a846c88d3b7b0112b45930`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:55.010502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-57f9a2ad-3f95-4cf7-85ce-f15b4c9fa57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:55.026309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1261/2522] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:54 2022] PUT /identity/v3/projects/824562619c6c477d9904f9c939e8a94e/users/9490779137cf4838ad353c7c4ca60f78/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:01:55.030195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039d487-243c-46df-962d-1f4a01997f4d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.074387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1262/2523] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:55.079337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9a2ad-3f95-4cf7-85ce-f15b4c9fa57f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.093065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039d487-243c-46df-962d-1f4a01997f4d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.097941 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5259b-02bf-4fc3-8128-98653121c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.098626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5259b-02bf-4fc3-8128-98653121c12e admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.098979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5259b-02bf-4fc3-8128-98653121c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.099278 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5259b-02bf-4fc3-8128-98653121c12e admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.099922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5259b-02bf-4fc3-8128-98653121c12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.101516 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5259b-02bf-4fc3-8128-98653121c12e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.112172 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1262/2524] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:01:55.116222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5259b-02bf-4fc3-8128-98653121c12e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.117538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:55.126958 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5259b-02bf-4fc3-8128-98653121c12e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.131679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f4223-fa2c-4565-8ed1-c7e505222491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.132321 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f4223-fa2c-4565-8ed1-c7e505222491 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.132604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f4223-fa2c-4565-8ed1-c7e505222491 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.132879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f4223-fa2c-4565-8ed1-c7e505222491 admin admin] PATH_INFO: `/v3/projects/824562619c6c477d9904f9c939e8a94e/users/9490779137cf4838ad353c7c4ca60f78/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.134853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f4223-fa2c-4565-8ed1-c7e505222491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824562619c6c477d9904f9c939e8a94e, user_id=9490779137cf4838ad353c7c4ca60f78, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.137559 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f4223-fa2c-4565-8ed1-c7e505222491 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.145940 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9a2ad-3f95-4cf7-85ce-f15b4c9fa57f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.148200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1263/2525] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:55 2022] PUT /identity/v3/projects/824562619c6c477d9904f9c939e8a94e/users/9490779137cf4838ad353c7c4ca60f78/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:01:55.201995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663ff9f-61ab-4abb-b075-926b349e88d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.202604 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663ff9f-61ab-4abb-b075-926b349e88d1 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.202911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663ff9f-61ab-4abb-b075-926b349e88d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.203185 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663ff9f-61ab-4abb-b075-926b349e88d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.203846 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663ff9f-61ab-4abb-b075-926b349e88d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.205983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663ff9f-61ab-4abb-b075-926b349e88d1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.335777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1263/2526] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:01:55 2022] POST /identity/v3/projects => generated 379 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:55.339977 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f4223-fa2c-4565-8ed1-c7e505222491 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.355780 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f4223-fa2c-4565-8ed1-c7e505222491 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.417904 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c667b4-f25a-4fc7-8ba7-e4a78ffc972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.418514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c667b4-f25a-4fc7-8ba7-e4a78ffc972a admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.418790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c667b4-f25a-4fc7-8ba7-e4a78ffc972a admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.419088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c667b4-f25a-4fc7-8ba7-e4a78ffc972a admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.419702 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c667b4-f25a-4fc7-8ba7-e4a78ffc972a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.423096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c667b4-f25a-4fc7-8ba7-e4a78ffc972a admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.518848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1264/2527] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:01:55 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:55.520258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663ff9f-61ab-4abb-b075-926b349e88d1 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.534041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663ff9f-61ab-4abb-b075-926b349e88d1 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.543732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be43a6-f318-4622-8744-ca7c47719119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.543732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be43a6-f318-4622-8744-ca7c47719119 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.543732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be43a6-f318-4622-8744-ca7c47719119 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.543732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be43a6-f318-4622-8744-ca7c47719119 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.544207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be43a6-f318-4622-8744-ca7c47719119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.544207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be43a6-f318-4622-8744-ca7c47719119 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.558670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1264/2528] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:01:55.559956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c667b4-f25a-4fc7-8ba7-e4a78ffc972a admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.571668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c667b4-f25a-4fc7-8ba7-e4a78ffc972a admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.577277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74417b2-47c1-488f-9e62-6b9f0cc3c183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.577958 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74417b2-47c1-488f-9e62-6b9f0cc3c183 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.578280 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74417b2-47c1-488f-9e62-6b9f0cc3c183 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.579160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74417b2-47c1-488f-9e62-6b9f0cc3c183 admin admin] PATH_INFO: `/v3/projects/e103ad0ab82c460199eb8d54195c9ce8/users/f78f68ad0f9542a3905f6b12205aa006/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.596770 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74417b2-47c1-488f-9e62-6b9f0cc3c183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e103ad0ab82c460199eb8d54195c9ce8, user_id=f78f68ad0f9542a3905f6b12205aa006, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.601116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74417b2-47c1-488f-9e62-6b9f0cc3c183 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.603005 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:55.683689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1265/2529] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:55 2022] PUT /identity/v3/projects/e103ad0ab82c460199eb8d54195c9ce8/users/f78f68ad0f9542a3905f6b12205aa006/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:55.687981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be43a6-f318-4622-8744-ca7c47719119 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.698537 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be43a6-f318-4622-8744-ca7c47719119 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.768747 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b961e-9b79-437c-944b-9b2b7b77c3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.771354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b961e-9b79-437c-944b-9b2b7b77c3bf admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.771354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b961e-9b79-437c-944b-9b2b7b77c3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.771354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b961e-9b79-437c-944b-9b2b7b77c3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.771354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b961e-9b79-437c-944b-9b2b7b77c3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.772191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b961e-9b79-437c-944b-9b2b7b77c3bf admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.783059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1265/2530] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:01:55.787283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74417b2-47c1-488f-9e62-6b9f0cc3c183 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.800628 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74417b2-47c1-488f-9e62-6b9f0cc3c183 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.805573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5392c8-247b-4be9-b18d-6dd4518077b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.806194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5392c8-247b-4be9-b18d-6dd4518077b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.806475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5392c8-247b-4be9-b18d-6dd4518077b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.806789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5392c8-247b-4be9-b18d-6dd4518077b0 admin admin] PATH_INFO: `/v3/projects/e103ad0ab82c460199eb8d54195c9ce8/users/f78f68ad0f9542a3905f6b12205aa006/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.809097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5392c8-247b-4be9-b18d-6dd4518077b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e103ad0ab82c460199eb8d54195c9ce8, user_id=f78f68ad0f9542a3905f6b12205aa006, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.816441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5392c8-247b-4be9-b18d-6dd4518077b0 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.825069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1266/2531] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:55 2022] PUT /identity/v3/projects/e103ad0ab82c460199eb8d54195c9ce8/users/f78f68ad0f9542a3905f6b12205aa006/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:55.836567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf64f-8c60-4d34-909b-25dfa579916d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.836942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf64f-8c60-4d34-909b-25dfa579916d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.837312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf64f-8c60-4d34-909b-25dfa579916d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.875837 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-0bbdf64f-8c60-4d34-909b-25dfa579916d None None] MFA Rules not processed for user `f78f68ad0f9542a3905f6b12205aa006`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:55.877192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-0bbdf64f-8c60-4d34-909b-25dfa579916d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:55.929114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:55.960338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1266/2532] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:55.971365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5392c8-247b-4be9-b18d-6dd4518077b0 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.973230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7c5392c8-247b-4be9-b18d-6dd4518077b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:56.035767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5392c8-247b-4be9-b18d-6dd4518077b0 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:56.039501 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710520c-4adc-4d25-a29f-bb72283eb5c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:56.040166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710520c-4adc-4d25-a29f-bb72283eb5c9 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:56.040405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710520c-4adc-4d25-a29f-bb72283eb5c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:56.040681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710520c-4adc-4d25-a29f-bb72283eb5c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:56.050742 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710520c-4adc-4d25-a29f-bb72283eb5c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:56.052031 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710520c-4adc-4d25-a29f-bb72283eb5c9 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:56.062697 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1267/2533] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:56.549475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdf64f-8c60-4d34-909b-25dfa579916d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:56.612603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdf64f-8c60-4d34-909b-25dfa579916d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:56.617143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:56.617767 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:56.618041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:56.618316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] PATH_INFO: `/v3/users/07668f21b1a846c88d3b7b0112b45930` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:56.619472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] RBAC: Authorizing `identity:delete_user(user_id=07668f21b1a846c88d3b7b0112b45930)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:56.621421 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:56.758482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452fd3e-62e3-4a57-bdb7-9c7e5122c7b1 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:56.759116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452fd3e-62e3-4a57-bdb7-9c7e5122c7b1 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:56.759116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452fd3e-62e3-4a57-bdb7-9c7e5122c7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:56.789042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-3452fd3e-62e3-4a57-bdb7-9c7e5122c7b1 None None] MFA Rules not processed for user `9490779137cf4838ad353c7c4ca60f78`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:56.790413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-3452fd3e-62e3-4a57-bdb7-9c7e5122c7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:56.809622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07668f21b1a846c88d3b7b0112b45930'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:56.862659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1268/2534] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:56 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:56.887263 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07668f21b1a846c88d3b7b0112b45930'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:56.895358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07668f21b1a846c88d3b7b0112b45930'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:56.896029 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07668f21b1a846c88d3b7b0112b45930'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:56.908850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07668f21b1a846c88d3b7b0112b45930'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:56.915149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1267/2535] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:01:56 2022] DELETE /identity/v3/users/07668f21b1a846c88d3b7b0112b45930 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:56.919582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfd880-ebe2-4ea3-956b-82e4f0897887 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:56.919868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfd880-ebe2-4ea3-956b-82e4f0897887 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:56.920177 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfd880-ebe2-4ea3-956b-82e4f0897887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:56.940189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-c8dfd880-ebe2-4ea3-956b-82e4f0897887 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:56.941419 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c8dfd880-ebe2-4ea3-956b-82e4f0897887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:57.005464 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1269/2536] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:57.015269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:57.016856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:57.075403 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a7e50-3ba5-47fc-8a59-e9cf8eae708e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:57.079767 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65502de5-eb3a-4d52-bf6d-2d712fd98669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:57.080628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502de5-eb3a-4d52-bf6d-2d712fd98669 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:57.080900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502de5-eb3a-4d52-bf6d-2d712fd98669 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:57.081161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502de5-eb3a-4d52-bf6d-2d712fd98669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:57.090332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65502de5-eb3a-4d52-bf6d-2d712fd98669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:57.092468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65502de5-eb3a-4d52-bf6d-2d712fd98669 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:57.098386 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:57.106204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1268/2537] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:01:57.602150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfd880-ebe2-4ea3-956b-82e4f0897887 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:57.604167 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c8dfd880-ebe2-4ea3-956b-82e4f0897887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:57.617478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfd880-ebe2-4ea3-956b-82e4f0897887 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:57.622771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:57.623511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:57.623730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:57.624005 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] PATH_INFO: `/v3/projects/b77eb55e3503457a8e3da00d15b1a1b1` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:57.625230 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77eb55e3503457a8e3da00d15b1a1b1)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:57.628256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:57.644457 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:57.766825 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65502de5-eb3a-4d52-bf6d-2d712fd98669 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:57.775341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77eb55e3503457a8e3da00d15b1a1b1', 'request_id': 'req-889e6868-2205-4736-8027-f1d6eadb010d'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:57.776791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65502de5-eb3a-4d52-bf6d-2d712fd98669 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:57.781290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77eb55e3503457a8e3da00d15b1a1b1', 'request_id': 'req-889e6868-2205-4736-8027-f1d6eadb010d'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:57.827578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de1916-8a5c-4242-8098-131ed605af3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:57.828175 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de1916-8a5c-4242-8098-131ed605af3c service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:57.828469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de1916-8a5c-4242-8098-131ed605af3c service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:57.828740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de1916-8a5c-4242-8098-131ed605af3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:57.830723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-97de1916-8a5c-4242-8098-131ed605af3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:57.840014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de1916-8a5c-4242-8098-131ed605af3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:57.841405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de1916-8a5c-4242-8098-131ed605af3c service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:57.849489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1269/2538] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:01:57.865611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77eb55e3503457a8e3da00d15b1a1b1', 'request_id': 'req-889e6868-2205-4736-8027-f1d6eadb010d'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:57.878663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] The token cache is being invalidate because project b77eb55e3503457a8e3da00d15b1a1b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:01:57.879068 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:57.879788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:57.881430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1270/2539] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:01:57 2022] DELETE /identity/v3/projects/b77eb55e3503457a8e3da00d15b1a1b1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:57.885410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de1916-8a5c-4242-8098-131ed605af3c service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:57.958052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de1916-8a5c-4242-8098-131ed605af3c service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:57.962609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:57.963402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:57.963544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:57.963832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] PATH_INFO: `/v3/users/f78f68ad0f9542a3905f6b12205aa006` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:57.964929 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f78f68ad0f9542a3905f6b12205aa006)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:57.966850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:58.130629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f78f68ad0f9542a3905f6b12205aa006'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.191347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f78f68ad0f9542a3905f6b12205aa006'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.198572 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f78f68ad0f9542a3905f6b12205aa006'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.199233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f78f68ad0f9542a3905f6b12205aa006'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.211581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f78f68ad0f9542a3905f6b12205aa006'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.217515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1270/2540] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:01:57 2022] DELETE /identity/v3/users/f78f68ad0f9542a3905f6b12205aa006 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:58.260534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:58.262116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:58.275750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e6868-2205-4736-8027-f1d6eadb010d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:58.335715 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:58.336349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.336629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.336902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] PATH_INFO: `/v3/users/568f267cadcf4cd28ea1644c2e838d4b` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.338017 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=568f267cadcf4cd28ea1644c2e838d4b)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:58.340044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:58.498239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568f267cadcf4cd28ea1644c2e838d4b'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.510841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568f267cadcf4cd28ea1644c2e838d4b'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.518087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568f267cadcf4cd28ea1644c2e838d4b'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.518916 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568f267cadcf4cd28ea1644c2e838d4b'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.519593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568f267cadcf4cd28ea1644c2e838d4b'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.573199 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1271/2541] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:01:58 2022] DELETE /identity/v3/users/568f267cadcf4cd28ea1644c2e838d4b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:58.610199 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:58.614180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:58.640710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fbddb-a309-42c8-b84a-0317ccb61770 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:58.661021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:58.702328 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:58.702902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.703276 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.704030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d admin admin] PATH_INFO: `/v3/projects/e103ad0ab82c460199eb8d54195c9ce8` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.705453 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e103ad0ab82c460199eb8d54195c9ce8)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:58.707525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:58.821328 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e103ad0ab82c460199eb8d54195c9ce8', 'request_id': 'req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.827227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e103ad0ab82c460199eb8d54195c9ce8', 'request_id': 'req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.834354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e103ad0ab82c460199eb8d54195c9ce8', 'request_id': 'req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.913908 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:58.915578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:58.929800 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5199d-0cc0-4927-a44d-a8663c4a9d9c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:58.935727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d admin admin] The token cache is being invalidate because project e103ad0ab82c460199eb8d54195c9ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:01:58.938517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.938517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-1a135049-aa11-4cd3-bc25-e1a1b819ea8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:58.941838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:58.942670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1271/2542] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:01:58 2022] DELETE /identity/v3/projects/e103ad0ab82c460199eb8d54195c9ce8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:58.944068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6295583-e91c-41a8-8c52-28fbd9b578f1 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.944356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6295583-e91c-41a8-8c52-28fbd9b578f1 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.944629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6295583-e91c-41a8-8c52-28fbd9b578f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.972300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-c6295583-e91c-41a8-8c52-28fbd9b578f1 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:58.972300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c6295583-e91c-41a8-8c52-28fbd9b578f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:58.992313 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:58.995279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.995279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.995279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] PATH_INFO: `/v3/projects/fa059ffed5e04057891898402f0674d0` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.995279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa059ffed5e04057891898402f0674d0)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:58.996566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.027730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1272/2543] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:59.036308 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a3d9-064d-402a-949b-d45bb1a89d19 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.036595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a3d9-064d-402a-949b-d45bb1a89d19 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.036873 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a3d9-064d-402a-949b-d45bb1a89d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.055784 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-7df5a3d9-064d-402a-949b-d45bb1a89d19 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:59.056982 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-7df5a3d9-064d-402a-949b-d45bb1a89d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:59.065729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1273/2544] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:01:59.070015 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5a3d9-064d-402a-949b-d45bb1a89d19 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.079511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5a3d9-064d-402a-949b-d45bb1a89d19 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.084484 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8886f52-487b-435d-a9b9-9f16280b3506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.085060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8886f52-487b-435d-a9b9-9f16280b3506 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.085341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8886f52-487b-435d-a9b9-9f16280b3506 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.085616 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8886f52-487b-435d-a9b9-9f16280b3506 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.086242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8886f52-487b-435d-a9b9-9f16280b3506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:59.086543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8886f52-487b-435d-a9b9-9f16280b3506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.088204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8886f52-487b-435d-a9b9-9f16280b3506 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.100367 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa059ffed5e04057891898402f0674d0', 'request_id': 'req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:59.100530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1274/2545] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:59.104927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8886f52-487b-435d-a9b9-9f16280b3506 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.107154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa059ffed5e04057891898402f0674d0', 'request_id': 'req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:59.114529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8886f52-487b-435d-a9b9-9f16280b3506 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.144021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:59.172358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f84f2-c532-4e40-865f-090d6c52902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.173366 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f84f2-c532-4e40-865f-090d6c52902b admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.173366 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f84f2-c532-4e40-865f-090d6c52902b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.173559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f84f2-c532-4e40-865f-090d6c52902b admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.174074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f84f2-c532-4e40-865f-090d6c52902b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.175980 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f84f2-c532-4e40-865f-090d6c52902b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.185753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa059ffed5e04057891898402f0674d0', 'request_id': 'req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:59.198299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] The token cache is being invalidate because project fa059ffed5e04057891898402f0674d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:01:59.198591 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:59.199254 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:59.204395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1272/2546] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:01:58 2022] DELETE /identity/v3/projects/fa059ffed5e04057891898402f0674d0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:59.208100 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.209424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:59.221584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e69f7-efd9-4fb1-886e-9bcb27de09a5 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.226234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.226784 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.227097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.227374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] PATH_INFO: `/v3/users/9490779137cf4838ad353c7c4ca60f78` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.228497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9490779137cf4838ad353c7c4ca60f78)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.230396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.251450 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1275/2547] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:01:59 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:01:59.255718 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f84f2-c532-4e40-865f-090d6c52902b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.257492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-602f84f2-c532-4e40-865f-090d6c52902b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:59.324367 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f84f2-c532-4e40-865f-090d6c52902b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.329040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2f248-702d-491d-bc0c-5a5c9196f91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.329646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f248-702d-491d-bc0c-5a5c9196f91f admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.330202 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f248-702d-491d-bc0c-5a5c9196f91f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.330471 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f248-702d-491d-bc0c-5a5c9196f91f admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.331116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2f248-702d-491d-bc0c-5a5c9196f91f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.333012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2f248-702d-491d-bc0c-5a5c9196f91f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.414668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9490779137cf4838ad353c7c4ca60f78'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:59.426817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9490779137cf4838ad353c7c4ca60f78'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:59.433799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9490779137cf4838ad353c7c4ca60f78'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:59.434535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9490779137cf4838ad353c7c4ca60f78'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:59.435185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9490779137cf4838ad353c7c4ca60f78'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:01:59.458927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1276/2548] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:01:59 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:01:59.460163 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4db32-7d65-4b54-b09e-ab5c512fdaa4 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.461934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4db32-7d65-4b54-b09e-ab5c512fdaa4 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.461934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4db32-7d65-4b54-b09e-ab5c512fdaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.488537 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-a1e4db32-7d65-4b54-b09e-ab5c512fdaa4 None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:59.488537 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a1e4db32-7d65-4b54-b09e-ab5c512fdaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:59.506716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1273/2549] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:01:59 2022] DELETE /identity/v3/users/9490779137cf4838ad353c7c4ca60f78 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:59.507627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.517150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:59.534285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:59.541538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1277/2550] 10.222.0.73 () {58 vars in 967 bytes} [Tue Aug 30 00:01:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:59.556183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4db32-7d65-4b54-b09e-ab5c512fdaa4 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.557673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a1e4db32-7d65-4b54-b09e-ab5c512fdaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:59.587958 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d95a5c-ac08-498e-99e5-a412abf97788 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.593875 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ffb7b-85b7-42aa-8544-171fecec702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.594556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ffb7b-85b7-42aa-8544-171fecec702e admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.594835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ffb7b-85b7-42aa-8544-171fecec702e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.595141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ffb7b-85b7-42aa-8544-171fecec702e admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.595888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ffb7b-85b7-42aa-8544-171fecec702e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.597502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ffb7b-85b7-42aa-8544-171fecec702e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.611880 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1274/2551] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:01:59.613499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ffb7b-85b7-42aa-8544-171fecec702e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.618391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:59.624776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ffb7b-85b7-42aa-8544-171fecec702e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.630635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70c8cb-61a5-45c0-8025-d802f91cc516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.631301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70c8cb-61a5-45c0-8025-d802f91cc516 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.631587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70c8cb-61a5-45c0-8025-d802f91cc516 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.631864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70c8cb-61a5-45c0-8025-d802f91cc516 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.632643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70c8cb-61a5-45c0-8025-d802f91cc516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.634410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70c8cb-61a5-45c0-8025-d802f91cc516 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.642363 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4db32-7d65-4b54-b09e-ab5c512fdaa4 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.647059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1275/2552] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:01:59.649320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70c8cb-61a5-45c0-8025-d802f91cc516 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.660151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70c8cb-61a5-45c0-8025-d802f91cc516 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.666525 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5347f-228d-4666-863d-8c053460acf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.667362 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5347f-228d-4666-863d-8c053460acf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.667740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5347f-228d-4666-863d-8c053460acf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.668116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5347f-228d-4666-863d-8c053460acf7 admin admin] PATH_INFO: `/v3/projects/a4f557c34d6b4ed8b26ca144bdc4eb36/users/a0d77ec60b3247b1928451dde30245dd/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.687019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5347f-228d-4666-863d-8c053460acf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4f557c34d6b4ed8b26ca144bdc4eb36, user_id=a0d77ec60b3247b1928451dde30245dd, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.689675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5347f-228d-4666-863d-8c053460acf7 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.707843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a72ff-b86e-47f5-bf12-94d1fe64ceee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.708455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a72ff-b86e-47f5-bf12-94d1fe64ceee service swift] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.708737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a72ff-b86e-47f5-bf12-94d1fe64ceee service swift] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.709006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a72ff-b86e-47f5-bf12-94d1fe64ceee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.764863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a72ff-b86e-47f5-bf12-94d1fe64ceee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.766493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a72ff-b86e-47f5-bf12-94d1fe64ceee service swift] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.776541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1278/2553] 10.222.0.73 () {60 vars in 1384 bytes} [Tue Aug 30 00:01:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:01:59.782185 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a72ff-b86e-47f5-bf12-94d1fe64ceee service swift] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.784383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3c2a72ff-b86e-47f5-bf12-94d1fe64ceee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:59.788570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1276/2554] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:01:59 2022] PUT /identity/v3/projects/a4f557c34d6b4ed8b26ca144bdc4eb36/users/a0d77ec60b3247b1928451dde30245dd/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:59.790514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9de8c1-791d-46ee-866f-ae7520c5af08 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.790752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9de8c1-791d-46ee-866f-ae7520c5af08 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.791144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9de8c1-791d-46ee-866f-ae7520c5af08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.799091 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a72ff-b86e-47f5-bf12-94d1fe64ceee service swift] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.819566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-5b9de8c1-791d-46ee-866f-ae7520c5af08 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:59.820943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5b9de8c1-791d-46ee-866f-ae7520c5af08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:59.877338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cafadb-d019-46fc-b87f-58889c144983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.878105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cafadb-d019-46fc-b87f-58889c144983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.878567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cafadb-d019-46fc-b87f-58889c144983 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.878966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cafadb-d019-46fc-b87f-58889c144983 admin admin] PATH_INFO: `/v3/projects/824562619c6c477d9904f9c939e8a94e` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.880233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cafadb-d019-46fc-b87f-58889c144983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824562619c6c477d9904f9c939e8a94e)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.882813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cafadb-d019-46fc-b87f-58889c144983 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.912342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1277/2555] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:01:59.923088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9de8c1-791d-46ee-866f-ae7520c5af08 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.924947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5b9de8c1-791d-46ee-866f-ae7520c5af08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:59.988779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:00.002484 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-21cafadb-d019-46fc-b87f-58889c144983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824562619c6c477d9904f9c939e8a94e', 'request_id': 'req-21cafadb-d019-46fc-b87f-58889c144983'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:00.009332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-21cafadb-d019-46fc-b87f-58889c144983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824562619c6c477d9904f9c939e8a94e', 'request_id': 'req-21cafadb-d019-46fc-b87f-58889c144983'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:00.013112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9de8c1-791d-46ee-866f-ae7520c5af08 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:00.019228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-21cafadb-d019-46fc-b87f-58889c144983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824562619c6c477d9904f9c939e8a94e', 'request_id': 'req-21cafadb-d019-46fc-b87f-58889c144983'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:00.050345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:00.085089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaf88b-5709-4111-a273-068f6fe49577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:00.085687 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaf88b-5709-4111-a273-068f6fe49577 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.085989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaf88b-5709-4111-a273-068f6fe49577 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.086222 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaf88b-5709-4111-a273-068f6fe49577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.122022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-21cafadb-d019-46fc-b87f-58889c144983 admin admin] The token cache is being invalidate because project 824562619c6c477d9904f9c939e8a94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:00.122313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-21cafadb-d019-46fc-b87f-58889c144983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:00.123014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-21cafadb-d019-46fc-b87f-58889c144983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:00.124666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1279/2556] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:01:59 2022] DELETE /identity/v3/projects/824562619c6c477d9904f9c939e8a94e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:00.129520 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232d819-571e-4d6c-8d49-2f073161b4b9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.129808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232d819-571e-4d6c-8d49-2f073161b4b9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.130085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232d819-571e-4d6c-8d49-2f073161b4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.153255 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-c232d819-571e-4d6c-8d49-2f073161b4b9 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:00.154325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaf88b-5709-4111-a273-068f6fe49577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:00.154479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c232d819-571e-4d6c-8d49-2f073161b4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:00.159211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaf88b-5709-4111-a273-068f6fe49577 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:00.165281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1280/2557] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:00.172155 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c9cb-e4ab-4844-a55a-cb555f9e9d18 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.172155 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c9cb-e4ab-4844-a55a-cb555f9e9d18 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.172155 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c9cb-e4ab-4844-a55a-cb555f9e9d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.184437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1278/2558] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:02:00.197739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-40e9c9cb-e4ab-4844-a55a-cb555f9e9d18 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:00.204028 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-40e9c9cb-e4ab-4844-a55a-cb555f9e9d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:00.208590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1281/2559] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:00.212453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaf88b-5709-4111-a273-068f6fe49577 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:00.213895 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e4eaf88b-5709-4111-a273-068f6fe49577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:00.227024 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaf88b-5709-4111-a273-068f6fe49577 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:00.232837 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3829aca-1850-42f9-af83-753285811edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:00.233454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3829aca-1850-42f9-af83-753285811edb admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.233737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3829aca-1850-42f9-af83-753285811edb admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.234012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3829aca-1850-42f9-af83-753285811edb admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.234694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3829aca-1850-42f9-af83-753285811edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:00.235035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3829aca-1850-42f9-af83-753285811edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:00.236685 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3829aca-1850-42f9-af83-753285811edb admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:00.248937 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1279/2560] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:00.260873 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9c9cb-e4ab-4844-a55a-cb555f9e9d18 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:00.266488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9c9cb-e4ab-4844-a55a-cb555f9e9d18 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:00.271438 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007ca5b-e1a5-4b4c-bcc2-b53187dd19d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:00.272048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007ca5b-e1a5-4b4c-bcc2-b53187dd19d0 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.272356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007ca5b-e1a5-4b4c-bcc2-b53187dd19d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.272651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007ca5b-e1a5-4b4c-bcc2-b53187dd19d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.273283 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007ca5b-e1a5-4b4c-bcc2-b53187dd19d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:00.277623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007ca5b-e1a5-4b4c-bcc2-b53187dd19d0 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:00.387196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1282/2561] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:00 2022] POST /identity/v3/projects => generated 389 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:00.392560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3829aca-1850-42f9-af83-753285811edb admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:00.403324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3829aca-1850-42f9-af83-753285811edb admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:00.464430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c9cef-752a-4bc7-ab1d-515d6678ea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:00.465035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c9cef-752a-4bc7-ab1d-515d6678ea76 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.465313 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c9cef-752a-4bc7-ab1d-515d6678ea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.465582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c9cef-752a-4bc7-ab1d-515d6678ea76 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.466206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c9cef-752a-4bc7-ab1d-515d6678ea76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:00.468135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c9cef-752a-4bc7-ab1d-515d6678ea76 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:00.573012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1280/2562] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:00 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:00.574269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007ca5b-e1a5-4b4c-bcc2-b53187dd19d0 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:00.586082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007ca5b-e1a5-4b4c-bcc2-b53187dd19d0 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:00.593031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3eb64-b1a9-4ab1-9d16-559c5a1d8ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:00.593031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3eb64-b1a9-4ab1-9d16-559c5a1d8ade admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.593031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3eb64-b1a9-4ab1-9d16-559c5a1d8ade admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.593031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3eb64-b1a9-4ab1-9d16-559c5a1d8ade admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.593433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3eb64-b1a9-4ab1-9d16-559c5a1d8ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:00.594200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3eb64-b1a9-4ab1-9d16-559c5a1d8ade admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:00.607617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1283/2563] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:00.608872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c9cef-752a-4bc7-ab1d-515d6678ea76 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:00.620558 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c9cef-752a-4bc7-ab1d-515d6678ea76 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:00.626127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9119-c383-4720-b51e-c6d39571747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:00.626783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9119-c383-4720-b51e-c6d39571747f admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.627084 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9119-c383-4720-b51e-c6d39571747f admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.627363 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9119-c383-4720-b51e-c6d39571747f admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.628012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c9119-c383-4720-b51e-c6d39571747f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:00.629622 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c9119-c383-4720-b51e-c6d39571747f admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:00.641818 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1281/2564] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:00.646191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3eb64-b1a9-4ab1-9d16-559c5a1d8ade admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:00.656284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3eb64-b1a9-4ab1-9d16-559c5a1d8ade admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:00.660939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a65a5-dd37-453f-bf8e-1f473a7d4ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:00.661579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a65a5-dd37-453f-bf8e-1f473a7d4ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.661857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a65a5-dd37-453f-bf8e-1f473a7d4ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.662130 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a65a5-dd37-453f-bf8e-1f473a7d4ee2 admin admin] PATH_INFO: `/v3/projects/d608279d15884df999f03821b5e30310/users/ce242cd55fd74cccb4311e06d6b43858/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.678124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a65a5-dd37-453f-bf8e-1f473a7d4ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d608279d15884df999f03821b5e30310, user_id=ce242cd55fd74cccb4311e06d6b43858, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:00.680968 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a65a5-dd37-453f-bf8e-1f473a7d4ee2 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:00.750790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1284/2565] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:00 2022] PUT /identity/v3/projects/d608279d15884df999f03821b5e30310/users/ce242cd55fd74cccb4311e06d6b43858/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:00.763269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ea4a6-e5b4-426e-bc23-8394f4ebaf00 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.763606 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ea4a6-e5b4-426e-bc23-8394f4ebaf00 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.763960 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ea4a6-e5b4-426e-bc23-8394f4ebaf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.802391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-089ea4a6-e5b4-426e-bc23-8394f4ebaf00 None None] MFA Rules not processed for user `ce242cd55fd74cccb4311e06d6b43858`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:00.803945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-089ea4a6-e5b4-426e-bc23-8394f4ebaf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:00.862266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:00.888675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1282/2566] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:00.893424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a65a5-dd37-453f-bf8e-1f473a7d4ee2 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:00.955975 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a65a5-dd37-453f-bf8e-1f473a7d4ee2 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:00.961175 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca6677-c24e-4c30-b92a-d6a977d489c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:00.962154 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca6677-c24e-4c30-b92a-d6a977d489c9 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.962440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca6677-c24e-4c30-b92a-d6a977d489c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.962714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca6677-c24e-4c30-b92a-d6a977d489c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.963400 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca6677-c24e-4c30-b92a-d6a977d489c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:00.965289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca6677-c24e-4c30-b92a-d6a977d489c9 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.103646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1285/2567] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:00 2022] POST /identity/v3/projects => generated 389 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:01.109075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ea4a6-e5b4-426e-bc23-8394f4ebaf00 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.120229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ea4a6-e5b4-426e-bc23-8394f4ebaf00 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.193994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cd2a5-d1ae-4744-973c-2cb7323503c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.195216 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cd2a5-d1ae-4744-973c-2cb7323503c5 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.195499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cd2a5-d1ae-4744-973c-2cb7323503c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.196394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cd2a5-d1ae-4744-973c-2cb7323503c5 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.196748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cd2a5-d1ae-4744-973c-2cb7323503c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:01.198838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cd2a5-d1ae-4744-973c-2cb7323503c5 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.295202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1283/2568] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:01 2022] POST /identity/v3/users => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:01.299847 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca6677-c24e-4c30-b92a-d6a977d489c9 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.311047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca6677-c24e-4c30-b92a-d6a977d489c9 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.315859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ad1e6-1d20-4906-a3a7-0e8cb37305d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.316491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ad1e6-1d20-4906-a3a7-0e8cb37305d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.316765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ad1e6-1d20-4906-a3a7-0e8cb37305d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.317033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ad1e6-1d20-4906-a3a7-0e8cb37305d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.317673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ad1e6-1d20-4906-a3a7-0e8cb37305d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:01.319279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ad1e6-1d20-4906-a3a7-0e8cb37305d4 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.330232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1286/2569] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:01.334335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cd2a5-d1ae-4744-973c-2cb7323503c5 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.344706 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cd2a5-d1ae-4744-973c-2cb7323503c5 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.349284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c40d5-6a5f-424a-a2a6-1b2f27d326a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.349921 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c40d5-6a5f-424a-a2a6-1b2f27d326a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.350200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c40d5-6a5f-424a-a2a6-1b2f27d326a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.350473 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c40d5-6a5f-424a-a2a6-1b2f27d326a1 admin admin] PATH_INFO: `/v3/projects/0efd00f985f446d4baaf32ac6cc0a0f7/users/f2cfb9cc3c1a45f392a568161fd70620/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.365558 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c40d5-6a5f-424a-a2a6-1b2f27d326a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efd00f985f446d4baaf32ac6cc0a0f7, user_id=f2cfb9cc3c1a45f392a568161fd70620, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:01.368213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c40d5-6a5f-424a-a2a6-1b2f27d326a1 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.523119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1284/2570] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:01 2022] PUT /identity/v3/projects/0efd00f985f446d4baaf32ac6cc0a0f7/users/f2cfb9cc3c1a45f392a568161fd70620/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:01.527220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ad1e6-1d20-4906-a3a7-0e8cb37305d4 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.537606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ad1e6-1d20-4906-a3a7-0e8cb37305d4 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.558271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1871b8c-5b92-4918-a061-3aa7b938a58b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.558841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1871b8c-5b92-4918-a061-3aa7b938a58b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.559355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1871b8c-5b92-4918-a061-3aa7b938a58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.575469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:01.592737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-f1871b8c-5b92-4918-a061-3aa7b938a58b None None] MFA Rules not processed for user `a0d77ec60b3247b1928451dde30245dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:01.592737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f1871b8c-5b92-4918-a061-3aa7b938a58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:01.612053 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fbdc4-c076-4899-9ce6-51b38d3aa2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.612902 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fbdc4-c076-4899-9ce6-51b38d3aa2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.613186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fbdc4-c076-4899-9ce6-51b38d3aa2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.613489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fbdc4-c076-4899-9ce6-51b38d3aa2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.614125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fbdc4-c076-4899-9ce6-51b38d3aa2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:01.615750 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fbdc4-c076-4899-9ce6-51b38d3aa2d4 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.626054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1287/2571] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:01.630111 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fbdc4-c076-4899-9ce6-51b38d3aa2d4 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.639548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fbdc4-c076-4899-9ce6-51b38d3aa2d4 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.644758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c0fc5-10ba-4770-abc6-1c66fd08acec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.645385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c0fc5-10ba-4770-abc6-1c66fd08acec admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.645666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c0fc5-10ba-4770-abc6-1c66fd08acec admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.645931 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c0fc5-10ba-4770-abc6-1c66fd08acec admin admin] PATH_INFO: `/v3/projects/0efd00f985f446d4baaf32ac6cc0a0f7/users/f2cfb9cc3c1a45f392a568161fd70620/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.647863 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c0fc5-10ba-4770-abc6-1c66fd08acec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efd00f985f446d4baaf32ac6cc0a0f7, user_id=f2cfb9cc3c1a45f392a568161fd70620, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:01.650505 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c0fc5-10ba-4770-abc6-1c66fd08acec admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.660201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1285/2572] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:01.661197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1288/2573] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:01 2022] PUT /identity/v3/projects/0efd00f985f446d4baaf32ac6cc0a0f7/users/f2cfb9cc3c1a45f392a568161fd70620/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:02:01.664596 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1871b8c-5b92-4918-a061-3aa7b938a58b None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.665908 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f1871b8c-5b92-4918-a061-3aa7b938a58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:01.676932 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a1ff5-d77e-40f6-8898-0b17df83640a None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.677216 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a1ff5-d77e-40f6-8898-0b17df83640a None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.677493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a1ff5-d77e-40f6-8898-0b17df83640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.679675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1871b8c-5b92-4918-a061-3aa7b938a58b None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.707248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-9d6a1ff5-d77e-40f6-8898-0b17df83640a None None] MFA Rules not processed for user `f2cfb9cc3c1a45f392a568161fd70620`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:01.708564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9d6a1ff5-d77e-40f6-8898-0b17df83640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:01.711352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:01.738636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d455b-0e50-4640-920f-6b64eea6013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.739229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d455b-0e50-4640-920f-6b64eea6013b admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.739567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d455b-0e50-4640-920f-6b64eea6013b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.739925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d455b-0e50-4640-920f-6b64eea6013b admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.740747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d455b-0e50-4640-920f-6b64eea6013b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:01.743779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d455b-0e50-4640-920f-6b64eea6013b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.777887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1289/2574] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:01 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:01.789695 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a1ff5-d77e-40f6-8898-0b17df83640a None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.791074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9d6a1ff5-d77e-40f6-8898-0b17df83640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:01.821771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1286/2575] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:01 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:01.825877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d455b-0e50-4640-920f-6b64eea6013b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.852519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a1ff5-d77e-40f6-8898-0b17df83640a None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.889794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d455b-0e50-4640-920f-6b64eea6013b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.895351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8752d1e-8003-4ca0-9c0d-c3e1bc687f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.895964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8752d1e-8003-4ca0-9c0d-c3e1bc687f4f admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.896244 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8752d1e-8003-4ca0-9c0d-c3e1bc687f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.896518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8752d1e-8003-4ca0-9c0d-c3e1bc687f4f admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.897151 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8752d1e-8003-4ca0-9c0d-c3e1bc687f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:01.899109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8752d1e-8003-4ca0-9c0d-c3e1bc687f4f admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.904729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afc2f2-e46d-4a84-81cf-d77868888858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.904729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc2f2-e46d-4a84-81cf-d77868888858 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.904729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc2f2-e46d-4a84-81cf-d77868888858 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.904729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc2f2-e46d-4a84-81cf-d77868888858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.925646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:01.964815 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afc2f2-e46d-4a84-81cf-d77868888858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:01.966248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afc2f2-e46d-4a84-81cf-d77868888858 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.975713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1290/2576] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:01 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:02:02.000731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1287/2577] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:01 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:02:02.002327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afc2f2-e46d-4a84-81cf-d77868888858 service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:02.019544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afc2f2-e46d-4a84-81cf-d77868888858 service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:02.022944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51039c99-130e-4ab7-a363-fc6737ed52ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:02.023850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51039c99-130e-4ab7-a363-fc6737ed52ed admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.024063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51039c99-130e-4ab7-a363-fc6737ed52ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.024334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51039c99-130e-4ab7-a363-fc6737ed52ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.024973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51039c99-130e-4ab7-a363-fc6737ed52ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:02.026554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51039c99-130e-4ab7-a363-fc6737ed52ed admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:02.037514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1291/2578] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:02.045775 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8752d1e-8003-4ca0-9c0d-c3e1bc687f4f admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:02.058998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8752d1e-8003-4ca0-9c0d-c3e1bc687f4f admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:02.061233 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00fea3-7ee0-4819-99eb-2771b2982b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:02.061882 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00fea3-7ee0-4819-99eb-2771b2982b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.062159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00fea3-7ee0-4819-99eb-2771b2982b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.062430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00fea3-7ee0-4819-99eb-2771b2982b33 admin admin] PATH_INFO: `/v3/projects/b1e348ba5fd04e3aab9d292eb1ec97c6/users/ca904d1ecc8c40f7a9a62a9cb3543142/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.079611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00fea3-7ee0-4819-99eb-2771b2982b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e348ba5fd04e3aab9d292eb1ec97c6, user_id=ca904d1ecc8c40f7a9a62a9cb3543142, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:02.082594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00fea3-7ee0-4819-99eb-2771b2982b33 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:02.121067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51039c99-130e-4ab7-a363-fc6737ed52ed admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:02.131939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51039c99-130e-4ab7-a363-fc6737ed52ed admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:02.134592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1288/2579] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:02 2022] PUT /identity/v3/projects/b1e348ba5fd04e3aab9d292eb1ec97c6/users/ca904d1ecc8c40f7a9a62a9cb3543142/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:02.143663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00fea3-7ee0-4819-99eb-2771b2982b33 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:02.189962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:02.190593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.190900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.191176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] PATH_INFO: `/v3/users/ce242cd55fd74cccb4311e06d6b43858` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.192319 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce242cd55fd74cccb4311e06d6b43858)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:02.194228 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:02.207352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00fea3-7ee0-4819-99eb-2771b2982b33 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:02.212144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a260c19-ff84-408b-9b47-27991bce609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:02.212749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a260c19-ff84-408b-9b47-27991bce609f admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.213033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a260c19-ff84-408b-9b47-27991bce609f admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.213306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a260c19-ff84-408b-9b47-27991bce609f admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.213949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a260c19-ff84-408b-9b47-27991bce609f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:02.215617 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a260c19-ff84-408b-9b47-27991bce609f admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:02.225699 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1289/2580] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:02:02.230155 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a260c19-ff84-408b-9b47-27991bce609f admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:02.239722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a260c19-ff84-408b-9b47-27991bce609f admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:02.244402 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3f01b-80d6-41cb-8d29-7178daea5b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:02.245019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f01b-80d6-41cb-8d29-7178daea5b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.245302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f01b-80d6-41cb-8d29-7178daea5b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.245578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f01b-80d6-41cb-8d29-7178daea5b46 admin admin] PATH_INFO: `/v3/projects/b1e348ba5fd04e3aab9d292eb1ec97c6/users/ca904d1ecc8c40f7a9a62a9cb3543142/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.247601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3f01b-80d6-41cb-8d29-7178daea5b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e348ba5fd04e3aab9d292eb1ec97c6, user_id=ca904d1ecc8c40f7a9a62a9cb3543142, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:02.250681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3f01b-80d6-41cb-8d29-7178daea5b46 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:02.261058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1290/2581] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:02 2022] PUT /identity/v3/projects/b1e348ba5fd04e3aab9d292eb1ec97c6/users/ca904d1ecc8c40f7a9a62a9cb3543142/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:02:02.355701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce242cd55fd74cccb4311e06d6b43858'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:02.413291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce242cd55fd74cccb4311e06d6b43858'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:02.440764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce242cd55fd74cccb4311e06d6b43858'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:02.441514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce242cd55fd74cccb4311e06d6b43858'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:02.453892 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce242cd55fd74cccb4311e06d6b43858'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:02.460073 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1292/2582] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:02:02 2022] DELETE /identity/v3/users/ce242cd55fd74cccb4311e06d6b43858 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:02:02.464721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3bd96-2645-4e21-aa3e-2c3ecfc2ba86 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.465010 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3bd96-2645-4e21-aa3e-2c3ecfc2ba86 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.465284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3bd96-2645-4e21-aa3e-2c3ecfc2ba86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.479448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:02.485589 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-08d3bd96-2645-4e21-aa3e-2c3ecfc2ba86 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:02.486841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-08d3bd96-2645-4e21-aa3e-2c3ecfc2ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:02.548808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1291/2583] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:02.558961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:02.560653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:02.576498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:02.620626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738cf8d-ca08-434e-8a3a-c0deccc1e458 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:02.624059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f03a5c-cbed-49de-9295-149ce6578731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:02.624670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f03a5c-cbed-49de-9295-149ce6578731 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.624967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f03a5c-cbed-49de-9295-149ce6578731 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.625855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f03a5c-cbed-49de-9295-149ce6578731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.635053 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f03a5c-cbed-49de-9295-149ce6578731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:02.636518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f03a5c-cbed-49de-9295-149ce6578731 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:02.645676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1293/2584] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:02:03.067461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3bd96-2645-4e21-aa3e-2c3ecfc2ba86 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:03.068911 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-08d3bd96-2645-4e21-aa3e-2c3ecfc2ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:03.084336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3bd96-2645-4e21-aa3e-2c3ecfc2ba86 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:03.092312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:03.092312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:03.092312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:03.092312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2 admin admin] PATH_INFO: `/v3/projects/d608279d15884df999f03821b5e30310` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:03.093004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d608279d15884df999f03821b5e30310)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:03.094513 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:03.218487 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd608279d15884df999f03821b5e30310', 'request_id': 'req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:03.225471 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd608279d15884df999f03821b5e30310', 'request_id': 'req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:03.311323 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd608279d15884df999f03821b5e30310', 'request_id': 'req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:03.322838 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2 admin admin] The token cache is being invalidate because project d608279d15884df999f03821b5e30310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:03.323210 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:03.323832 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-b1b68d68-f037-4e52-bd0c-7af8fb0684a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:03.325352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1292/2585] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:02:03 2022] DELETE /identity/v3/projects/d608279d15884df999f03821b5e30310 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:03.330101 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f03a5c-cbed-49de-9295-149ce6578731 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:03.339911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f03a5c-cbed-49de-9295-149ce6578731 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:03.402441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:03.403032 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:03.403321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:03.403719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] PATH_INFO: `/v3/users/f2cfb9cc3c1a45f392a568161fd70620` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:03.404844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2cfb9cc3c1a45f392a568161fd70620)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:03.407382 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:03.460133 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f163ca6-8c78-4f2e-ac99-29a688abff88 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:03.460492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f163ca6-8c78-4f2e-ac99-29a688abff88 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:03.461057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f163ca6-8c78-4f2e-ac99-29a688abff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:03.493504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-5f163ca6-8c78-4f2e-ac99-29a688abff88 None None] MFA Rules not processed for user `ca904d1ecc8c40f7a9a62a9cb3543142`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:03.494864 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5f163ca6-8c78-4f2e-ac99-29a688abff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:03.567279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1293/2586] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:03.579296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f44de5-5ed3-49b9-ba59-4a8f241b6c7a None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:03.579585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f44de5-5ed3-49b9-ba59-4a8f241b6c7a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:03.580125 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f44de5-5ed3-49b9-ba59-4a8f241b6c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:03.595888 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2cfb9cc3c1a45f392a568161fd70620'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:03.603251 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-b4f44de5-5ed3-49b9-ba59-4a8f241b6c7a None None] MFA Rules not processed for user `a0d77ec60b3247b1928451dde30245dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:03.604459 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b4f44de5-5ed3-49b9-ba59-4a8f241b6c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:03.613745 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:03.658896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1294/2587] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:03.669542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f44de5-5ed3-49b9-ba59-4a8f241b6c7a None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:03.670897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b4f44de5-5ed3-49b9-ba59-4a8f241b6c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:03.675654 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2cfb9cc3c1a45f392a568161fd70620'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:03.683181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2cfb9cc3c1a45f392a568161fd70620'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:03.689016 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2cfb9cc3c1a45f392a568161fd70620'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:03.696620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2cfb9cc3c1a45f392a568161fd70620'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:03.702501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1294/2588] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:02:03 2022] DELETE /identity/v3/users/f2cfb9cc3c1a45f392a568161fd70620 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:03.749028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f44de5-5ed3-49b9-ba59-4a8f241b6c7a None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:03.815190 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff956e-0b70-4d09-9300-2d4b1b7afbc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:03.815802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff956e-0b70-4d09-9300-2d4b1b7afbc4 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:03.816078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff956e-0b70-4d09-9300-2d4b1b7afbc4 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:03.816349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff956e-0b70-4d09-9300-2d4b1b7afbc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:03.818126 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c2ff956e-0b70-4d09-9300-2d4b1b7afbc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:03.876354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:03.878557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff956e-0b70-4d09-9300-2d4b1b7afbc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:03.880217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff956e-0b70-4d09-9300-2d4b1b7afbc4 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:03.889581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1295/2589] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:02:04.193005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:04.194478 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:04.240874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:04.271479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de672f6-9599-4c99-9854-3e0e409eb51e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:04.276324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856650b-2eba-475e-ad31-0e03069ce8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:04.276965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856650b-2eba-475e-ad31-0e03069ce8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.277249 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856650b-2eba-475e-ad31-0e03069ce8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.277525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856650b-2eba-475e-ad31-0e03069ce8f1 admin admin] PATH_INFO: `/v3/projects/0efd00f985f446d4baaf32ac6cc0a0f7` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.278653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856650b-2eba-475e-ad31-0e03069ce8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0efd00f985f446d4baaf32ac6cc0a0f7)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:04.280701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856650b-2eba-475e-ad31-0e03069ce8f1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:04.420843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3856650b-2eba-475e-ad31-0e03069ce8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0efd00f985f446d4baaf32ac6cc0a0f7', 'request_id': 'req-3856650b-2eba-475e-ad31-0e03069ce8f1'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:04.427064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3856650b-2eba-475e-ad31-0e03069ce8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0efd00f985f446d4baaf32ac6cc0a0f7', 'request_id': 'req-3856650b-2eba-475e-ad31-0e03069ce8f1'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:04.433223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3856650b-2eba-475e-ad31-0e03069ce8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0efd00f985f446d4baaf32ac6cc0a0f7', 'request_id': 'req-3856650b-2eba-475e-ad31-0e03069ce8f1'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:04.537052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3856650b-2eba-475e-ad31-0e03069ce8f1 admin admin] The token cache is being invalidate because project 0efd00f985f446d4baaf32ac6cc0a0f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:04.537052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3856650b-2eba-475e-ad31-0e03069ce8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:04.537052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-3856650b-2eba-475e-ad31-0e03069ce8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:04.537052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1295/2590] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:02:04 2022] DELETE /identity/v3/projects/0efd00f985f446d4baaf32ac6cc0a0f7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:04.539034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e977954-849e-4dcf-9077-4c69541b171d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.539451 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e977954-849e-4dcf-9077-4c69541b171d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.539768 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e977954-849e-4dcf-9077-4c69541b171d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.561873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-8e977954-849e-4dcf-9077-4c69541b171d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:04.570079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8e977954-849e-4dcf-9077-4c69541b171d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:04.626971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1296/2591] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:04.634688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02117474-4616-4c56-a47d-d54c18e44439 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.635012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02117474-4616-4c56-a47d-d54c18e44439 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.635292 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02117474-4616-4c56-a47d-d54c18e44439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.656307 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-02117474-4616-4c56-a47d-d54c18e44439 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:04.658041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-02117474-4616-4c56-a47d-d54c18e44439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:04.666196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1296/2592] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:04.670394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e977954-849e-4dcf-9077-4c69541b171d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:04.681153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e977954-849e-4dcf-9077-4c69541b171d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:04.685752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a505a7-21aa-4a55-9eed-496b7de529cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:04.686349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a505a7-21aa-4a55-9eed-496b7de529cf admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.686627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a505a7-21aa-4a55-9eed-496b7de529cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.686922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a505a7-21aa-4a55-9eed-496b7de529cf admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.687564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a505a7-21aa-4a55-9eed-496b7de529cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:04.687865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a505a7-21aa-4a55-9eed-496b7de529cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:04.689437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a505a7-21aa-4a55-9eed-496b7de529cf admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:04.701229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1297/2593] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:04.708569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02117474-4616-4c56-a47d-d54c18e44439 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:04.717934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02117474-4616-4c56-a47d-d54c18e44439 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:04.723330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef197b4-e9b3-4350-beac-dbc333893b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:04.723924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef197b4-e9b3-4350-beac-dbc333893b42 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.724204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef197b4-e9b3-4350-beac-dbc333893b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.724476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef197b4-e9b3-4350-beac-dbc333893b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.725138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef197b4-e9b3-4350-beac-dbc333893b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:04.727191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef197b4-e9b3-4350-beac-dbc333893b42 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:04.838798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1297/2594] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:04 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:02:04.843083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a505a7-21aa-4a55-9eed-496b7de529cf admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:04.853820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a505a7-21aa-4a55-9eed-496b7de529cf admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:04.910374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb03797-f210-4bd5-9945-d63bc325743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:04.911014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb03797-f210-4bd5-9945-d63bc325743b admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.911294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb03797-f210-4bd5-9945-d63bc325743b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.911593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb03797-f210-4bd5-9945-d63bc325743b admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.912238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb03797-f210-4bd5-9945-d63bc325743b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:04.914164 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb03797-f210-4bd5-9945-d63bc325743b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.007647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1298/2595] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:04 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:05.012094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef197b4-e9b3-4350-beac-dbc333893b42 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.022824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef197b4-e9b3-4350-beac-dbc333893b42 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.027384 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1304b-7429-47bd-81d7-7c204e0e9bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.027993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1304b-7429-47bd-81d7-7c204e0e9bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.028266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1304b-7429-47bd-81d7-7c204e0e9bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.028530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1304b-7429-47bd-81d7-7c204e0e9bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.029152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1304b-7429-47bd-81d7-7c204e0e9bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.030743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1304b-7429-47bd-81d7-7c204e0e9bf0 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.046613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1298/2596] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:02:05.049461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb03797-f210-4bd5-9945-d63bc325743b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.059510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb03797-f210-4bd5-9945-d63bc325743b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.064715 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7db09e-807f-4b5a-89e7-5fecd6e9ac94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.069783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db09e-807f-4b5a-89e7-5fecd6e9ac94 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.069783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db09e-807f-4b5a-89e7-5fecd6e9ac94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.069783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db09e-807f-4b5a-89e7-5fecd6e9ac94 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.069783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7db09e-807f-4b5a-89e7-5fecd6e9ac94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.069783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7db09e-807f-4b5a-89e7-5fecd6e9ac94 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.083313 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1299/2597] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:05.084454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1304b-7429-47bd-81d7-7c204e0e9bf0 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.094547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1304b-7429-47bd-81d7-7c204e0e9bf0 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.099659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49036f08-11a5-4703-bb0f-9a54cdc403ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.100380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49036f08-11a5-4703-bb0f-9a54cdc403ad admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.100721 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49036f08-11a5-4703-bb0f-9a54cdc403ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.101059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49036f08-11a5-4703-bb0f-9a54cdc403ad admin admin] PATH_INFO: `/v3/projects/237aaa7d835d4910982d0bc3c23510fe/users/0a0a7d3e0d6b46eeb9adbf79ebdbd21c/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.116517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49036f08-11a5-4703-bb0f-9a54cdc403ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=237aaa7d835d4910982d0bc3c23510fe, user_id=0a0a7d3e0d6b46eeb9adbf79ebdbd21c, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.119168 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49036f08-11a5-4703-bb0f-9a54cdc403ad admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.180054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1299/2598] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:05 2022] PUT /identity/v3/projects/237aaa7d835d4910982d0bc3c23510fe/users/0a0a7d3e0d6b46eeb9adbf79ebdbd21c/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:02:05.191934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63763-2111-4974-87e9-747eeebe9aed None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.192226 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63763-2111-4974-87e9-747eeebe9aed None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.192508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63763-2111-4974-87e9-747eeebe9aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.222503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a2f63763-2111-4974-87e9-747eeebe9aed None None] MFA Rules not processed for user `0a0a7d3e0d6b46eeb9adbf79ebdbd21c`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:05.223793 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a2f63763-2111-4974-87e9-747eeebe9aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:05.274012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:05.291051 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1300/2599] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:05.295539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49036f08-11a5-4703-bb0f-9a54cdc403ad admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.358941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49036f08-11a5-4703-bb0f-9a54cdc403ad admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.364237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559199b-425e-4a69-b10f-7de075ad910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.364834 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559199b-425e-4a69-b10f-7de075ad910b admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.367946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559199b-425e-4a69-b10f-7de075ad910b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.367946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559199b-425e-4a69-b10f-7de075ad910b admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.367946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559199b-425e-4a69-b10f-7de075ad910b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.367946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559199b-425e-4a69-b10f-7de075ad910b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.372466 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:05.488571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1300/2600] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:05 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:02:05.492658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f63763-2111-4974-87e9-747eeebe9aed None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.504158 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f63763-2111-4974-87e9-747eeebe9aed None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.560377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97d724-d482-483f-8d67-f3924a119b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.561041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97d724-d482-483f-8d67-f3924a119b66 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.561255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97d724-d482-483f-8d67-f3924a119b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.561534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97d724-d482-483f-8d67-f3924a119b66 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.562166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97d724-d482-483f-8d67-f3924a119b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.564679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97d724-d482-483f-8d67-f3924a119b66 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.678854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1301/2601] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:05 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:05.682376 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559199b-425e-4a69-b10f-7de075ad910b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.692772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559199b-425e-4a69-b10f-7de075ad910b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.697340 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8c3a4-0f93-4562-af61-7ba286802cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.697939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8c3a4-0f93-4562-af61-7ba286802cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.698218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8c3a4-0f93-4562-af61-7ba286802cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.698491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8c3a4-0f93-4562-af61-7ba286802cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.699162 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8c3a4-0f93-4562-af61-7ba286802cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.700781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8c3a4-0f93-4562-af61-7ba286802cc5 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.711534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1301/2602] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:05.715672 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97d724-d482-483f-8d67-f3924a119b66 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.726196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97d724-d482-483f-8d67-f3924a119b66 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.731081 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc6635-702c-4b19-a1a9-a9410f3b02ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.731779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc6635-702c-4b19-a1a9-a9410f3b02ee admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.732022 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc6635-702c-4b19-a1a9-a9410f3b02ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.732298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc6635-702c-4b19-a1a9-a9410f3b02ee admin admin] PATH_INFO: `/v3/projects/2fb77d6e301646bab601cba62adeaff2/users/227885e1cda7460fb669e44df894e01e/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.748168 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc6635-702c-4b19-a1a9-a9410f3b02ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb77d6e301646bab601cba62adeaff2, user_id=227885e1cda7460fb669e44df894e01e, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.750845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc6635-702c-4b19-a1a9-a9410f3b02ee admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.813052 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1302/2603] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:05 2022] PUT /identity/v3/projects/2fb77d6e301646bab601cba62adeaff2/users/227885e1cda7460fb669e44df894e01e/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:05.817182 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8c3a4-0f93-4562-af61-7ba286802cc5 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.827275 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8c3a4-0f93-4562-af61-7ba286802cc5 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.886414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8db3e-40f9-4471-a352-ef0d962614d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.886979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8db3e-40f9-4471-a352-ef0d962614d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.887265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8db3e-40f9-4471-a352-ef0d962614d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.887540 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8db3e-40f9-4471-a352-ef0d962614d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.888176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8db3e-40f9-4471-a352-ef0d962614d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.889817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8db3e-40f9-4471-a352-ef0d962614d5 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.899560 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1302/2604] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:05.904535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc6635-702c-4b19-a1a9-a9410f3b02ee admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.915674 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc6635-702c-4b19-a1a9-a9410f3b02ee admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.920388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c83f45-c3e4-4002-8fd8-29419ce9970f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.921035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c83f45-c3e4-4002-8fd8-29419ce9970f admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.921384 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c83f45-c3e4-4002-8fd8-29419ce9970f admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.921660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c83f45-c3e4-4002-8fd8-29419ce9970f admin admin] PATH_INFO: `/v3/projects/2fb77d6e301646bab601cba62adeaff2/users/227885e1cda7460fb669e44df894e01e/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.924127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c83f45-c3e4-4002-8fd8-29419ce9970f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb77d6e301646bab601cba62adeaff2, user_id=227885e1cda7460fb669e44df894e01e, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.926790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c83f45-c3e4-4002-8fd8-29419ce9970f admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.937647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1303/2605] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:05 2022] PUT /identity/v3/projects/2fb77d6e301646bab601cba62adeaff2/users/227885e1cda7460fb669e44df894e01e/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:02:05.947884 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e3bac-a3a8-4879-9cc8-4a0afb42c7ab None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.948159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e3bac-a3a8-4879-9cc8-4a0afb42c7ab None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.948467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e3bac-a3a8-4879-9cc8-4a0afb42c7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.977599 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-3e3e3bac-a3a8-4879-9cc8-4a0afb42c7ab None None] MFA Rules not processed for user `227885e1cda7460fb669e44df894e01e`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:05.978915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3e3e3bac-a3a8-4879-9cc8-4a0afb42c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:06.049841 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1303/2606] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:06.061500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c83f45-c3e4-4002-8fd8-29419ce9970f admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:06.063303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a7c83f45-c3e4-4002-8fd8-29419ce9970f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:06.121573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c83f45-c3e4-4002-8fd8-29419ce9970f admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:06.125152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e07860-a299-493a-ba77-93a7d667b191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:06.125748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e07860-a299-493a-ba77-93a7d667b191 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:06.126032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e07860-a299-493a-ba77-93a7d667b191 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:06.126292 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e07860-a299-493a-ba77-93a7d667b191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:06.135196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e07860-a299-493a-ba77-93a7d667b191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:06.136655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e07860-a299-493a-ba77-93a7d667b191 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:06.146291 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1304/2607] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:06.268552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e3bac-a3a8-4879-9cc8-4a0afb42c7ab None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:06.278233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e3bac-a3a8-4879-9cc8-4a0afb42c7ab None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:06.282581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536146d7-117f-4cb1-9cfa-edb68ca61408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:06.283220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536146d7-117f-4cb1-9cfa-edb68ca61408 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:06.283509 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536146d7-117f-4cb1-9cfa-edb68ca61408 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:06.283779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536146d7-117f-4cb1-9cfa-edb68ca61408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:06.342720 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:06.347019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536146d7-117f-4cb1-9cfa-edb68ca61408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:06.348521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536146d7-117f-4cb1-9cfa-edb68ca61408 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:06.357407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1304/2608] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:06.823437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e07860-a299-493a-ba77-93a7d667b191 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:06.885300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:06.902662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e07860-a299-493a-ba77-93a7d667b191 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:06.907436 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:06.908074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:06.908364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:06.908640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] PATH_INFO: `/v3/users/0a0a7d3e0d6b46eeb9adbf79ebdbd21c` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:06.909812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0a7d3e0d6b46eeb9adbf79ebdbd21c)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:06.911925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:07.221054 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0a7d3e0d6b46eeb9adbf79ebdbd21c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:07.233016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0a7d3e0d6b46eeb9adbf79ebdbd21c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:07.240453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0a7d3e0d6b46eeb9adbf79ebdbd21c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:07.241179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0a7d3e0d6b46eeb9adbf79ebdbd21c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:07.245868 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0a7d3e0d6b46eeb9adbf79ebdbd21c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:07.328849 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1305/2609] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:02:06 2022] DELETE /identity/v3/users/0a0a7d3e0d6b46eeb9adbf79ebdbd21c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:07.333723 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829b3c9-d3aa-4fcf-aae8-2147fcf49425 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:07.334192 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829b3c9-d3aa-4fcf-aae8-2147fcf49425 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:07.334398 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829b3c9-d3aa-4fcf-aae8-2147fcf49425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:07.354712 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d829b3c9-d3aa-4fcf-aae8-2147fcf49425 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:07.356064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d829b3c9-d3aa-4fcf-aae8-2147fcf49425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:07.415498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1305/2610] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:07.425829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:07.427284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:07.490190 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abfc28-eb56-492f-a5b2-ccd689a986be admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:07.493901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68209a06-48f0-4311-bc22-9f72125cdaff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:07.494525 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68209a06-48f0-4311-bc22-9f72125cdaff service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:07.494796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68209a06-48f0-4311-bc22-9f72125cdaff service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:07.495098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68209a06-48f0-4311-bc22-9f72125cdaff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:07.504422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68209a06-48f0-4311-bc22-9f72125cdaff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:07.505839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68209a06-48f0-4311-bc22-9f72125cdaff service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:07.516161 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1306/2611] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:02:08.067551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829b3c9-d3aa-4fcf-aae8-2147fcf49425 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:08.068980 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d829b3c9-d3aa-4fcf-aae8-2147fcf49425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:08.082468 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829b3c9-d3aa-4fcf-aae8-2147fcf49425 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:08.087414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:08.088123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:08.088400 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:08.089346 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] PATH_INFO: `/v3/projects/237aaa7d835d4910982d0bc3c23510fe` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:08.091026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237aaa7d835d4910982d0bc3c23510fe)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:08.092896 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:08.191983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237aaa7d835d4910982d0bc3c23510fe', 'request_id': 'req-d4554240-ba68-4d93-b52d-7bdd59df66d1'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:08.197764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237aaa7d835d4910982d0bc3c23510fe', 'request_id': 'req-d4554240-ba68-4d93-b52d-7bdd59df66d1'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:08.205017 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237aaa7d835d4910982d0bc3c23510fe', 'request_id': 'req-d4554240-ba68-4d93-b52d-7bdd59df66d1'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:08.293495 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] The token cache is being invalidate because project 237aaa7d835d4910982d0bc3c23510fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:08.293905 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:08.294567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:08.296246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1306/2612] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:02:08 2022] DELETE /identity/v3/projects/237aaa7d835d4910982d0bc3c23510fe => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:08.301189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68209a06-48f0-4311-bc22-9f72125cdaff service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:08.311242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68209a06-48f0-4311-bc22-9f72125cdaff service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:08.368574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814742e5-d598-4868-b46a-8a363ea21463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:08.369459 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814742e5-d598-4868-b46a-8a363ea21463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:08.369733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814742e5-d598-4868-b46a-8a363ea21463 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:08.370250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814742e5-d598-4868-b46a-8a363ea21463 admin admin] PATH_INFO: `/v3/users/227885e1cda7460fb669e44df894e01e` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:08.371436 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814742e5-d598-4868-b46a-8a363ea21463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=227885e1cda7460fb669e44df894e01e)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:08.373328 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814742e5-d598-4868-b46a-8a363ea21463 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:08.383732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:08.432574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:08.434125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:08.513047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4554240-ba68-4d93-b52d-7bdd59df66d1 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:08.518966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4661f-deea-4c5e-bc58-5cfcc4e15d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:08.519590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4661f-deea-4c5e-bc58-5cfcc4e15d6b service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:08.519885 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4661f-deea-4c5e-bc58-5cfcc4e15d6b service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:08.520161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4661f-deea-4c5e-bc58-5cfcc4e15d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:08.521948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fab4661f-deea-4c5e-bc58-5cfcc4e15d6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:08.534662 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4661f-deea-4c5e-bc58-5cfcc4e15d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:08.536285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4661f-deea-4c5e-bc58-5cfcc4e15d6b service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:08.547721 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1307/2613] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:02:08.593287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-814742e5-d598-4868-b46a-8a363ea21463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227885e1cda7460fb669e44df894e01e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:08.606187 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-814742e5-d598-4868-b46a-8a363ea21463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227885e1cda7460fb669e44df894e01e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:08.614524 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-814742e5-d598-4868-b46a-8a363ea21463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227885e1cda7460fb669e44df894e01e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:08.616731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-814742e5-d598-4868-b46a-8a363ea21463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227885e1cda7460fb669e44df894e01e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:08.616731 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-814742e5-d598-4868-b46a-8a363ea21463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227885e1cda7460fb669e44df894e01e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:08.716896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1307/2614] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:02:08 2022] DELETE /identity/v3/users/227885e1cda7460fb669e44df894e01e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:09.096130 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4661f-deea-4c5e-bc58-5cfcc4e15d6b service nova] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.097598 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fab4661f-deea-4c5e-bc58-5cfcc4e15d6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:09.107482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:09.112391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4661f-deea-4c5e-bc58-5cfcc4e15d6b service nova] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.171399 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.172381 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.172859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.173696 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78 admin admin] PATH_INFO: `/v3/projects/2fb77d6e301646bab601cba62adeaff2` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.175014 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb77d6e301646bab601cba62adeaff2)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.176909 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.278297 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb77d6e301646bab601cba62adeaff2', 'request_id': 'req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:09.284658 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb77d6e301646bab601cba62adeaff2', 'request_id': 'req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:09.291136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb77d6e301646bab601cba62adeaff2', 'request_id': 'req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:09.401619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78 admin admin] The token cache is being invalidate because project 2fb77d6e301646bab601cba62adeaff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:09.401951 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:09.402571 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2e0bf943-d4cb-491c-95c9-8f22ddc6fe78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:09.404082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1308/2615] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:02:09 2022] DELETE /identity/v3/projects/2fb77d6e301646bab601cba62adeaff2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:09.409643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b1c01-490a-43d3-98c9-f01d52696e4d None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.410119 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b1c01-490a-43d3-98c9-f01d52696e4d None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.410215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b1c01-490a-43d3-98c9-f01d52696e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.429916 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-923b1c01-490a-43d3-98c9-f01d52696e4d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:09.431162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-923b1c01-490a-43d3-98c9-f01d52696e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:09.489452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1308/2616] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:09.497135 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df05b41-1c06-4ab3-945f-c2b1e008c005 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.497592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df05b41-1c06-4ab3-945f-c2b1e008c005 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.497721 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df05b41-1c06-4ab3-945f-c2b1e008c005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.518142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-9df05b41-1c06-4ab3-945f-c2b1e008c005 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:09.519380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9df05b41-1c06-4ab3-945f-c2b1e008c005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:09.527048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1309/2617] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:09.531219 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b1c01-490a-43d3-98c9-f01d52696e4d None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.540930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b1c01-490a-43d3-98c9-f01d52696e4d None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.545534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd758d-8b86-49be-93a6-ee7725dc3240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.546135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd758d-8b86-49be-93a6-ee7725dc3240 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.546420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd758d-8b86-49be-93a6-ee7725dc3240 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.546774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd758d-8b86-49be-93a6-ee7725dc3240 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.547454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd758d-8b86-49be-93a6-ee7725dc3240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:09.547764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd758d-8b86-49be-93a6-ee7725dc3240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.549372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd758d-8b86-49be-93a6-ee7725dc3240 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.560780 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1309/2618] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:09.565372 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df05b41-1c06-4ab3-945f-c2b1e008c005 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.574354 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df05b41-1c06-4ab3-945f-c2b1e008c005 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.579541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5362104-725e-4a1d-9e25-2722f93fe4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.580414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5362104-725e-4a1d-9e25-2722f93fe4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.580690 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5362104-725e-4a1d-9e25-2722f93fe4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.580954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5362104-725e-4a1d-9e25-2722f93fe4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.581562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5362104-725e-4a1d-9e25-2722f93fe4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.583490 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5362104-725e-4a1d-9e25-2722f93fe4c4 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.670599 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1310/2619] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:09 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:09.672149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd758d-8b86-49be-93a6-ee7725dc3240 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.682273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd758d-8b86-49be-93a6-ee7725dc3240 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.744264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841a9b1-2bdf-4869-b412-bfda74abed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.744905 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841a9b1-2bdf-4869-b412-bfda74abed8b admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.745177 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841a9b1-2bdf-4869-b412-bfda74abed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.745456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841a9b1-2bdf-4869-b412-bfda74abed8b admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.746088 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841a9b1-2bdf-4869-b412-bfda74abed8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.748112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841a9b1-2bdf-4869-b412-bfda74abed8b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.829123 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1310/2620] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:09 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:09.830684 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5362104-725e-4a1d-9e25-2722f93fe4c4 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.841345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5362104-725e-4a1d-9e25-2722f93fe4c4 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.845995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c4cd6-e96d-47d5-9de1-7ed79ac82d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.846663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4cd6-e96d-47d5-9de1-7ed79ac82d84 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.846981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4cd6-e96d-47d5-9de1-7ed79ac82d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.847259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4cd6-e96d-47d5-9de1-7ed79ac82d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.847901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c4cd6-e96d-47d5-9de1-7ed79ac82d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.849489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c4cd6-e96d-47d5-9de1-7ed79ac82d84 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.860289 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1311/2621] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:09.867547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841a9b1-2bdf-4869-b412-bfda74abed8b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.873993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:09.878369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841a9b1-2bdf-4869-b412-bfda74abed8b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.883065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2351edf-8944-4d17-955e-87b4efc020f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.883694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2351edf-8944-4d17-955e-87b4efc020f6 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.883969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2351edf-8944-4d17-955e-87b4efc020f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.884265 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2351edf-8944-4d17-955e-87b4efc020f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.884903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2351edf-8944-4d17-955e-87b4efc020f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.886490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2351edf-8944-4d17-955e-87b4efc020f6 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.897826 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1311/2622] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:09.901737 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c4cd6-e96d-47d5-9de1-7ed79ac82d84 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.913361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c4cd6-e96d-47d5-9de1-7ed79ac82d84 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.918337 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35424b06-2726-4914-95b6-a95154afc337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.919044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35424b06-2726-4914-95b6-a95154afc337 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.924871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35424b06-2726-4914-95b6-a95154afc337 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.924871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35424b06-2726-4914-95b6-a95154afc337 admin admin] PATH_INFO: `/v3/projects/c8e6db1a282746bfb3792022f5dfca76/users/73456fd084c1435a96f031aae40500aa/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.935105 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35424b06-2726-4914-95b6-a95154afc337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e6db1a282746bfb3792022f5dfca76, user_id=73456fd084c1435a96f031aae40500aa, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.938436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35424b06-2726-4914-95b6-a95154afc337 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:10.008161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1312/2623] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:09 2022] PUT /identity/v3/projects/c8e6db1a282746bfb3792022f5dfca76/users/73456fd084c1435a96f031aae40500aa/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:10.019767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318c73a-b83b-470a-990e-3fe093389811 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.020051 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318c73a-b83b-470a-990e-3fe093389811 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.020319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318c73a-b83b-470a-990e-3fe093389811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.051777 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d318c73a-b83b-470a-990e-3fe093389811 None None] MFA Rules not processed for user `73456fd084c1435a96f031aae40500aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:10.055420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d318c73a-b83b-470a-990e-3fe093389811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:10.122521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1312/2624] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:10.127880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35424b06-2726-4914-95b6-a95154afc337 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:10.160615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:10.191656 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35424b06-2726-4914-95b6-a95154afc337 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:10.196751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728725e-b78c-4023-880a-3a775e8700ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:10.197697 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728725e-b78c-4023-880a-3a775e8700ff admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.198150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728725e-b78c-4023-880a-3a775e8700ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.198819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728725e-b78c-4023-880a-3a775e8700ff admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.199670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728725e-b78c-4023-880a-3a775e8700ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:10.201595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728725e-b78c-4023-880a-3a775e8700ff admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:10.292162 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1313/2625] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:10 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:10.296118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318c73a-b83b-470a-990e-3fe093389811 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:10.311213 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318c73a-b83b-470a-990e-3fe093389811 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:10.379581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5864b-e17d-4ade-96a0-54f1ff81d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:10.380242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5864b-e17d-4ade-96a0-54f1ff81d693 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.380520 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5864b-e17d-4ade-96a0-54f1ff81d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.380786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5864b-e17d-4ade-96a0-54f1ff81d693 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.381417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5864b-e17d-4ade-96a0-54f1ff81d693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:10.383345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5864b-e17d-4ade-96a0-54f1ff81d693 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:10.454096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1313/2626] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:10 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:02:10.458233 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728725e-b78c-4023-880a-3a775e8700ff admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:10.469432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728725e-b78c-4023-880a-3a775e8700ff admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:10.474090 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd249401-c243-4614-b056-69d902008e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:10.474685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd249401-c243-4614-b056-69d902008e4f admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.475007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd249401-c243-4614-b056-69d902008e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.475316 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd249401-c243-4614-b056-69d902008e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.475958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd249401-c243-4614-b056-69d902008e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:10.477554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd249401-c243-4614-b056-69d902008e4f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:10.488334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1314/2627] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:10.492173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5864b-e17d-4ade-96a0-54f1ff81d693 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:10.502149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5864b-e17d-4ade-96a0-54f1ff81d693 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:10.506722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0332ca-b300-43c6-a88e-4659f54753b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:10.507383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0332ca-b300-43c6-a88e-4659f54753b4 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.507665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0332ca-b300-43c6-a88e-4659f54753b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.507942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0332ca-b300-43c6-a88e-4659f54753b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.508584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0332ca-b300-43c6-a88e-4659f54753b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:10.510166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0332ca-b300-43c6-a88e-4659f54753b4 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:10.520154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1314/2628] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:10.524243 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd249401-c243-4614-b056-69d902008e4f admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:10.534751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd249401-c243-4614-b056-69d902008e4f admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:10.539411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a9236-c702-4875-97de-1a5fc0f50795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:10.540052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a9236-c702-4875-97de-1a5fc0f50795 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.540334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a9236-c702-4875-97de-1a5fc0f50795 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.540609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a9236-c702-4875-97de-1a5fc0f50795 admin admin] PATH_INFO: `/v3/projects/dee5f50e89b24647a76eb978ba3a7a83/users/2154b7754a054dbeb94ecb3146231dcc/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.556435 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a9236-c702-4875-97de-1a5fc0f50795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee5f50e89b24647a76eb978ba3a7a83, user_id=2154b7754a054dbeb94ecb3146231dcc, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:10.559131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a9236-c702-4875-97de-1a5fc0f50795 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:10.625071 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1315/2629] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:10 2022] PUT /identity/v3/projects/dee5f50e89b24647a76eb978ba3a7a83/users/2154b7754a054dbeb94ecb3146231dcc/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:02:10.635314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74c958-2a64-48df-bd9f-21411c3e8ea9 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.635601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74c958-2a64-48df-bd9f-21411c3e8ea9 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.635879 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74c958-2a64-48df-bd9f-21411c3e8ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.664347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-1f74c958-2a64-48df-bd9f-21411c3e8ea9 None None] MFA Rules not processed for user `2154b7754a054dbeb94ecb3146231dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:10.665685 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1f74c958-2a64-48df-bd9f-21411c3e8ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:10.713992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:10.730194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1315/2630] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:10.734749 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a9236-c702-4875-97de-1a5fc0f50795 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:10.796705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a9236-c702-4875-97de-1a5fc0f50795 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:10.801465 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2a6dd-2899-4369-b472-b07e0d664dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:10.802068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2a6dd-2899-4369-b472-b07e0d664dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.802349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2a6dd-2899-4369-b472-b07e0d664dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.802625 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2a6dd-2899-4369-b472-b07e0d664dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.803281 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2a6dd-2899-4369-b472-b07e0d664dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:10.805167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2a6dd-2899-4369-b472-b07e0d664dc8 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:10.889293 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1316/2631] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:10 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:10.893326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74c958-2a64-48df-bd9f-21411c3e8ea9 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:10.904869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74c958-2a64-48df-bd9f-21411c3e8ea9 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:10.961249 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6988e2-e353-4d64-b4c4-e5f16a97c906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:10.961857 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6988e2-e353-4d64-b4c4-e5f16a97c906 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.962138 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6988e2-e353-4d64-b4c4-e5f16a97c906 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.962411 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6988e2-e353-4d64-b4c4-e5f16a97c906 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.963101 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6988e2-e353-4d64-b4c4-e5f16a97c906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:10.965061 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6988e2-e353-4d64-b4c4-e5f16a97c906 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:11.076514 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1316/2632] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:10 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:11.080606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2a6dd-2899-4369-b472-b07e0d664dc8 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:11.091627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2a6dd-2899-4369-b472-b07e0d664dc8 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:11.096183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b96bb1-6e67-4219-88c3-645e5eda327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:11.096773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b96bb1-6e67-4219-88c3-645e5eda327b admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.097052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b96bb1-6e67-4219-88c3-645e5eda327b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.097325 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b96bb1-6e67-4219-88c3-645e5eda327b admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.097954 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b96bb1-6e67-4219-88c3-645e5eda327b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:11.099626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b96bb1-6e67-4219-88c3-645e5eda327b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:11.110047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1317/2633] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:11.114143 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6988e2-e353-4d64-b4c4-e5f16a97c906 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:11.123914 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6988e2-e353-4d64-b4c4-e5f16a97c906 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:11.129003 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0454262-61dd-493f-9d36-cbce7617adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:11.129637 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0454262-61dd-493f-9d36-cbce7617adc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.129912 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0454262-61dd-493f-9d36-cbce7617adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.130181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0454262-61dd-493f-9d36-cbce7617adc7 admin admin] PATH_INFO: `/v3/projects/6c01f32bb6e943998090a7e2d1d3cce0/users/546bac09b50b4f05b6425bcd8497c718/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.145220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0454262-61dd-493f-9d36-cbce7617adc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c01f32bb6e943998090a7e2d1d3cce0, user_id=546bac09b50b4f05b6425bcd8497c718, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:11.147858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0454262-61dd-493f-9d36-cbce7617adc7 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:11.213561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1317/2634] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:11 2022] PUT /identity/v3/projects/6c01f32bb6e943998090a7e2d1d3cce0/users/546bac09b50b4f05b6425bcd8497c718/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:11.217551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b96bb1-6e67-4219-88c3-645e5eda327b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:11.227373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b96bb1-6e67-4219-88c3-645e5eda327b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:11.273373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:11.281881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3866950-2fb9-4669-90f1-9fca10554de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:11.291392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3866950-2fb9-4669-90f1-9fca10554de1 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.291392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3866950-2fb9-4669-90f1-9fca10554de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.291392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3866950-2fb9-4669-90f1-9fca10554de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.291392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3866950-2fb9-4669-90f1-9fca10554de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:11.291392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3866950-2fb9-4669-90f1-9fca10554de1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:11.294844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1318/2635] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:11.299066 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0454262-61dd-493f-9d36-cbce7617adc7 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:11.310332 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0454262-61dd-493f-9d36-cbce7617adc7 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:11.315512 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549688c-49bf-4228-a8ba-c3573c790f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:11.316779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549688c-49bf-4228-a8ba-c3573c790f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.320828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549688c-49bf-4228-a8ba-c3573c790f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.320828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549688c-49bf-4228-a8ba-c3573c790f0c admin admin] PATH_INFO: `/v3/projects/6c01f32bb6e943998090a7e2d1d3cce0/users/546bac09b50b4f05b6425bcd8497c718/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.320828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549688c-49bf-4228-a8ba-c3573c790f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c01f32bb6e943998090a7e2d1d3cce0, user_id=546bac09b50b4f05b6425bcd8497c718, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:11.322096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549688c-49bf-4228-a8ba-c3573c790f0c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:11.332710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1318/2636] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:11 2022] PUT /identity/v3/projects/6c01f32bb6e943998090a7e2d1d3cce0/users/546bac09b50b4f05b6425bcd8497c718/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:11.343668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7481606-8dee-4b9c-a989-9240b40bb839 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.343955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7481606-8dee-4b9c-a989-9240b40bb839 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.344232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7481606-8dee-4b9c-a989-9240b40bb839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.372335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f7481606-8dee-4b9c-a989-9240b40bb839 None None] MFA Rules not processed for user `546bac09b50b4f05b6425bcd8497c718`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:11.373557 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f7481606-8dee-4b9c-a989-9240b40bb839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:11.452161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1319/2637] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:11.464481 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549688c-49bf-4228-a8ba-c3573c790f0c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:11.466290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f549688c-49bf-4228-a8ba-c3573c790f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:11.531048 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549688c-49bf-4228-a8ba-c3573c790f0c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:11.534930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804397b-7225-42a5-a25a-1096ca9f220c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:11.535540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804397b-7225-42a5-a25a-1096ca9f220c service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.535822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804397b-7225-42a5-a25a-1096ca9f220c service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.536096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804397b-7225-42a5-a25a-1096ca9f220c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.593487 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804397b-7225-42a5-a25a-1096ca9f220c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:11.594953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804397b-7225-42a5-a25a-1096ca9f220c service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:11.599150 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:11.605437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1319/2638] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:13.641773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7481606-8dee-4b9c-a989-9240b40bb839 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:13.643336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f7481606-8dee-4b9c-a989-9240b40bb839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:13.655664 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804397b-7225-42a5-a25a-1096ca9f220c service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:13.657069 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7481606-8dee-4b9c-a989-9240b40bb839 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:13.657950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7804397b-7225-42a5-a25a-1096ca9f220c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:13.661816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f845ecf-9770-4256-bd68-aaa8b011461a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:13.663012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f845ecf-9770-4256-bd68-aaa8b011461a service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:13.663012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f845ecf-9770-4256-bd68-aaa8b011461a service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:13.663012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f845ecf-9770-4256-bd68-aaa8b011461a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:13.721024 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f845ecf-9770-4256-bd68-aaa8b011461a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:13.722732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f845ecf-9770-4256-bd68-aaa8b011461a service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:13.735052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1320/2639] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:13.747783 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804397b-7225-42a5-a25a-1096ca9f220c service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:13.764597 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad06b1e-b845-47e1-b8ca-337e2bf77454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:13.766083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad06b1e-b845-47e1-b8ca-337e2bf77454 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:13.766373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad06b1e-b845-47e1-b8ca-337e2bf77454 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:13.766754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad06b1e-b845-47e1-b8ca-337e2bf77454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:13.770478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2ad06b1e-b845-47e1-b8ca-337e2bf77454 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:13.794808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad06b1e-b845-47e1-b8ca-337e2bf77454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:13.795734 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad06b1e-b845-47e1-b8ca-337e2bf77454 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:13.814919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1320/2640] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:02:15.197839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f845ecf-9770-4256-bd68-aaa8b011461a service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:15.206612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f845ecf-9770-4256-bd68-aaa8b011461a service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:15.210720 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710138cc-da9f-46f8-b5cb-aa4bbef4bfec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:15.211447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710138cc-da9f-46f8-b5cb-aa4bbef4bfec service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:15.211733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710138cc-da9f-46f8-b5cb-aa4bbef4bfec service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:15.212007 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710138cc-da9f-46f8-b5cb-aa4bbef4bfec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:15.220670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710138cc-da9f-46f8-b5cb-aa4bbef4bfec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:15.222068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710138cc-da9f-46f8-b5cb-aa4bbef4bfec service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:15.232072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1321/2641] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:18.623560 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad06b1e-b845-47e1-b8ca-337e2bf77454 service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:18.633337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad06b1e-b845-47e1-b8ca-337e2bf77454 service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:18.637174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a2e59-11a6-4e28-9cde-70bfa1cd95e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:18.637789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a2e59-11a6-4e28-9cde-70bfa1cd95e7 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:18.638073 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a2e59-11a6-4e28-9cde-70bfa1cd95e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:18.638359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a2e59-11a6-4e28-9cde-70bfa1cd95e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:18.640105 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-3c4a2e59-11a6-4e28-9cde-70bfa1cd95e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:18.710648 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a2e59-11a6-4e28-9cde-70bfa1cd95e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:18.712285 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a2e59-11a6-4e28-9cde-70bfa1cd95e7 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:18.721912 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1321/2642] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:19.889036 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710138cc-da9f-46f8-b5cb-aa4bbef4bfec service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:19.953523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710138cc-da9f-46f8-b5cb-aa4bbef4bfec service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:19.958363 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:19.959020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:19.959302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:19.959574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] PATH_INFO: `/v3/users/73456fd084c1435a96f031aae40500aa` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:19.961036 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73456fd084c1435a96f031aae40500aa)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:19.962584 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:19.964128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=100 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:20.123762 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73456fd084c1435a96f031aae40500aa'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:20.189936 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73456fd084c1435a96f031aae40500aa'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:20.197073 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73456fd084c1435a96f031aae40500aa'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:20.197731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73456fd084c1435a96f031aae40500aa'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:20.210320 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73456fd084c1435a96f031aae40500aa'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:20.216402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1322/2643] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:02:19 2022] DELETE /identity/v3/users/73456fd084c1435a96f031aae40500aa => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:20.220680 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d215-0afc-4009-99c7-be2148501d34 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:20.221160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d215-0afc-4009-99c7-be2148501d34 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:20.221256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d215-0afc-4009-99c7-be2148501d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:20.240480 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-66d0d215-0afc-4009-99c7-be2148501d34 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:20.241670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-66d0d215-0afc-4009-99c7-be2148501d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:20.299082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1322/2644] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:20.308672 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:20.310065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:20.366426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f9c3c-5d96-4202-82e9-efd877166893 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:20.370083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bbcba-5d8e-4dc8-a973-ebea8132de53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:20.370685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bbcba-5d8e-4dc8-a973-ebea8132de53 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:20.370991 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bbcba-5d8e-4dc8-a973-ebea8132de53 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:20.371263 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bbcba-5d8e-4dc8-a973-ebea8132de53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:20.380303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bbcba-5d8e-4dc8-a973-ebea8132de53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:20.381667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bbcba-5d8e-4dc8-a973-ebea8132de53 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:20.391161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1323/2645] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:20.790681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0d215-0afc-4009-99c7-be2148501d34 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:20.792146 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-66d0d215-0afc-4009-99c7-be2148501d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:20.806338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0d215-0afc-4009-99c7-be2148501d34 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:20.811228 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:20.811900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:20.812210 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:20.812489 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] PATH_INFO: `/v3/projects/c8e6db1a282746bfb3792022f5dfca76` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:20.813635 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e6db1a282746bfb3792022f5dfca76)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:20.815586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:20.828938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:20.911173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e6db1a282746bfb3792022f5dfca76', 'request_id': 'req-30ce984f-7403-4afa-86b2-f9506bedd87e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:20.916692 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e6db1a282746bfb3792022f5dfca76', 'request_id': 'req-30ce984f-7403-4afa-86b2-f9506bedd87e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:20.973174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e6db1a282746bfb3792022f5dfca76', 'request_id': 'req-30ce984f-7403-4afa-86b2-f9506bedd87e'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:20.985911 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] The token cache is being invalidate because project c8e6db1a282746bfb3792022f5dfca76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:20.986235 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:20.986841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:20.988446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1323/2646] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:02:20 2022] DELETE /identity/v3/projects/c8e6db1a282746bfb3792022f5dfca76 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:20.993000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bbcba-5d8e-4dc8-a973-ebea8132de53 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:21.003118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bbcba-5d8e-4dc8-a973-ebea8132de53 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:21.062033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:21.062671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:21.062983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:21.063265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] PATH_INFO: `/v3/users/2154b7754a054dbeb94ecb3146231dcc` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:21.064440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2154b7754a054dbeb94ecb3146231dcc)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:21.066387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:21.090405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:21.296120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2154b7754a054dbeb94ecb3146231dcc'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:21.368199 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2154b7754a054dbeb94ecb3146231dcc'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:21.376290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2154b7754a054dbeb94ecb3146231dcc'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:21.376941 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2154b7754a054dbeb94ecb3146231dcc'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:21.389413 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2154b7754a054dbeb94ecb3146231dcc'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:21.395721 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1324/2647] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:02:20 2022] DELETE /identity/v3/users/2154b7754a054dbeb94ecb3146231dcc => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:21.804109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:21.805614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:21.818829 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce984f-7403-4afa-86b2-f9506bedd87e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:21.879112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:21.879743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:21.880019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:21.880287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] PATH_INFO: `/v3/projects/dee5f50e89b24647a76eb978ba3a7a83` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:21.881434 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee5f50e89b24647a76eb978ba3a7a83)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:21.883380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:21.986622 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee5f50e89b24647a76eb978ba3a7a83', 'request_id': 'req-425ccf4d-3df4-4d57-9314-24aab85f5e53'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:21.992155 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee5f50e89b24647a76eb978ba3a7a83', 'request_id': 'req-425ccf4d-3df4-4d57-9314-24aab85f5e53'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:22.206741 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee5f50e89b24647a76eb978ba3a7a83', 'request_id': 'req-425ccf4d-3df4-4d57-9314-24aab85f5e53'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:22.220652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] The token cache is being invalidate because project dee5f50e89b24647a76eb978ba3a7a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:22.220942 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:22.221675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:22.223049 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1324/2648] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:02:21 2022] DELETE /identity/v3/projects/dee5f50e89b24647a76eb978ba3a7a83 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:22.226821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:22.228363 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:22.241271 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3d55f-4040-4cb5-b3d4-82857f1ec995 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:22.301267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8d2fe-b54b-4cc3-b2b8-67a085bd7ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:22.301923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8d2fe-b54b-4cc3-b2b8-67a085bd7ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:22.302206 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8d2fe-b54b-4cc3-b2b8-67a085bd7ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:22.302480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8d2fe-b54b-4cc3-b2b8-67a085bd7ad0 admin admin] PATH_INFO: `/v3/users/546bac09b50b4f05b6425bcd8497c718` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:22.303623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8d2fe-b54b-4cc3-b2b8-67a085bd7ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546bac09b50b4f05b6425bcd8497c718)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:22.305583 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8d2fe-b54b-4cc3-b2b8-67a085bd7ad0 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:22.525239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c7a8d2fe-b54b-4cc3-b2b8-67a085bd7ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546bac09b50b4f05b6425bcd8497c718'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:22.624851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c7a8d2fe-b54b-4cc3-b2b8-67a085bd7ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546bac09b50b4f05b6425bcd8497c718'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:22.632643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c7a8d2fe-b54b-4cc3-b2b8-67a085bd7ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546bac09b50b4f05b6425bcd8497c718'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:22.633287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c7a8d2fe-b54b-4cc3-b2b8-67a085bd7ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546bac09b50b4f05b6425bcd8497c718'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:22.645460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c7a8d2fe-b54b-4cc3-b2b8-67a085bd7ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546bac09b50b4f05b6425bcd8497c718'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:22.651755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1325/2649] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:02:22 2022] DELETE /identity/v3/users/546bac09b50b4f05b6425bcd8497c718 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:23.146508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.147998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:23.160818 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ccf4d-3df4-4d57-9314-24aab85f5e53 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:23.190242 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:23.217812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f86846-f9b9-4918-b3e2-6110121017c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:23.218458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f86846-f9b9-4918-b3e2-6110121017c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.218970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f86846-f9b9-4918-b3e2-6110121017c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.219306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f86846-f9b9-4918-b3e2-6110121017c7 admin admin] PATH_INFO: `/v3/projects/6c01f32bb6e943998090a7e2d1d3cce0` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.220920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f86846-f9b9-4918-b3e2-6110121017c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c01f32bb6e943998090a7e2d1d3cce0)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:23.222971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f86846-f9b9-4918-b3e2-6110121017c7 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:23.368669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-30f86846-f9b9-4918-b3e2-6110121017c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c01f32bb6e943998090a7e2d1d3cce0', 'request_id': 'req-30f86846-f9b9-4918-b3e2-6110121017c7'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:23.374405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-30f86846-f9b9-4918-b3e2-6110121017c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c01f32bb6e943998090a7e2d1d3cce0', 'request_id': 'req-30f86846-f9b9-4918-b3e2-6110121017c7'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:23.457489 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-30f86846-f9b9-4918-b3e2-6110121017c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c01f32bb6e943998090a7e2d1d3cce0', 'request_id': 'req-30f86846-f9b9-4918-b3e2-6110121017c7'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:23.469816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-30f86846-f9b9-4918-b3e2-6110121017c7 admin admin] The token cache is being invalidate because project 6c01f32bb6e943998090a7e2d1d3cce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:23.470104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-30f86846-f9b9-4918-b3e2-6110121017c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:23.470716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-30f86846-f9b9-4918-b3e2-6110121017c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:23.472256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1325/2650] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:02:23 2022] DELETE /identity/v3/projects/6c01f32bb6e943998090a7e2d1d3cce0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:23.477803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45591a-e2b4-4c84-9123-5fad66705653 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.478280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45591a-e2b4-4c84-9123-5fad66705653 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.478378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45591a-e2b4-4c84-9123-5fad66705653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.498827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8f45591a-e2b4-4c84-9123-5fad66705653 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:23.500062 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8f45591a-e2b4-4c84-9123-5fad66705653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:23.513045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:23.558795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1326/2651] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:23.566650 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9357-be9f-454a-a18d-92d771649272 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.566990 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9357-be9f-454a-a18d-92d771649272 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.567266 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9357-be9f-454a-a18d-92d771649272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.589264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a2ed9357-be9f-454a-a18d-92d771649272 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:23.590508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a2ed9357-be9f-454a-a18d-92d771649272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:23.598520 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1326/2652] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:23.603020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45591a-e2b4-4c84-9123-5fad66705653 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.612708 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45591a-e2b4-4c84-9123-5fad66705653 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:23.617441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54685370-965f-43d3-83ce-7f6a09cc94d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:23.618034 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54685370-965f-43d3-83ce-7f6a09cc94d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.618341 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54685370-965f-43d3-83ce-7f6a09cc94d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.618617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54685370-965f-43d3-83ce-7f6a09cc94d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.619321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54685370-965f-43d3-83ce-7f6a09cc94d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:23.623347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54685370-965f-43d3-83ce-7f6a09cc94d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:23.623347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54685370-965f-43d3-83ce-7f6a09cc94d1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:23.633485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1327/2653] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:23.637886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed9357-be9f-454a-a18d-92d771649272 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.647929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed9357-be9f-454a-a18d-92d771649272 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:23.653052 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61130-d8da-4622-8941-77ee63847db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:23.653642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61130-d8da-4622-8941-77ee63847db6 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.653916 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61130-d8da-4622-8941-77ee63847db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.654185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61130-d8da-4622-8941-77ee63847db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.654802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd61130-d8da-4622-8941-77ee63847db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:23.656752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd61130-d8da-4622-8941-77ee63847db6 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:23.767237 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1327/2654] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:23 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:23.768717 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54685370-965f-43d3-83ce-7f6a09cc94d1 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.788178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54685370-965f-43d3-83ce-7f6a09cc94d1 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:23.846330 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8005b6-c87e-4532-9980-7c91e96ffd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:23.846969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8005b6-c87e-4532-9980-7c91e96ffd7f admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.847259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8005b6-c87e-4532-9980-7c91e96ffd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.847530 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8005b6-c87e-4532-9980-7c91e96ffd7f admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.848149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8005b6-c87e-4532-9980-7c91e96ffd7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:23.850083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8005b6-c87e-4532-9980-7c91e96ffd7f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:23.960195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1328/2655] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:23 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:23.961750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61130-d8da-4622-8941-77ee63847db6 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.972079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61130-d8da-4622-8941-77ee63847db6 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:23.976743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5bf15-61a4-4d7e-8a42-9babef738cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:23.977336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5bf15-61a4-4d7e-8a42-9babef738cae admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.977621 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5bf15-61a4-4d7e-8a42-9babef738cae admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.977892 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5bf15-61a4-4d7e-8a42-9babef738cae admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.978573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5bf15-61a4-4d7e-8a42-9babef738cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:23.980231 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5bf15-61a4-4d7e-8a42-9babef738cae admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:23.990713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1328/2656] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:23.994861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8005b6-c87e-4532-9980-7c91e96ffd7f admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:24.004862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8005b6-c87e-4532-9980-7c91e96ffd7f admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:24.010224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57052ee6-1ea9-4e0a-bd69-297d01ce93d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:24.010815 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57052ee6-1ea9-4e0a-bd69-297d01ce93d9 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:24.011131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57052ee6-1ea9-4e0a-bd69-297d01ce93d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:24.011403 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57052ee6-1ea9-4e0a-bd69-297d01ce93d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:24.012064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57052ee6-1ea9-4e0a-bd69-297d01ce93d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:24.013634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57052ee6-1ea9-4e0a-bd69-297d01ce93d9 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:24.025796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1329/2657] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:24.030803 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5bf15-61a4-4d7e-8a42-9babef738cae admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:24.040138 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5bf15-61a4-4d7e-8a42-9babef738cae admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:24.045214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab8119-2a37-4939-bbbe-7af9ff02c21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:24.049581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab8119-2a37-4939-bbbe-7af9ff02c21b admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:24.049581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab8119-2a37-4939-bbbe-7af9ff02c21b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:24.049581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab8119-2a37-4939-bbbe-7af9ff02c21b admin admin] PATH_INFO: `/v3/projects/bc3b65f1381a49bb9588b81a77548642/users/7fc337675d484bf789d9867cd768d3d9/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:24.062282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab8119-2a37-4939-bbbe-7af9ff02c21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3b65f1381a49bb9588b81a77548642, user_id=7fc337675d484bf789d9867cd768d3d9, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:24.065131 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab8119-2a37-4939-bbbe-7af9ff02c21b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:24.171944 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1329/2658] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:24 2022] PUT /identity/v3/projects/bc3b65f1381a49bb9588b81a77548642/users/7fc337675d484bf789d9867cd768d3d9/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:02:24.183083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9757f-47c3-45ef-a7f8-2b0e7bfc14bc None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:24.183470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9757f-47c3-45ef-a7f8-2b0e7bfc14bc None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:24.183663 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9757f-47c3-45ef-a7f8-2b0e7bfc14bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:24.212752 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-fbe9757f-47c3-45ef-a7f8-2b0e7bfc14bc None None] MFA Rules not processed for user `7fc337675d484bf789d9867cd768d3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:24.213986 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fbe9757f-47c3-45ef-a7f8-2b0e7bfc14bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:24.279002 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1330/2659] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:24.290558 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab8119-2a37-4939-bbbe-7af9ff02c21b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:24.292271 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-74ab8119-2a37-4939-bbbe-7af9ff02c21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:24.350601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab8119-2a37-4939-bbbe-7af9ff02c21b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:24.354385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5186717-3653-4720-8258-8ad91def550c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:24.355020 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5186717-3653-4720-8258-8ad91def550c service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:24.355303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5186717-3653-4720-8258-8ad91def550c service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:24.355579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5186717-3653-4720-8258-8ad91def550c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:24.363752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5186717-3653-4720-8258-8ad91def550c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:24.365835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5186717-3653-4720-8258-8ad91def550c service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:24.370378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:24.374854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1330/2660] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:34.276156 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:35.989916 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9757f-47c3-45ef-a7f8-2b0e7bfc14bc None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:36.053803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9757f-47c3-45ef-a7f8-2b0e7bfc14bc None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:36.058558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:36.059219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.059518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.059781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] PATH_INFO: `/v3/users/7fc337675d484bf789d9867cd768d3d9` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.060897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc337675d484bf789d9867cd768d3d9)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:36.062924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:36.261214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc337675d484bf789d9867cd768d3d9'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:36.361778 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc337675d484bf789d9867cd768d3d9'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:36.370980 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc337675d484bf789d9867cd768d3d9'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:36.371822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc337675d484bf789d9867cd768d3d9'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:36.387921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc337675d484bf789d9867cd768d3d9'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:36.397404 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1331/2661] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:02:35 2022] DELETE /identity/v3/users/7fc337675d484bf789d9867cd768d3d9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:36.399523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a0260-baea-4231-9c2e-3f0b82085836 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.399951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a0260-baea-4231-9c2e-3f0b82085836 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.400264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a0260-baea-4231-9c2e-3f0b82085836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.425650 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-884a0260-baea-4231-9c2e-3f0b82085836 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:36.426867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-884a0260-baea-4231-9c2e-3f0b82085836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:36.493435 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1331/2662] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:36.502985 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:36.504437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:36.564781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f13a5-6bed-4f7f-b4e4-abdf998362b1 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:36.568888 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb4552-b97b-4995-a015-5dc023dfefed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:36.569502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb4552-b97b-4995-a015-5dc023dfefed service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.569785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb4552-b97b-4995-a015-5dc023dfefed service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.570059 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb4552-b97b-4995-a015-5dc023dfefed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.583030 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb4552-b97b-4995-a015-5dc023dfefed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:36.584085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb4552-b97b-4995-a015-5dc023dfefed service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:36.597763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1332/2663] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:37.006855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a0260-baea-4231-9c2e-3f0b82085836 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.009715 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-884a0260-baea-4231-9c2e-3f0b82085836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:37.023448 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a0260-baea-4231-9c2e-3f0b82085836 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.032858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c148ab5-f290-4c89-ae15-401ce9bc27b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.032858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c148ab5-f290-4c89-ae15-401ce9bc27b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.032858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c148ab5-f290-4c89-ae15-401ce9bc27b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.032858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c148ab5-f290-4c89-ae15-401ce9bc27b6 admin admin] PATH_INFO: `/v3/projects/bc3b65f1381a49bb9588b81a77548642` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.033234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c148ab5-f290-4c89-ae15-401ce9bc27b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3b65f1381a49bb9588b81a77548642)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.033654 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c148ab5-f290-4c89-ae15-401ce9bc27b6 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.166077 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8c148ab5-f290-4c89-ae15-401ce9bc27b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3b65f1381a49bb9588b81a77548642', 'request_id': 'req-8c148ab5-f290-4c89-ae15-401ce9bc27b6'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:37.171759 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8c148ab5-f290-4c89-ae15-401ce9bc27b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3b65f1381a49bb9588b81a77548642', 'request_id': 'req-8c148ab5-f290-4c89-ae15-401ce9bc27b6'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:37.268014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8c148ab5-f290-4c89-ae15-401ce9bc27b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3b65f1381a49bb9588b81a77548642', 'request_id': 'req-8c148ab5-f290-4c89-ae15-401ce9bc27b6'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:37.280141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8c148ab5-f290-4c89-ae15-401ce9bc27b6 admin admin] The token cache is being invalidate because project bc3b65f1381a49bb9588b81a77548642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:37.280425 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8c148ab5-f290-4c89-ae15-401ce9bc27b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:37.281051 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-8c148ab5-f290-4c89-ae15-401ce9bc27b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:37.282565 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1332/2664] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:02:37 2022] DELETE /identity/v3/projects/bc3b65f1381a49bb9588b81a77548642 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:37.289064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd1bd8-6d7b-46af-a0da-a2a42751075b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.289532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd1bd8-6d7b-46af-a0da-a2a42751075b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.289628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd1bd8-6d7b-46af-a0da-a2a42751075b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.309204 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-9dcd1bd8-6d7b-46af-a0da-a2a42751075b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:37.310417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9dcd1bd8-6d7b-46af-a0da-a2a42751075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:37.327878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:37.370785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1333/2665] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:37.378511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135704-8e11-4711-9611-d923af1196bf None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.378803 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135704-8e11-4711-9611-d923af1196bf None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.379144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135704-8e11-4711-9611-d923af1196bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.400532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-fc135704-8e11-4711-9611-d923af1196bf None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:37.401752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-fc135704-8e11-4711-9611-d923af1196bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:37.409957 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1333/2666] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:37.419387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd1bd8-6d7b-46af-a0da-a2a42751075b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.429641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd1bd8-6d7b-46af-a0da-a2a42751075b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.443983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfca5b-52b4-4b78-9644-5a96ffc44cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.443983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfca5b-52b4-4b78-9644-5a96ffc44cac admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.443983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfca5b-52b4-4b78-9644-5a96ffc44cac admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.443983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfca5b-52b4-4b78-9644-5a96ffc44cac admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.445628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfca5b-52b4-4b78-9644-5a96ffc44cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:37.445628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfca5b-52b4-4b78-9644-5a96ffc44cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.445628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfca5b-52b4-4b78-9644-5a96ffc44cac admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.450150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1334/2667] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:37.454491 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135704-8e11-4711-9611-d923af1196bf None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.465258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135704-8e11-4711-9611-d923af1196bf None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.470259 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e7e8d-8a5b-48f1-9fbc-f8fec4db22c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.471035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e7e8d-8a5b-48f1-9fbc-f8fec4db22c8 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.471318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e7e8d-8a5b-48f1-9fbc-f8fec4db22c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.471743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e7e8d-8a5b-48f1-9fbc-f8fec4db22c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.472199 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e7e8d-8a5b-48f1-9fbc-f8fec4db22c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.474207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e7e8d-8a5b-48f1-9fbc-f8fec4db22c8 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.585910 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1334/2668] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:37 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:37.590174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfca5b-52b4-4b78-9644-5a96ffc44cac admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.600144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfca5b-52b4-4b78-9644-5a96ffc44cac admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.657232 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cc0d4-74f1-43b6-b20d-e8ce87909101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.658009 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cc0d4-74f1-43b6-b20d-e8ce87909101 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.658303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cc0d4-74f1-43b6-b20d-e8ce87909101 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.658764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cc0d4-74f1-43b6-b20d-e8ce87909101 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.659836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cc0d4-74f1-43b6-b20d-e8ce87909101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.661859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cc0d4-74f1-43b6-b20d-e8ce87909101 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.773142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1335/2669] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:37 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:37.777516 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e7e8d-8a5b-48f1-9fbc-f8fec4db22c8 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.788787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e7e8d-8a5b-48f1-9fbc-f8fec4db22c8 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.793403 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2bbd7-72c2-4c47-a063-a04704e893b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.794019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2bbd7-72c2-4c47-a063-a04704e893b1 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.794299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2bbd7-72c2-4c47-a063-a04704e893b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.794629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2bbd7-72c2-4c47-a063-a04704e893b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.795337 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2bbd7-72c2-4c47-a063-a04704e893b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.796918 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2bbd7-72c2-4c47-a063-a04704e893b1 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.807737 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1335/2670] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:37.811688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cc0d4-74f1-43b6-b20d-e8ce87909101 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.821854 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cc0d4-74f1-43b6-b20d-e8ce87909101 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.826972 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb8c1c-4466-4d09-b0ab-33b2771d604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.827573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb8c1c-4466-4d09-b0ab-33b2771d604d admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.827849 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb8c1c-4466-4d09-b0ab-33b2771d604d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.828195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb8c1c-4466-4d09-b0ab-33b2771d604d admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.828816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb8c1c-4466-4d09-b0ab-33b2771d604d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.830649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb8c1c-4466-4d09-b0ab-33b2771d604d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.843922 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1336/2671] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:37.847082 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2bbd7-72c2-4c47-a063-a04704e893b1 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.859453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2bbd7-72c2-4c47-a063-a04704e893b1 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.864270 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727429a-1fb8-4bbb-bb0e-e4fd1fd2e155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.864920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727429a-1fb8-4bbb-bb0e-e4fd1fd2e155 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.865202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727429a-1fb8-4bbb-bb0e-e4fd1fd2e155 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.865477 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727429a-1fb8-4bbb-bb0e-e4fd1fd2e155 admin admin] PATH_INFO: `/v3/projects/bdf7d023bf454edf9c31e50ee0c10bcd/users/79c324b271244bc588fbbf538f438038/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.881717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727429a-1fb8-4bbb-bb0e-e4fd1fd2e155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf7d023bf454edf9c31e50ee0c10bcd, user_id=79c324b271244bc588fbbf538f438038, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.884472 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727429a-1fb8-4bbb-bb0e-e4fd1fd2e155 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.960140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1336/2672] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:37 2022] PUT /identity/v3/projects/bdf7d023bf454edf9c31e50ee0c10bcd/users/79c324b271244bc588fbbf538f438038/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:37.965301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6dc2b-72a1-4559-99a8-bca28f5917a4 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.965581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6dc2b-72a1-4559-99a8-bca28f5917a4 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.965850 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6dc2b-72a1-4559-99a8-bca28f5917a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.986261 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-25c6dc2b-72a1-4559-99a8-bca28f5917a4 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:37.987508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-25c6dc2b-72a1-4559-99a8-bca28f5917a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:38.047190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1337/2673] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:38.060390 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727429a-1fb8-4bbb-bb0e-e4fd1fd2e155 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:38.062089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4727429a-1fb8-4bbb-bb0e-e4fd1fd2e155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:38.084815 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:38.128030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727429a-1fb8-4bbb-bb0e-e4fd1fd2e155 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:38.133290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc0302-9418-42c7-983f-879e9c157e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:38.133903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc0302-9418-42c7-983f-879e9c157e5f service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:38.145503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc0302-9418-42c7-983f-879e9c157e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:38.145503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc0302-9418-42c7-983f-879e9c157e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:38.145503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc0302-9418-42c7-983f-879e9c157e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:38.145503 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc0302-9418-42c7-983f-879e9c157e5f service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:38.155207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1337/2674] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:39.987579 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6dc2b-72a1-4559-99a8-bca28f5917a4 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:39.996641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6dc2b-72a1-4559-99a8-bca28f5917a4 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:40.000420 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e105e-11fe-486a-9517-336416026b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:40.001065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e105e-11fe-486a-9517-336416026b99 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:40.001392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e105e-11fe-486a-9517-336416026b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:40.001551 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e105e-11fe-486a-9517-336416026b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:40.003376 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fc8e105e-11fe-486a-9517-336416026b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:40.028013 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e105e-11fe-486a-9517-336416026b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:40.029549 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e105e-11fe-486a-9517-336416026b99 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:40.043140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1338/2675] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:02:41.669368 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc0302-9418-42c7-983f-879e9c157e5f service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:41.671056 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9dbc0302-9418-42c7-983f-879e9c157e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:41.768042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc0302-9418-42c7-983f-879e9c157e5f service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:41.774005 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b41f4-13df-4a53-a21b-242c0a02f6a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:41.774623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b41f4-13df-4a53-a21b-242c0a02f6a2 service placement] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:41.774951 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b41f4-13df-4a53-a21b-242c0a02f6a2 service placement] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:41.775236 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b41f4-13df-4a53-a21b-242c0a02f6a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:41.777039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a20b41f4-13df-4a53-a21b-242c0a02f6a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:41.792283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b41f4-13df-4a53-a21b-242c0a02f6a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:41.794394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b41f4-13df-4a53-a21b-242c0a02f6a2 service placement] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:41.806557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1338/2676] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:42.631907 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e105e-11fe-486a-9517-336416026b99 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:42.633377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fc8e105e-11fe-486a-9517-336416026b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:42.646244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e105e-11fe-486a-9517-336416026b99 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:42.658619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:42.658619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:42.658619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:42.658619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] PATH_INFO: `/v3/users/a0d77ec60b3247b1928451dde30245dd` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:42.659186 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d77ec60b3247b1928451dde30245dd)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:42.659961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:42.675026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:42.882777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d77ec60b3247b1928451dde30245dd'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:42.988370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d77ec60b3247b1928451dde30245dd'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:42.998615 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d77ec60b3247b1928451dde30245dd'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:43.000921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d77ec60b3247b1928451dde30245dd'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:43.035699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d77ec60b3247b1928451dde30245dd'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:43.045639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1339/2677] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:02:42 2022] DELETE /identity/v3/users/a0d77ec60b3247b1928451dde30245dd => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:43.625677 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b41f4-13df-4a53-a21b-242c0a02f6a2 service placement] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:43.641976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b41f4-13df-4a53-a21b-242c0a02f6a2 service placement] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.723564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.724225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.724507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.724787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] PATH_INFO: `/v3/projects/a4f557c34d6b4ed8b26ca144bdc4eb36` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.725995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4f557c34d6b4ed8b26ca144bdc4eb36)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:43.728598 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:43.924410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4f557c34d6b4ed8b26ca144bdc4eb36', 'request_id': 'req-0d0f54c7-d322-4de5-acce-4ce9b7126853'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:43.931323 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:43.958270 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4f557c34d6b4ed8b26ca144bdc4eb36', 'request_id': 'req-0d0f54c7-d322-4de5-acce-4ce9b7126853'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:44.092755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4f557c34d6b4ed8b26ca144bdc4eb36', 'request_id': 'req-0d0f54c7-d322-4de5-acce-4ce9b7126853'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:44.105243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] The token cache is being invalidate because project a4f557c34d6b4ed8b26ca144bdc4eb36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:44.105532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:44.106160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:44.107655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1339/2678] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:02:43 2022] DELETE /identity/v3/projects/a4f557c34d6b4ed8b26ca144bdc4eb36 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:44.112090 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.113589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:44.135004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bdbe1-cb35-4633-bc95-17cea5fd6320 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:44.211441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba27020-8d7d-4b3a-83ab-9eda84b315b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:44.212370 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba27020-8d7d-4b3a-83ab-9eda84b315b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:44.214002 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba27020-8d7d-4b3a-83ab-9eda84b315b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:44.214002 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba27020-8d7d-4b3a-83ab-9eda84b315b5 admin admin] PATH_INFO: `/v3/users/ca904d1ecc8c40f7a9a62a9cb3543142` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:44.221521 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba27020-8d7d-4b3a-83ab-9eda84b315b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca904d1ecc8c40f7a9a62a9cb3543142)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:44.223857 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba27020-8d7d-4b3a-83ab-9eda84b315b5 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:44.457480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-7ba27020-8d7d-4b3a-83ab-9eda84b315b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca904d1ecc8c40f7a9a62a9cb3543142'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:44.589918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-7ba27020-8d7d-4b3a-83ab-9eda84b315b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca904d1ecc8c40f7a9a62a9cb3543142'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:44.600730 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-7ba27020-8d7d-4b3a-83ab-9eda84b315b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca904d1ecc8c40f7a9a62a9cb3543142'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:44.601777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-7ba27020-8d7d-4b3a-83ab-9eda84b315b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca904d1ecc8c40f7a9a62a9cb3543142'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:44.622112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-7ba27020-8d7d-4b3a-83ab-9eda84b315b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca904d1ecc8c40f7a9a62a9cb3543142'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:44.651634 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1340/2679] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:02:44 2022] DELETE /identity/v3/users/ca904d1ecc8c40f7a9a62a9cb3543142 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:45.142012 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.144600 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:45.166856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f54c7-d322-4de5-acce-4ce9b7126853 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.262565 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.263407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.263820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.264194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf admin admin] PATH_INFO: `/v3/projects/b1e348ba5fd04e3aab9d292eb1ec97c6` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.265465 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e348ba5fd04e3aab9d292eb1ec97c6)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.267684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.418549 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e348ba5fd04e3aab9d292eb1ec97c6', 'request_id': 'req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:45.426828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e348ba5fd04e3aab9d292eb1ec97c6', 'request_id': 'req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:45.509896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e348ba5fd04e3aab9d292eb1ec97c6', 'request_id': 'req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:45.524657 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf admin admin] The token cache is being invalidate because project b1e348ba5fd04e3aab9d292eb1ec97c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:45.525217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:45.526208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-de0a4a5f-54cc-48f3-bd30-21b44a327ddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:45.527986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1340/2680] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:02:45 2022] DELETE /identity/v3/projects/b1e348ba5fd04e3aab9d292eb1ec97c6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:45.532852 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b936d03-01c0-431b-a045-7fc13568b245 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.533363 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b936d03-01c0-431b-a045-7fc13568b245 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.533460 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b936d03-01c0-431b-a045-7fc13568b245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.551686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:45.559535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4b936d03-01c0-431b-a045-7fc13568b245 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:45.560923 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4b936d03-01c0-431b-a045-7fc13568b245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:45.672196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1341/2681] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:45.679886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378957-6312-4d4b-81d6-d76c0caa4774 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.680730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378957-6312-4d4b-81d6-d76c0caa4774 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.682433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378957-6312-4d4b-81d6-d76c0caa4774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.711280 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d6378957-6312-4d4b-81d6-d76c0caa4774 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:45.712767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d6378957-6312-4d4b-81d6-d76c0caa4774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:45.721130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1341/2682] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:45.726280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b936d03-01c0-431b-a045-7fc13568b245 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.740001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b936d03-01c0-431b-a045-7fc13568b245 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.746856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40217a2a-f2a7-481e-9a03-70505cd1ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.747590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40217a2a-f2a7-481e-9a03-70505cd1ba6a admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.747873 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40217a2a-f2a7-481e-9a03-70505cd1ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.748268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40217a2a-f2a7-481e-9a03-70505cd1ba6a admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.749832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40217a2a-f2a7-481e-9a03-70505cd1ba6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:45.751132 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40217a2a-f2a7-481e-9a03-70505cd1ba6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.753349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40217a2a-f2a7-481e-9a03-70505cd1ba6a admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.768779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1342/2683] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:45.773913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6378957-6312-4d4b-81d6-d76c0caa4774 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.790128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6378957-6312-4d4b-81d6-d76c0caa4774 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.795025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce0c6f-0097-4aaf-9cc0-9ed34120e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.795642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce0c6f-0097-4aaf-9cc0-9ed34120e58e admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.795922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce0c6f-0097-4aaf-9cc0-9ed34120e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.796220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce0c6f-0097-4aaf-9cc0-9ed34120e58e admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.796865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce0c6f-0097-4aaf-9cc0-9ed34120e58e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.798776 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce0c6f-0097-4aaf-9cc0-9ed34120e58e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.883559 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db9a5d-f4d9-423e-a3d0-326f9a356603 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.883868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db9a5d-f4d9-423e-a3d0-326f9a356603 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.884273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db9a5d-f4d9-423e-a3d0-326f9a356603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.918727 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-16db9a5d-f4d9-423e-a3d0-326f9a356603 None None] MFA Rules not processed for user `79c324b271244bc588fbbf538f438038`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:45.920428 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-16db9a5d-f4d9-423e-a3d0-326f9a356603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:45.938109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1342/2684] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:45 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:45.939433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce0c6f-0097-4aaf-9cc0-9ed34120e58e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.992506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:45.993020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1343/2685] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:45.997447 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db9a5d-f4d9-423e-a3d0-326f9a356603 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.998746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-16db9a5d-f4d9-423e-a3d0-326f9a356603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:46.011540 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce0c6f-0097-4aaf-9cc0-9ed34120e58e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.014858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db9a5d-f4d9-423e-a3d0-326f9a356603 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.016877 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85377981-3e72-44c6-9d6f-cfbd32817d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.017507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377981-3e72-44c6-9d6f-cfbd32817d32 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.017927 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377981-3e72-44c6-9d6f-cfbd32817d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.018207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377981-3e72-44c6-9d6f-cfbd32817d32 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.019161 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85377981-3e72-44c6-9d6f-cfbd32817d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.019813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee79c5-6da4-489a-ae7a-104be8e33ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.020419 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee79c5-6da4-489a-ae7a-104be8e33ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.020699 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee79c5-6da4-489a-ae7a-104be8e33ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.020966 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85377981-3e72-44c6-9d6f-cfbd32817d32 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.021073 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee79c5-6da4-489a-ae7a-104be8e33ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.021592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee79c5-6da4-489a-ae7a-104be8e33ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.024174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee79c5-6da4-489a-ae7a-104be8e33ac4 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.129329 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1343/2686] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:45 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:02:46.130324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85377981-3e72-44c6-9d6f-cfbd32817d32 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.132676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1344/2687] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:45 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:02:46.133533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-85377981-3e72-44c6-9d6f-cfbd32817d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:46.133704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee79c5-6da4-489a-ae7a-104be8e33ac4 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.152919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85377981-3e72-44c6-9d6f-cfbd32817d32 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.205815 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee79c5-6da4-489a-ae7a-104be8e33ac4 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.211143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fe56b-e5c6-4952-8c1b-01a9feca0592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.211786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fe56b-e5c6-4952-8c1b-01a9feca0592 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.212064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fe56b-e5c6-4952-8c1b-01a9feca0592 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.212332 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fe56b-e5c6-4952-8c1b-01a9feca0592 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.212966 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fe56b-e5c6-4952-8c1b-01a9feca0592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.214532 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fe56b-e5c6-4952-8c1b-01a9feca0592 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.216605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:46.217495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.218152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.218441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.218720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] PATH_INFO: `/v3/users/3c8d932499ee46cb9179ef5b49c3dae1` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.219913 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8d932499ee46cb9179ef5b49c3dae1)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.221846 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.225397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1345/2688] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:46.230783 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fe56b-e5c6-4952-8c1b-01a9feca0592 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.236577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fe56b-e5c6-4952-8c1b-01a9feca0592 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.241612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8796242-be58-4d06-84ac-9df4c0b6b7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.242212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796242-be58-4d06-84ac-9df4c0b6b7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.242489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796242-be58-4d06-84ac-9df4c0b6b7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.242758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796242-be58-4d06-84ac-9df4c0b6b7b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.243412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8796242-be58-4d06-84ac-9df4c0b6b7b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.245309 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8796242-be58-4d06-84ac-9df4c0b6b7b4 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.368550 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1346/2689] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:46 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:46.369467 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8796242-be58-4d06-84ac-9df4c0b6b7b4 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.379958 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8796242-be58-4d06-84ac-9df4c0b6b7b4 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.385577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774621e-a0ef-47ff-b8d4-4dd70aa669a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.386209 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774621e-a0ef-47ff-b8d4-4dd70aa669a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.388083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774621e-a0ef-47ff-b8d4-4dd70aa669a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.388083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774621e-a0ef-47ff-b8d4-4dd70aa669a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.388083 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774621e-a0ef-47ff-b8d4-4dd70aa669a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.389040 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774621e-a0ef-47ff-b8d4-4dd70aa669a2 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.399877 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1347/2690] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:46.400792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774621e-a0ef-47ff-b8d4-4dd70aa669a2 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.410550 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774621e-a0ef-47ff-b8d4-4dd70aa669a2 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.416779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccae47a-bfb4-41d3-a4ed-343a426d428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.416779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccae47a-bfb4-41d3-a4ed-343a426d428e admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.416779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccae47a-bfb4-41d3-a4ed-343a426d428e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.416779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccae47a-bfb4-41d3-a4ed-343a426d428e admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.417250 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccae47a-bfb4-41d3-a4ed-343a426d428e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.418814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccae47a-bfb4-41d3-a4ed-343a426d428e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.421357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8d932499ee46cb9179ef5b49c3dae1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:46.429622 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1348/2691] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:46.430642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccae47a-bfb4-41d3-a4ed-343a426d428e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.435356 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8d932499ee46cb9179ef5b49c3dae1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:46.440489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccae47a-bfb4-41d3-a4ed-343a426d428e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.445374 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8d932499ee46cb9179ef5b49c3dae1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:46.446196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3db67e-a360-468b-936f-f6d95b8c70f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.446566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8d932499ee46cb9179ef5b49c3dae1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:46.447051 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db67e-a360-468b-936f-f6d95b8c70f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.447379 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db67e-a360-468b-936f-f6d95b8c70f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.447724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db67e-a360-468b-936f-f6d95b8c70f8 admin admin] PATH_INFO: `/v3/projects/3983cae47d404713a4c2ab67fdf782ee/users/65964f5632a143cdb122a1fa4c6db28a/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.447977 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8d932499ee46cb9179ef5b49c3dae1'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:46.463190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3db67e-a360-468b-936f-f6d95b8c70f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3983cae47d404713a4c2ab67fdf782ee, user_id=65964f5632a143cdb122a1fa4c6db28a, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.465869 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3db67e-a360-468b-936f-f6d95b8c70f8 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.515409 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1344/2692] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:02:46 2022] DELETE /identity/v3/users/3c8d932499ee46cb9179ef5b49c3dae1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:46.516857 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.517823 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:46.544786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1349/2693] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:46 2022] PUT /identity/v3/projects/3983cae47d404713a4c2ab67fdf782ee/users/65964f5632a143cdb122a1fa4c6db28a/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:46.584732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:46.598543 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17d599-4de9-47c1-a747-770caba4b902 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.614426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac2e95-d2c5-440f-9228-c09b63ea2883 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.615026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac2e95-d2c5-440f-9228-c09b63ea2883 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.615293 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac2e95-d2c5-440f-9228-c09b63ea2883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.667322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddbce1-987c-49bd-8c1e-6b936c2e2427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.668191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddbce1-987c-49bd-8c1e-6b936c2e2427 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.668555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddbce1-987c-49bd-8c1e-6b936c2e2427 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.668678 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-41ac2e95-d2c5-440f-9228-c09b63ea2883 None None] MFA Rules not processed for user `65964f5632a143cdb122a1fa4c6db28a`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:46.668835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddbce1-987c-49bd-8c1e-6b936c2e2427 admin admin] PATH_INFO: `/v3/projects/7aff84c479344861ba16584214dad26a/users/649e5e6756094875999fabb2399001f4/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.670648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-41ac2e95-d2c5-440f-9228-c09b63ea2883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:46.688283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddbce1-987c-49bd-8c1e-6b936c2e2427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aff84c479344861ba16584214dad26a, user_id=649e5e6756094875999fabb2399001f4, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.692090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddbce1-987c-49bd-8c1e-6b936c2e2427 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.764333 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1350/2694] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:46.775500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac2e95-d2c5-440f-9228-c09b63ea2883 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.777123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-41ac2e95-d2c5-440f-9228-c09b63ea2883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:46.785180 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1345/2695] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:46 2022] PUT /identity/v3/projects/7aff84c479344861ba16584214dad26a/users/649e5e6756094875999fabb2399001f4/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:46.792024 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddbce1-987c-49bd-8c1e-6b936c2e2427 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.871805 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac2e95-d2c5-440f-9228-c09b63ea2883 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.871967 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddbce1-987c-49bd-8c1e-6b936c2e2427 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.877611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4159c4-4cb9-40f8-b270-d1c75941c11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.878723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4159c4-4cb9-40f8-b270-d1c75941c11d admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.878723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4159c4-4cb9-40f8-b270-d1c75941c11d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.878952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4159c4-4cb9-40f8-b270-d1c75941c11d admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.879740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4159c4-4cb9-40f8-b270-d1c75941c11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.881263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4159c4-4cb9-40f8-b270-d1c75941c11d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.895013 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1346/2696] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:02:46.895987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4159c4-4cb9-40f8-b270-d1c75941c11d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.898694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8a4159c4-4cb9-40f8-b270-d1c75941c11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:46.920681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4159c4-4cb9-40f8-b270-d1c75941c11d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.923467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.924194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.924925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.924925 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149 admin admin] PATH_INFO: `/v3/projects/f04f2be160c74ddc8ea264447fbd1fe9` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.929079 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04f2be160c74ddc8ea264447fbd1fe9)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.932433 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.939455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:46.961563 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca21ee7-7ce4-4094-9cb5-f32d7cc97583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.962227 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca21ee7-7ce4-4094-9cb5-f32d7cc97583 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.962569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca21ee7-7ce4-4094-9cb5-f32d7cc97583 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.963153 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca21ee7-7ce4-4094-9cb5-f32d7cc97583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.028035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca21ee7-7ce4-4094-9cb5-f32d7cc97583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:47.029785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca21ee7-7ce4-4094-9cb5-f32d7cc97583 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:47.041047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1351/2697] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:02:47.041953 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca21ee7-7ce4-4094-9cb5-f32d7cc97583 service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:47.053944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca21ee7-7ce4-4094-9cb5-f32d7cc97583 service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:47.060570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd0082-156a-4dc4-9423-24eb2d2b95d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:47.061703 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd0082-156a-4dc4-9423-24eb2d2b95d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.061992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd0082-156a-4dc4-9423-24eb2d2b95d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.062397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd0082-156a-4dc4-9423-24eb2d2b95d3 admin admin] PATH_INFO: `/v3/projects/7aff84c479344861ba16584214dad26a/users/649e5e6756094875999fabb2399001f4/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.064929 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd0082-156a-4dc4-9423-24eb2d2b95d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aff84c479344861ba16584214dad26a, user_id=649e5e6756094875999fabb2399001f4, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:47.067866 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd0082-156a-4dc4-9423-24eb2d2b95d3 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:47.082230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1352/2698] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:47 2022] PUT /identity/v3/projects/7aff84c479344861ba16584214dad26a/users/649e5e6756094875999fabb2399001f4/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:47.125946 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04f2be160c74ddc8ea264447fbd1fe9', 'request_id': 'req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:47.134194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04f2be160c74ddc8ea264447fbd1fe9', 'request_id': 'req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:47.217890 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04f2be160c74ddc8ea264447fbd1fe9', 'request_id': 'req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:47.231117 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149 admin admin] The token cache is being invalidate because project f04f2be160c74ddc8ea264447fbd1fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:47.231410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:47.232072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-7c5a2235-c1ad-4fa3-93e2-aeb8583fa149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:47.233576 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1347/2699] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:02:46 2022] DELETE /identity/v3/projects/f04f2be160c74ddc8ea264447fbd1fe9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:47.238500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea5e67-0394-4481-af1c-d89a4614b1a1 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.238796 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea5e67-0394-4481-af1c-d89a4614b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.239155 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea5e67-0394-4481-af1c-d89a4614b1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.268037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-89ea5e67-0394-4481-af1c-d89a4614b1a1 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:47.269432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-89ea5e67-0394-4481-af1c-d89a4614b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:47.373545 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1353/2700] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:47.381811 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b2c2-e2f7-48d7-9c22-08d66e86b2a8 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.382080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b2c2-e2f7-48d7-9c22-08d66e86b2a8 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.382387 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b2c2-e2f7-48d7-9c22-08d66e86b2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.401429 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:47.416704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-bc41b2c2-e2f7-48d7-9c22-08d66e86b2a8 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:47.418602 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bc41b2c2-e2f7-48d7-9c22-08d66e86b2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:47.432492 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1348/2701] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:47.433714 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea5e67-0394-4481-af1c-d89a4614b1a1 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:47.445791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea5e67-0394-4481-af1c-d89a4614b1a1 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:47.453635 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3efc7-2e73-4a7a-a2f0-471cd4b26c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:47.454704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3efc7-2e73-4a7a-a2f0-471cd4b26c40 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.455194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3efc7-2e73-4a7a-a2f0-471cd4b26c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.455643 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3efc7-2e73-4a7a-a2f0-471cd4b26c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.456924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3efc7-2e73-4a7a-a2f0-471cd4b26c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:47.457881 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3efc7-2e73-4a7a-a2f0-471cd4b26c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:47.460347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3efc7-2e73-4a7a-a2f0-471cd4b26c40 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:47.476984 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1354/2702] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:47.481320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b2c2-e2f7-48d7-9c22-08d66e86b2a8 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:47.492538 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b2c2-e2f7-48d7-9c22-08d66e86b2a8 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:47.500428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11371b84-3b32-4689-82ce-85ac895f3386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:47.501954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11371b84-3b32-4689-82ce-85ac895f3386 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.502495 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11371b84-3b32-4689-82ce-85ac895f3386 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.503069 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11371b84-3b32-4689-82ce-85ac895f3386 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.503948 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11371b84-3b32-4689-82ce-85ac895f3386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:47.507720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11371b84-3b32-4689-82ce-85ac895f3386 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:47.702463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1349/2703] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:47 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:02:47.705870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3efc7-2e73-4a7a-a2f0-471cd4b26c40 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:47.717398 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3efc7-2e73-4a7a-a2f0-471cd4b26c40 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:47.796780 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a268b1-0d3a-410e-9f51-4762466a77f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:47.797537 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a268b1-0d3a-410e-9f51-4762466a77f9 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.797830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a268b1-0d3a-410e-9f51-4762466a77f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.798201 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a268b1-0d3a-410e-9f51-4762466a77f9 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.798983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a268b1-0d3a-410e-9f51-4762466a77f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:47.801507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a268b1-0d3a-410e-9f51-4762466a77f9 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:47.933195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:47.942444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1355/2704] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:47 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:47.943780 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11371b84-3b32-4689-82ce-85ac895f3386 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:47.965424 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11371b84-3b32-4689-82ce-85ac895f3386 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:47.980584 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6893d7-6244-4b37-8d16-35b5cdba8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:47.981229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6893d7-6244-4b37-8d16-35b5cdba8f3b admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.981517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6893d7-6244-4b37-8d16-35b5cdba8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.981794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6893d7-6244-4b37-8d16-35b5cdba8f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.982505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6893d7-6244-4b37-8d16-35b5cdba8f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:47.984689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6893d7-6244-4b37-8d16-35b5cdba8f3b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:48.006196 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1350/2705] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:48.011772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a268b1-0d3a-410e-9f51-4762466a77f9 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:48.028776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a268b1-0d3a-410e-9f51-4762466a77f9 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:48.036601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a419c9a-8392-4437-b899-abc451c47129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:48.037355 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419c9a-8392-4437-b899-abc451c47129 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:48.037876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419c9a-8392-4437-b899-abc451c47129 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:48.038012 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419c9a-8392-4437-b899-abc451c47129 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:48.038808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a419c9a-8392-4437-b899-abc451c47129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:48.040732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a419c9a-8392-4437-b899-abc451c47129 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:48.056308 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1356/2706] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:48.060110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6893d7-6244-4b37-8d16-35b5cdba8f3b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:48.071115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6893d7-6244-4b37-8d16-35b5cdba8f3b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:48.076064 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4f68c-0df2-409c-8c91-103e0b0ceb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:48.076947 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4f68c-0df2-409c-8c91-103e0b0ceb39 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:48.078354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4f68c-0df2-409c-8c91-103e0b0ceb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:48.078662 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4f68c-0df2-409c-8c91-103e0b0ceb39 admin admin] PATH_INFO: `/v3/projects/cb1169ec8dd047a9ad3d47b658c76336/users/cc620e5da6504627b8033a31687697de/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:48.094724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4f68c-0df2-409c-8c91-103e0b0ceb39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1169ec8dd047a9ad3d47b658c76336, user_id=cc620e5da6504627b8033a31687697de, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:48.097418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4f68c-0df2-409c-8c91-103e0b0ceb39 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:48.210380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1351/2707] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:48 2022] PUT /identity/v3/projects/cb1169ec8dd047a9ad3d47b658c76336/users/cc620e5da6504627b8033a31687697de/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:48.215504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d73341-c91f-42c0-85d1-f73663097c4b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:48.215788 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d73341-c91f-42c0-85d1-f73663097c4b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:48.216060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d73341-c91f-42c0-85d1-f73663097c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:48.236782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-b6d73341-c91f-42c0-85d1-f73663097c4b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:48.238004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b6d73341-c91f-42c0-85d1-f73663097c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:48.317301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1357/2708] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:48.327670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4f68c-0df2-409c-8c91-103e0b0ceb39 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:48.330533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8cf4f68c-0df2-409c-8c91-103e0b0ceb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:48.393092 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4f68c-0df2-409c-8c91-103e0b0ceb39 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:48.397359 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474eddd-83ee-49e5-9605-7a46ac760210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:48.397956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474eddd-83ee-49e5-9605-7a46ac760210 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:48.398308 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474eddd-83ee-49e5-9605-7a46ac760210 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:48.398652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474eddd-83ee-49e5-9605-7a46ac760210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:48.408999 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474eddd-83ee-49e5-9605-7a46ac760210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:48.410581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474eddd-83ee-49e5-9605-7a46ac760210 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:48.422956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1352/2709] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:02:53.427246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241773a-609e-4c94-a033-99702bd78978 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:53.427878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241773a-609e-4c94-a033-99702bd78978 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:53.427878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241773a-609e-4c94-a033-99702bd78978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:53.462840 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-5241773a-609e-4c94-a033-99702bd78978 None None] MFA Rules not processed for user `649e5e6756094875999fabb2399001f4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:53.469679 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-5241773a-609e-4c94-a033-99702bd78978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:53.579660 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1358/2710] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:53.592557 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474eddd-83ee-49e5-9605-7a46ac760210 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:53.594326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-8474eddd-83ee-49e5-9605-7a46ac760210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:53.667652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474eddd-83ee-49e5-9605-7a46ac760210 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:53.672059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a9f8e-a47d-4a77-ae03-f82038761235 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a10328a436c4159b6519e5493ba57f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:53.673128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a9f8e-a47d-4a77-ae03-f82038761235 service glance] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:53.673640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a9f8e-a47d-4a77-ae03-f82038761235 service glance] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:53.674140 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a9f8e-a47d-4a77-ae03-f82038761235 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:53.676253 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-797a9f8e-a47d-4a77-ae03-f82038761235 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:53.815019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:53.818366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a9f8e-a47d-4a77-ae03-f82038761235 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:53.820991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a9f8e-a47d-4a77-ae03-f82038761235 service glance] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:53.843753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1353/2711] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:54.230617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74abf-1f9c-4835-9733-7911df0cf2d0 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.231288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74abf-1f9c-4835-9733-7911df0cf2d0 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.231838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74abf-1f9c-4835-9733-7911df0cf2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.277664 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-efc74abf-1f9c-4835-9733-7911df0cf2d0 None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:54.279484 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-efc74abf-1f9c-4835-9733-7911df0cf2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:54.358432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1359/2712] 10.222.0.73 () {58 vars in 1009 bytes} [Tue Aug 30 00:02:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:54.384453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a9f8e-a47d-4a77-ae03-f82038761235 service glance] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:54.390397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-797a9f8e-a47d-4a77-ae03-f82038761235 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:54.505159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a9f8e-a47d-4a77-ae03-f82038761235 service glance] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:54.519430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370cc93-6ad5-4fdc-8760-23a07b7bd998 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:54.520046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370cc93-6ad5-4fdc-8760-23a07b7bd998 service swift] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.520335 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370cc93-6ad5-4fdc-8760-23a07b7bd998 service swift] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.520609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370cc93-6ad5-4fdc-8760-23a07b7bd998 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.538527 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370cc93-6ad5-4fdc-8760-23a07b7bd998 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:54.540258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370cc93-6ad5-4fdc-8760-23a07b7bd998 service swift] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:54.560581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1354/2713] 10.222.0.73 () {60 vars in 1384 bytes} [Tue Aug 30 00:02:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 00:02:54.861827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74abf-1f9c-4835-9733-7911df0cf2d0 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:54.863820 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-efc74abf-1f9c-4835-9733-7911df0cf2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:54.893022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74abf-1f9c-4835-9733-7911df0cf2d0 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:54.913795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:54.913795 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.923860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.924178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] PATH_INFO: `/v3/users/65964f5632a143cdb122a1fa4c6db28a` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.932212 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=65964f5632a143cdb122a1fa4c6db28a)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:54.939205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:55.000502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:55.275802 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65964f5632a143cdb122a1fa4c6db28a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:55.376917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65964f5632a143cdb122a1fa4c6db28a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:55.385469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65964f5632a143cdb122a1fa4c6db28a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:55.391098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65964f5632a143cdb122a1fa4c6db28a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:55.421801 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65964f5632a143cdb122a1fa4c6db28a'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:55.431544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1360/2714] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:02:54 2022] DELETE /identity/v3/users/65964f5632a143cdb122a1fa4c6db28a => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:55.436100 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c1ee7-77bd-47c3-8c31-60609174da34 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:55.436647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c1ee7-77bd-47c3-8c31-60609174da34 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:55.436647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c1ee7-77bd-47c3-8c31-60609174da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:55.487974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-927c1ee7-77bd-47c3-8c31-60609174da34 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:55.489243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-927c1ee7-77bd-47c3-8c31-60609174da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:55.610507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1355/2715] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:55.612818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:55.614591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:55.781387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ffe02-d07d-4c3b-9658-90d17ecf27ef admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:55.791855 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03afeb-d9b0-4bae-a6cd-9a3fdef38449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:55.792498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03afeb-d9b0-4bae-a6cd-9a3fdef38449 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:55.792781 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03afeb-d9b0-4bae-a6cd-9a3fdef38449 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:55.793055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03afeb-d9b0-4bae-a6cd-9a3fdef38449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:55.813751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03afeb-d9b0-4bae-a6cd-9a3fdef38449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:55.817403 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03afeb-d9b0-4bae-a6cd-9a3fdef38449 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:55.855408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1361/2716] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:56.080112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777a0cd-32fc-4890-8510-34acedd665bc None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.080431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777a0cd-32fc-4890-8510-34acedd665bc None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.080659 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777a0cd-32fc-4890-8510-34acedd665bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.122137 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d777a0cd-32fc-4890-8510-34acedd665bc None None] MFA Rules not processed for user `cc620e5da6504627b8033a31687697de`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:56.123694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d777a0cd-32fc-4890-8510-34acedd665bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:56.288511 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1356/2717] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:56.299310 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03afeb-d9b0-4bae-a6cd-9a3fdef38449 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:56.302503 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1e03afeb-d9b0-4bae-a6cd-9a3fdef38449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:56.419853 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03afeb-d9b0-4bae-a6cd-9a3fdef38449 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:56.428745 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04e46f-be48-40c9-b1f0-6dfee8d00072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:56.429377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04e46f-be48-40c9-b1f0-6dfee8d00072 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.429652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04e46f-be48-40c9-b1f0-6dfee8d00072 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.429921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04e46f-be48-40c9-b1f0-6dfee8d00072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.440391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04e46f-be48-40c9-b1f0-6dfee8d00072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:56.443610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04e46f-be48-40c9-b1f0-6dfee8d00072 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:56.456290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1362/2718] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:02:56.481302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777a0cd-32fc-4890-8510-34acedd665bc None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:56.482810 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d777a0cd-32fc-4890-8510-34acedd665bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:56.499283 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777a0cd-32fc-4890-8510-34acedd665bc None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:56.509767 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d2be2-fb7e-452d-b47a-64bd0d2fa899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:56.510655 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d2be2-fb7e-452d-b47a-64bd0d2fa899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.511642 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d2be2-fb7e-452d-b47a-64bd0d2fa899 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.512097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d2be2-fb7e-452d-b47a-64bd0d2fa899 admin admin] PATH_INFO: `/v3/projects/3983cae47d404713a4c2ab67fdf782ee` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.514417 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d2be2-fb7e-452d-b47a-64bd0d2fa899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3983cae47d404713a4c2ab67fdf782ee)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:56.517678 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d2be2-fb7e-452d-b47a-64bd0d2fa899 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:56.530660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=100 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:56.664643 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-404d2be2-fb7e-452d-b47a-64bd0d2fa899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3983cae47d404713a4c2ab67fdf782ee', 'request_id': 'req-404d2be2-fb7e-452d-b47a-64bd0d2fa899'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:56.670786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-404d2be2-fb7e-452d-b47a-64bd0d2fa899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3983cae47d404713a4c2ab67fdf782ee', 'request_id': 'req-404d2be2-fb7e-452d-b47a-64bd0d2fa899'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:56.760828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-404d2be2-fb7e-452d-b47a-64bd0d2fa899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3983cae47d404713a4c2ab67fdf782ee', 'request_id': 'req-404d2be2-fb7e-452d-b47a-64bd0d2fa899'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:56.776974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-404d2be2-fb7e-452d-b47a-64bd0d2fa899 admin admin] The token cache is being invalidate because project 3983cae47d404713a4c2ab67fdf782ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:02:56.777677 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-404d2be2-fb7e-452d-b47a-64bd0d2fa899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:56.778679 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-404d2be2-fb7e-452d-b47a-64bd0d2fa899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:02:56.780808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1357/2719] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:02:56 2022] DELETE /identity/v3/projects/3983cae47d404713a4c2ab67fdf782ee => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:56.785491 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41f404-0da3-4f64-9f6d-4d3c2be9d23f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.785776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41f404-0da3-4f64-9f6d-4d3c2be9d23f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.786053 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41f404-0da3-4f64-9f6d-4d3c2be9d23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.809092 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-4a41f404-0da3-4f64-9f6d-4d3c2be9d23f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:56.810300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4a41f404-0da3-4f64-9f6d-4d3c2be9d23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:56.825001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:56.892628 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1363/2720] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:56.897701 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b1af9-a4b4-467f-8a49-58edac63d39b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.897972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b1af9-a4b4-467f-8a49-58edac63d39b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.898214 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b1af9-a4b4-467f-8a49-58edac63d39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.932120 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-e19b1af9-a4b4-467f-8a49-58edac63d39b None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:56.933365 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e19b1af9-a4b4-467f-8a49-58edac63d39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:56.956872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1358/2721] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:56.961887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41f404-0da3-4f64-9f6d-4d3c2be9d23f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:56.974117 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41f404-0da3-4f64-9f6d-4d3c2be9d23f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:56.980922 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c231acd-c080-4d58-82c0-0f48e9b20deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:56.981359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231acd-c080-4d58-82c0-0f48e9b20deb admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.981644 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231acd-c080-4d58-82c0-0f48e9b20deb admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.981912 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231acd-c080-4d58-82c0-0f48e9b20deb admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.983131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c231acd-c080-4d58-82c0-0f48e9b20deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:56.983131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c231acd-c080-4d58-82c0-0f48e9b20deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:56.984701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c231acd-c080-4d58-82c0-0f48e9b20deb admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:57.006021 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1364/2722] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:57.007431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b1af9-a4b4-467f-8a49-58edac63d39b None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.022929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b1af9-a4b4-467f-8a49-58edac63d39b None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.027720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d7cd3-f64d-4ea3-871b-b16316eb4ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:57.028471 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d7cd3-f64d-4ea3-871b-b16316eb4ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.028757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d7cd3-f64d-4ea3-871b-b16316eb4ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.029030 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d7cd3-f64d-4ea3-871b-b16316eb4ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.029670 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d7cd3-f64d-4ea3-871b-b16316eb4ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:57.031998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d7cd3-f64d-4ea3-871b-b16316eb4ab8 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:57.151159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1359/2723] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:57 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:02:57.152669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c231acd-c080-4d58-82c0-0f48e9b20deb admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.168005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c231acd-c080-4d58-82c0-0f48e9b20deb admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.259879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648a179-32ce-41ee-b5a0-d80b7cb27ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:57.260578 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648a179-32ce-41ee-b5a0-d80b7cb27ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.260979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648a179-32ce-41ee-b5a0-d80b7cb27ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.261247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648a179-32ce-41ee-b5a0-d80b7cb27ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.261893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648a179-32ce-41ee-b5a0-d80b7cb27ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:57.263926 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648a179-32ce-41ee-b5a0-d80b7cb27ef8 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:57.367570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1365/2724] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:57 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:57.369493 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d7cd3-f64d-4ea3-871b-b16316eb4ab8 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.379431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d7cd3-f64d-4ea3-871b-b16316eb4ab8 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.385162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50964543-7a0c-4e36-82c0-bd85f4f5e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:57.385883 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50964543-7a0c-4e36-82c0-bd85f4f5e5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.386059 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50964543-7a0c-4e36-82c0-bd85f4f5e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.386307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50964543-7a0c-4e36-82c0-bd85f4f5e5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.387058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50964543-7a0c-4e36-82c0-bd85f4f5e5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:57.388726 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50964543-7a0c-4e36-82c0-bd85f4f5e5e8 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:57.408341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1360/2725] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:57.411394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648a179-32ce-41ee-b5a0-d80b7cb27ef8 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.426903 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648a179-32ce-41ee-b5a0-d80b7cb27ef8 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.432964 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e7782-3c21-4fc5-896b-1c2dbdd44bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:57.434475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e7782-3c21-4fc5-896b-1c2dbdd44bcb admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.434475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e7782-3c21-4fc5-896b-1c2dbdd44bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.434475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e7782-3c21-4fc5-896b-1c2dbdd44bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.442967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e7782-3c21-4fc5-896b-1c2dbdd44bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:57.444651 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e7782-3c21-4fc5-896b-1c2dbdd44bcb admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:57.466713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1366/2726] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:57.470574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50964543-7a0c-4e36-82c0-bd85f4f5e5e8 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.485973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50964543-7a0c-4e36-82c0-bd85f4f5e5e8 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.493959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf107c-a711-4e20-9f35-dc8befc5e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:57.494785 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf107c-a711-4e20-9f35-dc8befc5e9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.495159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf107c-a711-4e20-9f35-dc8befc5e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.495530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf107c-a711-4e20-9f35-dc8befc5e9d6 admin admin] PATH_INFO: `/v3/projects/adae4741e59644ac840787a10c30f10f/users/f2cb3f5755b94a8da7e5e53911e65ec2/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.512822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf107c-a711-4e20-9f35-dc8befc5e9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adae4741e59644ac840787a10c30f10f, user_id=f2cb3f5755b94a8da7e5e53911e65ec2, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:57.515959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf107c-a711-4e20-9f35-dc8befc5e9d6 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:57.619096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1361/2727] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:57 2022] PUT /identity/v3/projects/adae4741e59644ac840787a10c30f10f/users/f2cb3f5755b94a8da7e5e53911e65ec2/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:57.630394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754b134-2a07-42d6-81ef-6d8983178c5d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.631481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754b134-2a07-42d6-81ef-6d8983178c5d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.631944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754b134-2a07-42d6-81ef-6d8983178c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.681573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-6754b134-2a07-42d6-81ef-6d8983178c5d None None] MFA Rules not processed for user `f2cb3f5755b94a8da7e5e53911e65ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:57.681573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6754b134-2a07-42d6-81ef-6d8983178c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:57.772481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1367/2728] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:57.776823 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf107c-a711-4e20-9f35-dc8befc5e9d6 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.851830 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf107c-a711-4e20-9f35-dc8befc5e9d6 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.856932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9a6fd-5099-44b8-9162-d7e82b6ee067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:57.857758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a6fd-5099-44b8-9162-d7e82b6ee067 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.858225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a6fd-5099-44b8-9162-d7e82b6ee067 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.858611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a6fd-5099-44b8-9162-d7e82b6ee067 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.859314 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9a6fd-5099-44b8-9162-d7e82b6ee067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:57.861388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9a6fd-5099-44b8-9162-d7e82b6ee067 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:57.960023 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1362/2729] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:57 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:57.960259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754b134-2a07-42d6-81ef-6d8983178c5d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.975312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754b134-2a07-42d6-81ef-6d8983178c5d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.988866 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:58.055360 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9077f-dbb4-4b24-a6c1-9331fd85142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.065064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9077f-dbb4-4b24-a6c1-9331fd85142d admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.065064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9077f-dbb4-4b24-a6c1-9331fd85142d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.065064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9077f-dbb4-4b24-a6c1-9331fd85142d admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.065064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9077f-dbb4-4b24-a6c1-9331fd85142d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:58.065064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9077f-dbb4-4b24-a6c1-9331fd85142d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:58.151589 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1368/2730] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:57 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:58.155377 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9a6fd-5099-44b8-9162-d7e82b6ee067 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:58.169915 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9a6fd-5099-44b8-9162-d7e82b6ee067 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:58.189830 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363015ba-2cce-4083-a98d-fcbb4e61eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.194086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363015ba-2cce-4083-a98d-fcbb4e61eb1c admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.194086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363015ba-2cce-4083-a98d-fcbb4e61eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.194086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363015ba-2cce-4083-a98d-fcbb4e61eb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.194086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363015ba-2cce-4083-a98d-fcbb4e61eb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:58.194457 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363015ba-2cce-4083-a98d-fcbb4e61eb1c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:58.218579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1363/2731] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:58.223278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9077f-dbb4-4b24-a6c1-9331fd85142d admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:58.237362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9077f-dbb4-4b24-a6c1-9331fd85142d admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:58.244097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e9c04-2511-4b1c-8030-c01d75c656e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.244804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e9c04-2511-4b1c-8030-c01d75c656e1 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.245159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e9c04-2511-4b1c-8030-c01d75c656e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.245503 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e9c04-2511-4b1c-8030-c01d75c656e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.246353 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e9c04-2511-4b1c-8030-c01d75c656e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:58.248070 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e9c04-2511-4b1c-8030-c01d75c656e1 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:58.266006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1369/2732] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:58.267239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363015ba-2cce-4083-a98d-fcbb4e61eb1c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:58.279547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363015ba-2cce-4083-a98d-fcbb4e61eb1c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:58.285822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a84d31-b996-46d2-a3b3-01ab540fa621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.286755 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a84d31-b996-46d2-a3b3-01ab540fa621 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.287172 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a84d31-b996-46d2-a3b3-01ab540fa621 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.287509 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a84d31-b996-46d2-a3b3-01ab540fa621 admin admin] PATH_INFO: `/v3/projects/74967f34514247ff952f39a387c8f26a/users/1373faf88a5c48b1b82ade8694f938bb/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.292225 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:58.307100 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a84d31-b996-46d2-a3b3-01ab540fa621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74967f34514247ff952f39a387c8f26a, user_id=1373faf88a5c48b1b82ade8694f938bb, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:58.309886 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a84d31-b996-46d2-a3b3-01ab540fa621 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:58.378393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1364/2733] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:58 2022] PUT /identity/v3/projects/74967f34514247ff952f39a387c8f26a/users/1373faf88a5c48b1b82ade8694f938bb/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:58.389514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd9dce-8fb4-4a25-b30a-bfdf092a2bb5 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.389514 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd9dce-8fb4-4a25-b30a-bfdf092a2bb5 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.390197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd9dce-8fb4-4a25-b30a-bfdf092a2bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.440443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-50bd9dce-8fb4-4a25-b30a-bfdf092a2bb5 None None] MFA Rules not processed for user `1373faf88a5c48b1b82ade8694f938bb`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:58.441670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-50bd9dce-8fb4-4a25-b30a-bfdf092a2bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:58.532366 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1370/2734] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:58.533780 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a84d31-b996-46d2-a3b3-01ab540fa621 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:58.857856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a84d31-b996-46d2-a3b3-01ab540fa621 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:58.857856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c0312-7814-4a46-b260-f0648307c45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.857856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c0312-7814-4a46-b260-f0648307c45b admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.857856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c0312-7814-4a46-b260-f0648307c45b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.861995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c0312-7814-4a46-b260-f0648307c45b admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.861995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c0312-7814-4a46-b260-f0648307c45b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:58.861995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c0312-7814-4a46-b260-f0648307c45b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:59.091067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1365/2735] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:02:58 2022] POST /identity/v3/projects => generated 383 bytes in 557 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:59.093897 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd9dce-8fb4-4a25-b30a-bfdf092a2bb5 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.109180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd9dce-8fb4-4a25-b30a-bfdf092a2bb5 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:59.223693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480c9da-d920-4c69-9f92-f97c8abc24d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:59.224176 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480c9da-d920-4c69-9f92-f97c8abc24d5 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.224461 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480c9da-d920-4c69-9f92-f97c8abc24d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.224772 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480c9da-d920-4c69-9f92-f97c8abc24d5 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.225908 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480c9da-d920-4c69-9f92-f97c8abc24d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:59.229336 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480c9da-d920-4c69-9f92-f97c8abc24d5 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:59.333197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1371/2736] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:02:59 2022] POST /identity/v3/users => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:02:59.337388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c0312-7814-4a46-b260-f0648307c45b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.351083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c0312-7814-4a46-b260-f0648307c45b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:59.357441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d079f-01d5-4a74-b2d1-d9dc2c44ea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:59.359983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d079f-01d5-4a74-b2d1-d9dc2c44ea9d admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.360523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d079f-01d5-4a74-b2d1-d9dc2c44ea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.361096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d079f-01d5-4a74-b2d1-d9dc2c44ea9d admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.361972 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d079f-01d5-4a74-b2d1-d9dc2c44ea9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:59.366004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d079f-01d5-4a74-b2d1-d9dc2c44ea9d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:59.387622 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1366/2737] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:59.388653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480c9da-d920-4c69-9f92-f97c8abc24d5 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.425313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480c9da-d920-4c69-9f92-f97c8abc24d5 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:59.437945 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1932b84-2d29-4b3f-993c-07131742b328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:59.439180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932b84-2d29-4b3f-993c-07131742b328 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.445470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932b84-2d29-4b3f-993c-07131742b328 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.445470 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932b84-2d29-4b3f-993c-07131742b328 admin admin] PATH_INFO: `/v3/projects/bacffad0131843949a45fd4da1b59249/users/16ab782fc58c499ebae38832af69fe5b/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.466585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:59.476197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1932b84-2d29-4b3f-993c-07131742b328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacffad0131843949a45fd4da1b59249, user_id=16ab782fc58c499ebae38832af69fe5b, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:59.479694 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1932b84-2d29-4b3f-993c-07131742b328 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:59.558142 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1372/2738] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:59 2022] PUT /identity/v3/projects/bacffad0131843949a45fd4da1b59249/users/16ab782fc58c499ebae38832af69fe5b/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:02:59.562320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d079f-01d5-4a74-b2d1-d9dc2c44ea9d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.576865 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d079f-01d5-4a74-b2d1-d9dc2c44ea9d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:59.642463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c56a6-f6b7-4b58-99c1-c3c8c308bbdc None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.643832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c56a6-f6b7-4b58-99c1-c3c8c308bbdc None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.643832 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c56a6-f6b7-4b58-99c1-c3c8c308bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.671192 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcd384-ca8a-44ea-92b9-fb54251fb494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:59.678395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcd384-ca8a-44ea-92b9-fb54251fb494 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.678395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcd384-ca8a-44ea-92b9-fb54251fb494 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.678395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcd384-ca8a-44ea-92b9-fb54251fb494 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.678395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efcd384-ca8a-44ea-92b9-fb54251fb494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:59.678395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efcd384-ca8a-44ea-92b9-fb54251fb494 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:59.678942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-948c56a6-f6b7-4b58-99c1-c3c8c308bbdc None None] MFA Rules not processed for user `cc620e5da6504627b8033a31687697de`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:59.678942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-948c56a6-f6b7-4b58-99c1-c3c8c308bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:59.692480 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1367/2739] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:02:59.694350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcd384-ca8a-44ea-92b9-fb54251fb494 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.707067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcd384-ca8a-44ea-92b9-fb54251fb494 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:59.713395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9f7ff-a354-4675-9dff-552a1ae2715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:59.714432 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9f7ff-a354-4675-9dff-552a1ae2715c admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.714926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9f7ff-a354-4675-9dff-552a1ae2715c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.715392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9f7ff-a354-4675-9dff-552a1ae2715c admin admin] PATH_INFO: `/v3/projects/bacffad0131843949a45fd4da1b59249/users/16ab782fc58c499ebae38832af69fe5b/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.717633 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9f7ff-a354-4675-9dff-552a1ae2715c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacffad0131843949a45fd4da1b59249, user_id=16ab782fc58c499ebae38832af69fe5b, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:59.720691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9f7ff-a354-4675-9dff-552a1ae2715c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:59.733700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1368/2740] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:02:59 2022] PUT /identity/v3/projects/bacffad0131843949a45fd4da1b59249/users/16ab782fc58c499ebae38832af69fe5b/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:59.744946 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8610940-aa5c-4ce9-b64e-4fd90bd78348 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.745250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8610940-aa5c-4ce9-b64e-4fd90bd78348 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.745546 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8610940-aa5c-4ce9-b64e-4fd90bd78348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.774124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1373/2741] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:02:59.807749 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d8610940-aa5c-4ce9-b64e-4fd90bd78348 None None] MFA Rules not processed for user `16ab782fc58c499ebae38832af69fe5b`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:59.809018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d8610940-aa5c-4ce9-b64e-4fd90bd78348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:59.876748 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:59.985211 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1369/2742] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:02:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:02:59.998411 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c56a6-f6b7-4b58-99c1-c3c8c308bbdc None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:00.000087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-948c56a6-f6b7-4b58-99c1-c3c8c308bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:00.082568 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c56a6-f6b7-4b58-99c1-c3c8c308bbdc None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:00.204644 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3e8e-a988-47be-b597-addd2506f0d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:00.205603 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3e8e-a988-47be-b597-addd2506f0d0 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:00.206144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3e8e-a988-47be-b597-addd2506f0d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:00.206632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3e8e-a988-47be-b597-addd2506f0d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:00.268468 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8610940-aa5c-4ce9-b64e-4fd90bd78348 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:00.269933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d8610940-aa5c-4ce9-b64e-4fd90bd78348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:00.383437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e3e8e-a988-47be-b597-addd2506f0d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:00.391729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e3e8e-a988-47be-b597-addd2506f0d0 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:00.417987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8610940-aa5c-4ce9-b64e-4fd90bd78348 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:00.432181 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931d8c5-c7c6-466f-a62c-18e5e4948403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:00.433658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931d8c5-c7c6-466f-a62c-18e5e4948403 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:00.433658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931d8c5-c7c6-466f-a62c-18e5e4948403 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:00.434267 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931d8c5-c7c6-466f-a62c-18e5e4948403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:00.438851 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f931d8c5-c7c6-466f-a62c-18e5e4948403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:00.439839 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1374/2743] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:02:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:03:00.455208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931d8c5-c7c6-466f-a62c-18e5e4948403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:00.456930 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931d8c5-c7c6-466f-a62c-18e5e4948403 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:00.469723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1370/2744] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:03:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:03:03.038836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3e8e-a988-47be-b597-addd2506f0d0 service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:03.040562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-cb7e3e8e-a988-47be-b597-addd2506f0d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:03.049501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:03.056830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3e8e-a988-47be-b597-addd2506f0d0 service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:03.060779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4038fe3-06d7-411d-ade2-0ca63c7934b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:03.061624 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038fe3-06d7-411d-ade2-0ca63c7934b4 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:03.062143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038fe3-06d7-411d-ade2-0ca63c7934b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:03.062590 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038fe3-06d7-411d-ade2-0ca63c7934b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:03.147322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4038fe3-06d7-411d-ade2-0ca63c7934b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:03.148901 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4038fe3-06d7-411d-ade2-0ca63c7934b4 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:03.159810 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1375/2745] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:03:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:03:05.422413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931d8c5-c7c6-466f-a62c-18e5e4948403 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:05.432531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931d8c5-c7c6-466f-a62c-18e5e4948403 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:05.436166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484275f-502a-4e62-82dc-1e67335c1c91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:05.436769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484275f-502a-4e62-82dc-1e67335c1c91 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:05.437042 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484275f-502a-4e62-82dc-1e67335c1c91 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:05.437309 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484275f-502a-4e62-82dc-1e67335c1c91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:05.448132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484275f-502a-4e62-82dc-1e67335c1c91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:05.449570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484275f-502a-4e62-82dc-1e67335c1c91 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:05.463068 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1371/2746] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:03:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:03:08.409387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bb3c6-96a5-48e9-8b43-80b98e54a52f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.409878 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bb3c6-96a5-48e9-8b43-80b98e54a52f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.409987 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bb3c6-96a5-48e9-8b43-80b98e54a52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.430178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-524bb3c6-96a5-48e9-8b43-80b98e54a52f None None] MFA Rules not processed for user `79c324b271244bc588fbbf538f438038`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:08.431421 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-524bb3c6-96a5-48e9-8b43-80b98e54a52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:08.484659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1376/2747] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:03:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:03:10.439497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484275f-502a-4e62-82dc-1e67335c1c91 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:10.502971 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484275f-502a-4e62-82dc-1e67335c1c91 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:10.508169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:10.508693 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:10.508970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:10.509240 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] PATH_INFO: `/v3/users/f2cb3f5755b94a8da7e5e53911e65ec2` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:10.510342 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2cb3f5755b94a8da7e5e53911e65ec2)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:10.512404 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:10.668750 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2cb3f5755b94a8da7e5e53911e65ec2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:10.676848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:10.681453 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2cb3f5755b94a8da7e5e53911e65ec2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:10.688500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2cb3f5755b94a8da7e5e53911e65ec2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:10.689197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2cb3f5755b94a8da7e5e53911e65ec2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:10.689853 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2cb3f5755b94a8da7e5e53911e65ec2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:10.764416 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1372/2748] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:03:10 2022] DELETE /identity/v3/users/f2cb3f5755b94a8da7e5e53911e65ec2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:10.769669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6aaf0-c0fc-4341-97f9-d8a826eda287 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:10.770187 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6aaf0-c0fc-4341-97f9-d8a826eda287 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:10.770632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6aaf0-c0fc-4341-97f9-d8a826eda287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:10.790181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-2ad6aaf0-c0fc-4341-97f9-d8a826eda287 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:10.791527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2ad6aaf0-c0fc-4341-97f9-d8a826eda287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:10.851992 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1377/2749] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:03:10.861695 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:10.863129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:10.924813 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c03e7-e3a0-4d45-8c72-fc5d2f0be7d1 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:10.929077 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e56e-e6f5-4fe8-9ad1-6b018e103aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:10.929675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e56e-e6f5-4fe8-9ad1-6b018e103aca service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:10.929950 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e56e-e6f5-4fe8-9ad1-6b018e103aca service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:10.930220 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e56e-e6f5-4fe8-9ad1-6b018e103aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:10.938973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3e56e-e6f5-4fe8-9ad1-6b018e103aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:10.940381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3e56e-e6f5-4fe8-9ad1-6b018e103aca service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:10.950485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1373/2750] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:03:11.435052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6aaf0-c0fc-4341-97f9-d8a826eda287 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:11.440329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2ad6aaf0-c0fc-4341-97f9-d8a826eda287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:11.451597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6aaf0-c0fc-4341-97f9-d8a826eda287 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:11.471552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123290ab-49f8-4b99-ac42-a738b0de88b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:11.472453 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123290ab-49f8-4b99-ac42-a738b0de88b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.472765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123290ab-49f8-4b99-ac42-a738b0de88b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.473037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123290ab-49f8-4b99-ac42-a738b0de88b5 admin admin] PATH_INFO: `/v3/projects/adae4741e59644ac840787a10c30f10f` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.474776 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123290ab-49f8-4b99-ac42-a738b0de88b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adae4741e59644ac840787a10c30f10f)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:11.476797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123290ab-49f8-4b99-ac42-a738b0de88b5 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:11.651473 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:11.658001 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-123290ab-49f8-4b99-ac42-a738b0de88b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adae4741e59644ac840787a10c30f10f', 'request_id': 'req-123290ab-49f8-4b99-ac42-a738b0de88b5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:11.664683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-123290ab-49f8-4b99-ac42-a738b0de88b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adae4741e59644ac840787a10c30f10f', 'request_id': 'req-123290ab-49f8-4b99-ac42-a738b0de88b5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:11.671150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-123290ab-49f8-4b99-ac42-a738b0de88b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adae4741e59644ac840787a10c30f10f', 'request_id': 'req-123290ab-49f8-4b99-ac42-a738b0de88b5'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:11.750785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-123290ab-49f8-4b99-ac42-a738b0de88b5 admin admin] The token cache is being invalidate because project adae4741e59644ac840787a10c30f10f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:03:11.751191 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-123290ab-49f8-4b99-ac42-a738b0de88b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:11.751922 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-123290ab-49f8-4b99-ac42-a738b0de88b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:11.754156 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1378/2751] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:03:11 2022] DELETE /identity/v3/projects/adae4741e59644ac840787a10c30f10f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:11.758121 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e56e-e6f5-4fe8-9ad1-6b018e103aca service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:11.769301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e56e-e6f5-4fe8-9ad1-6b018e103aca service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:11.839457 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:11.840096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.840376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.840650 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] PATH_INFO: `/v3/users/1373faf88a5c48b1b82ade8694f938bb` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.842058 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1373faf88a5c48b1b82ade8694f938bb)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:11.843944 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:12.090811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2260-6f6b-4d2b-afa6-de2a4dcd3770 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.091391 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2260-6f6b-4d2b-afa6-de2a4dcd3770 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.091547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2260-6f6b-4d2b-afa6-de2a4dcd3770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.106906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1373faf88a5c48b1b82ade8694f938bb'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:12.113600 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-917a2260-6f6b-4d2b-afa6-de2a4dcd3770 None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:12.114838 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-917a2260-6f6b-4d2b-afa6-de2a4dcd3770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:12.121081 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1373faf88a5c48b1b82ade8694f938bb'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:12.128408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1373faf88a5c48b1b82ade8694f938bb'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:12.129124 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1373faf88a5c48b1b82ade8694f938bb'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:12.129733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1373faf88a5c48b1b82ade8694f938bb'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:12.174812 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1379/2752] 10.222.0.73 () {58 vars in 1009 bytes} [Tue Aug 30 00:03:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:03:12.187691 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a2260-6f6b-4d2b-afa6-de2a4dcd3770 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:12.189127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-917a2260-6f6b-4d2b-afa6-de2a4dcd3770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:12.264725 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a2260-6f6b-4d2b-afa6-de2a4dcd3770 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:12.270358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87049a6a-fecb-4380-a19c-2879df427f75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:12.270629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:12.271072 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87049a6a-fecb-4380-a19c-2879df427f75 service swift] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.271349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87049a6a-fecb-4380-a19c-2879df427f75 service swift] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.271652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87049a6a-fecb-4380-a19c-2879df427f75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.280469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87049a6a-fecb-4380-a19c-2879df427f75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:12.284856 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87049a6a-fecb-4380-a19c-2879df427f75 service swift] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:12.285883 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1374/2753] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:03:11 2022] DELETE /identity/v3/users/1373faf88a5c48b1b82ade8694f938bb => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:03:12.294259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1380/2754] 10.222.0.73 () {60 vars in 1384 bytes} [Tue Aug 30 00:03:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 00:03:13.208095 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:13.210760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:13.288720 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1a626-cf3d-4bec-a9c5-d351f0e0cf46 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:13.293828 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:13.294506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:13.294916 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:13.295206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] PATH_INFO: `/v3/projects/74967f34514247ff952f39a387c8f26a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:13.296393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=74967f34514247ff952f39a387c8f26a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:13.298263 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:13.460340 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74967f34514247ff952f39a387c8f26a', 'request_id': 'req-9aa6533c-648c-4005-8249-b9c29b2d67fb'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:13.469405 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74967f34514247ff952f39a387c8f26a', 'request_id': 'req-9aa6533c-648c-4005-8249-b9c29b2d67fb'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:13.543019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74967f34514247ff952f39a387c8f26a', 'request_id': 'req-9aa6533c-648c-4005-8249-b9c29b2d67fb'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:13.565107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] The token cache is being invalidate because project 74967f34514247ff952f39a387c8f26a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:03:13.565399 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:13.566068 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:13.567855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1375/2755] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:03:13 2022] DELETE /identity/v3/projects/74967f34514247ff952f39a387c8f26a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:13.571819 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87049a6a-fecb-4380-a19c-2879df427f75 service swift] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:13.584022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87049a6a-fecb-4380-a19c-2879df427f75 service swift] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:13.704302 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e8a11-b1a8-4dfc-a97f-b8e244ca8378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:13.705144 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e8a11-b1a8-4dfc-a97f-b8e244ca8378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:13.705409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e8a11-b1a8-4dfc-a97f-b8e244ca8378 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:13.705683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e8a11-b1a8-4dfc-a97f-b8e244ca8378 admin admin] PATH_INFO: `/v3/users/16ab782fc58c499ebae38832af69fe5b` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:13.706933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e8a11-b1a8-4dfc-a97f-b8e244ca8378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ab782fc58c499ebae38832af69fe5b)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:13.710548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e8a11-b1a8-4dfc-a97f-b8e244ca8378 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:13.715942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:13.895556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-641e8a11-b1a8-4dfc-a97f-b8e244ca8378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ab782fc58c499ebae38832af69fe5b'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:13.998831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-641e8a11-b1a8-4dfc-a97f-b8e244ca8378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ab782fc58c499ebae38832af69fe5b'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:14.012253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-641e8a11-b1a8-4dfc-a97f-b8e244ca8378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ab782fc58c499ebae38832af69fe5b'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:14.012976 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-641e8a11-b1a8-4dfc-a97f-b8e244ca8378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ab782fc58c499ebae38832af69fe5b'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:14.030100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-641e8a11-b1a8-4dfc-a97f-b8e244ca8378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ab782fc58c499ebae38832af69fe5b'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:14.040006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1381/2756] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:03:13 2022] DELETE /identity/v3/users/16ab782fc58c499ebae38832af69fe5b => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:14.532923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:14.535105 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:14.554680 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6533c-648c-4005-8249-b9c29b2d67fb admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:14.625869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261499f2-1390-46f4-bca7-b875d952571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:14.626987 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261499f2-1390-46f4-bca7-b875d952571c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.627473 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261499f2-1390-46f4-bca7-b875d952571c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.627926 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261499f2-1390-46f4-bca7-b875d952571c admin admin] PATH_INFO: `/v3/projects/bacffad0131843949a45fd4da1b59249` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.629323 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261499f2-1390-46f4-bca7-b875d952571c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bacffad0131843949a45fd4da1b59249)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:14.631640 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261499f2-1390-46f4-bca7-b875d952571c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:14.725993 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:14.741445 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-261499f2-1390-46f4-bca7-b875d952571c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bacffad0131843949a45fd4da1b59249', 'request_id': 'req-261499f2-1390-46f4-bca7-b875d952571c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:14.747757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-261499f2-1390-46f4-bca7-b875d952571c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bacffad0131843949a45fd4da1b59249', 'request_id': 'req-261499f2-1390-46f4-bca7-b875d952571c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:14.836884 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-261499f2-1390-46f4-bca7-b875d952571c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bacffad0131843949a45fd4da1b59249', 'request_id': 'req-261499f2-1390-46f4-bca7-b875d952571c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:14.851593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-261499f2-1390-46f4-bca7-b875d952571c admin admin] The token cache is being invalidate because project bacffad0131843949a45fd4da1b59249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:03:14.851935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-261499f2-1390-46f4-bca7-b875d952571c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:14.852608 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-261499f2-1390-46f4-bca7-b875d952571c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:14.855970 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1376/2757] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:03:14 2022] DELETE /identity/v3/projects/bacffad0131843949a45fd4da1b59249 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:14.860436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd83e8a-b94d-4ee2-ba6a-7f907629b37e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.865285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd83e8a-b94d-4ee2-ba6a-7f907629b37e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.865285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd83e8a-b94d-4ee2-ba6a-7f907629b37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.891597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-ddd83e8a-b94d-4ee2-ba6a-7f907629b37e None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:14.893118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ddd83e8a-b94d-4ee2-ba6a-7f907629b37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:14.969942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1382/2758] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:03:14.979760 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b987d-a17a-4581-9ea7-def2c8b14ad1 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.980039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b987d-a17a-4581-9ea7-def2c8b14ad1 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.980499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b987d-a17a-4581-9ea7-def2c8b14ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:15.002822 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-722b987d-a17a-4581-9ea7-def2c8b14ad1 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:15.004135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-722b987d-a17a-4581-9ea7-def2c8b14ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:15.013009 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1377/2759] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:03:15.017600 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd83e8a-b94d-4ee2-ba6a-7f907629b37e None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:15.028005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd83e8a-b94d-4ee2-ba6a-7f907629b37e None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:15.032779 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e43b26-55ff-4718-b398-9938e45d8216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:15.033379 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e43b26-55ff-4718-b398-9938e45d8216 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:15.033659 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e43b26-55ff-4718-b398-9938e45d8216 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:15.034005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e43b26-55ff-4718-b398-9938e45d8216 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:15.034655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e43b26-55ff-4718-b398-9938e45d8216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:15.034995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e43b26-55ff-4718-b398-9938e45d8216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:15.036574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e43b26-55ff-4718-b398-9938e45d8216 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:15.053383 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b987d-a17a-4581-9ea7-def2c8b14ad1 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:15.062131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1383/2760] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:15.066243 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b987d-a17a-4581-9ea7-def2c8b14ad1 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:15.072019 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b750b-88b8-47af-90a8-ccfc736aa064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:15.072852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b750b-88b8-47af-90a8-ccfc736aa064 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:15.073256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b750b-88b8-47af-90a8-ccfc736aa064 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:15.073548 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b750b-88b8-47af-90a8-ccfc736aa064 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:15.074273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b750b-88b8-47af-90a8-ccfc736aa064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:15.077064 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b750b-88b8-47af-90a8-ccfc736aa064 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:15.194912 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1378/2761] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:03:15 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:15.199443 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e43b26-55ff-4718-b398-9938e45d8216 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:15.218047 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e43b26-55ff-4718-b398-9938e45d8216 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:15.301782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa056ed-7be6-451f-a0b3-feb02ece9195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:15.302569 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa056ed-7be6-451f-a0b3-feb02ece9195 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:15.304121 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa056ed-7be6-451f-a0b3-feb02ece9195 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:15.307104 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa056ed-7be6-451f-a0b3-feb02ece9195 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:15.307877 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa056ed-7be6-451f-a0b3-feb02ece9195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:15.310229 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa056ed-7be6-451f-a0b3-feb02ece9195 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:15.399858 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:15.407970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1384/2762] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:03:15 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:15.416603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b750b-88b8-47af-90a8-ccfc736aa064 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:15.428130 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b750b-88b8-47af-90a8-ccfc736aa064 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:15.432924 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3955-afbe-4d05-bdd3-1466b45ace81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:15.433533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3955-afbe-4d05-bdd3-1466b45ace81 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:15.433816 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3955-afbe-4d05-bdd3-1466b45ace81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:15.434090 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3955-afbe-4d05-bdd3-1466b45ace81 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:15.434732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3955-afbe-4d05-bdd3-1466b45ace81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:15.436459 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3955-afbe-4d05-bdd3-1466b45ace81 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:15.449020 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1379/2763] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:03:15.453118 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa056ed-7be6-451f-a0b3-feb02ece9195 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:15.464719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa056ed-7be6-451f-a0b3-feb02ece9195 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:15.470383 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e31be-4524-4190-a891-221df63c3b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:15.471053 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e31be-4524-4190-a891-221df63c3b3d admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:15.471335 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e31be-4524-4190-a891-221df63c3b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:15.471613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e31be-4524-4190-a891-221df63c3b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:15.472313 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e31be-4524-4190-a891-221df63c3b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:15.473927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e31be-4524-4190-a891-221df63c3b3d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:15.489795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3955-afbe-4d05-bdd3-1466b45ace81 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:15.491254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1385/2764] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:03:15.500846 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3955-afbe-4d05-bdd3-1466b45ace81 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:15.505675 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b792882-0641-4922-b8a0-82c447420f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:15.507118 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b792882-0641-4922-b8a0-82c447420f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:15.507543 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b792882-0641-4922-b8a0-82c447420f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:15.507906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b792882-0641-4922-b8a0-82c447420f32 admin admin] PATH_INFO: `/v3/projects/44a6569c44f5440e90c6e4f82d2787f2/users/6febfda2867140c1bd5029b1558824c7/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:15.524788 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b792882-0641-4922-b8a0-82c447420f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a6569c44f5440e90c6e4f82d2787f2, user_id=6febfda2867140c1bd5029b1558824c7, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:15.527522 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b792882-0641-4922-b8a0-82c447420f32 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:15.604934 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1380/2765] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:03:15 2022] PUT /identity/v3/projects/44a6569c44f5440e90c6e4f82d2787f2/users/6febfda2867140c1bd5029b1558824c7/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:03:15.616080 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c17d7-addd-49e4-b431-da292c6b407e None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:15.616732 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c17d7-addd-49e4-b431-da292c6b407e None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:15.616946 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c17d7-addd-49e4-b431-da292c6b407e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:15.648770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-8d3c17d7-addd-49e4-b431-da292c6b407e None None] MFA Rules not processed for user `6febfda2867140c1bd5029b1558824c7`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:15.649956 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-8d3c17d7-addd-49e4-b431-da292c6b407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:15.735279 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1386/2766] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:03:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:03:15.747852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b792882-0641-4922-b8a0-82c447420f32 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:15.749739 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2b792882-0641-4922-b8a0-82c447420f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:15.812300 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b792882-0641-4922-b8a0-82c447420f32 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:15.816166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7022b63-67b7-4d2e-ac34-a838407c9760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:15.816902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022b63-67b7-4d2e-ac34-a838407c9760 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:15.817185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022b63-67b7-4d2e-ac34-a838407c9760 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:15.817620 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022b63-67b7-4d2e-ac34-a838407c9760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:15.827691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7022b63-67b7-4d2e-ac34-a838407c9760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:15.829396 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7022b63-67b7-4d2e-ac34-a838407c9760 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:15.850808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1381/2767] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:03:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:03:19.062269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c17d7-addd-49e4-b431-da292c6b407e None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:19.137474 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c17d7-addd-49e4-b431-da292c6b407e None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:19.142641 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:19.143396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:19.143752 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:19.144026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] PATH_INFO: `/v3/users/6febfda2867140c1bd5029b1558824c7` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:19.145327 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6febfda2867140c1bd5029b1558824c7)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:19.148458 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:19.376656 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6febfda2867140c1bd5029b1558824c7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:19.449152 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6febfda2867140c1bd5029b1558824c7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:19.459667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6febfda2867140c1bd5029b1558824c7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:19.460393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6febfda2867140c1bd5029b1558824c7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:19.474665 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6febfda2867140c1bd5029b1558824c7'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:19.477802 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:19.486082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1387/2768] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:03:19 2022] DELETE /identity/v3/users/6febfda2867140c1bd5029b1558824c7 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:19.487869 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff46fe-2563-4aa7-9d82-ba0dc74ee405 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:19.488452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff46fe-2563-4aa7-9d82-ba0dc74ee405 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:19.488452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff46fe-2563-4aa7-9d82-ba0dc74ee405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:19.508569 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-00ff46fe-2563-4aa7-9d82-ba0dc74ee405 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:19.511415 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-00ff46fe-2563-4aa7-9d82-ba0dc74ee405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:19.564044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:19.574356 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1382/2769] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:03:19.585060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:19.586481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:19.647387 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919f969-3671-41ff-b67e-2f75eb6fafe7 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:19.650993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274d4e4-7802-4bb0-8918-77771bbc81ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:19.651606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274d4e4-7802-4bb0-8918-77771bbc81ef service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:19.651879 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274d4e4-7802-4bb0-8918-77771bbc81ef service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:19.652147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274d4e4-7802-4bb0-8918-77771bbc81ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:19.663338 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274d4e4-7802-4bb0-8918-77771bbc81ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:19.664924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274d4e4-7802-4bb0-8918-77771bbc81ef service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:19.679287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1388/2770] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:03:21.058033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff46fe-2563-4aa7-9d82-ba0dc74ee405 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:21.059712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-00ff46fe-2563-4aa7-9d82-ba0dc74ee405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:21.072734 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff46fe-2563-4aa7-9d82-ba0dc74ee405 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:21.082247 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:21.082989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:21.083280 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:21.083567 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] PATH_INFO: `/v3/projects/44a6569c44f5440e90c6e4f82d2787f2` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:21.085394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a6569c44f5440e90c6e4f82d2787f2)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:21.087346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:21.196086 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a6569c44f5440e90c6e4f82d2787f2', 'request_id': 'req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:21.201568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a6569c44f5440e90c6e4f82d2787f2', 'request_id': 'req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:21.265768 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a6569c44f5440e90c6e4f82d2787f2', 'request_id': 'req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:21.278256 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] The token cache is being invalidate because project 44a6569c44f5440e90c6e4f82d2787f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:03:21.278460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:21.279157 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:03:21.280810 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1383/2771] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:03:21 2022] DELETE /identity/v3/projects/44a6569c44f5440e90c6e4f82d2787f2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:29.670791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=27 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:31.274990 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:34.079959 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274d4e4-7802-4bb0-8918-77771bbc81ef service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:34.081404 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e274d4e4-7802-4bb0-8918-77771bbc81ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:34.092898 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274d4e4-7802-4bb0-8918-77771bbc81ef service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:34.144075 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39dbd4f-a8aa-4d54-8651-558cb13c57ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:34.144686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dbd4f-a8aa-4d54-8651-558cb13c57ba service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:34.144983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dbd4f-a8aa-4d54-8651-558cb13c57ba service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:34.145244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dbd4f-a8aa-4d54-8651-558cb13c57ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:34.147045 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b39dbd4f-a8aa-4d54-8651-558cb13c57ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:34.209393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39dbd4f-a8aa-4d54-8651-558cb13c57ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:34.211393 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39dbd4f-a8aa-4d54-8651-558cb13c57ba service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:34.221038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1389/2772] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:03:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:03:39.110952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:39.112398 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:39.204410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6a49a-3de1-49a8-ad12-e21cf1111b7d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:39.213446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04035-8167-4666-b3b7-88f3203d4e95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:39.214201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04035-8167-4666-b3b7-88f3203d4e95 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:39.214485 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04035-8167-4666-b3b7-88f3203d4e95 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:39.214757 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04035-8167-4666-b3b7-88f3203d4e95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:39.217320 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-69a04035-8167-4666-b3b7-88f3203d4e95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:39.233916 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a04035-8167-4666-b3b7-88f3203d4e95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:39.235806 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a04035-8167-4666-b3b7-88f3203d4e95 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:39.250028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1384/2773] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:03:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:03:44.216710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=50 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:49.244149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=34 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:06.603174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2bb43-7079-41d9-8979-59a0f192eb75 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:06.604926 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2bb43-7079-41d9-8979-59a0f192eb75 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:06.604926 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2bb43-7079-41d9-8979-59a0f192eb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:06.625253 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-44c2bb43-7079-41d9-8979-59a0f192eb75 None None] MFA Rules not processed for user `cc620e5da6504627b8033a31687697de`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:06.626503 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-44c2bb43-7079-41d9-8979-59a0f192eb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:06.687111 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1390/2774] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:04:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:04:16.680077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=25 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:32.545455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04035-8167-4666-b3b7-88f3203d4e95 service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:32.546855 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-69a04035-8167-4666-b3b7-88f3203d4e95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:32.685535 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04035-8167-4666-b3b7-88f3203d4e95 service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:32.690976 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bb6c1-7cb5-42eb-9738-8f9226fc0b83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:32.693399 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bb6c1-7cb5-42eb-9738-8f9226fc0b83 service placement] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:32.693399 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bb6c1-7cb5-42eb-9738-8f9226fc0b83 service placement] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:32.693399 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bb6c1-7cb5-42eb-9738-8f9226fc0b83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:32.693771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e04bb6c1-7cb5-42eb-9738-8f9226fc0b83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:32.705323 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bb6c1-7cb5-42eb-9738-8f9226fc0b83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:32.706872 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bb6c1-7cb5-42eb-9738-8f9226fc0b83 service placement] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:32.716682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1385/2775] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:04:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:04:42.712536 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=63 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:59.714535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d01eeb-40a7-449d-8190-2d45a7a9cff9 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:59.715061 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d01eeb-40a7-449d-8190-2d45a7a9cff9 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:59.715203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d01eeb-40a7-449d-8190-2d45a7a9cff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:59.744967 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-22d01eeb-40a7-449d-8190-2d45a7a9cff9 None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:59.746165 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-22d01eeb-40a7-449d-8190-2d45a7a9cff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:59.806048 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1391/2776] 10.222.0.73 () {58 vars in 967 bytes} [Tue Aug 30 00:04:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:04:59.846753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bb6c1-7cb5-42eb-9738-8f9226fc0b83 service placement] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:59.848195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e04bb6c1-7cb5-42eb-9738-8f9226fc0b83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:59.917369 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bb6c1-7cb5-42eb-9738-8f9226fc0b83 service placement] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:59.922392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ffda8-02f6-4992-a492-859053b15028 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:59.923035 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ffda8-02f6-4992-a492-859053b15028 service swift] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:59.923338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ffda8-02f6-4992-a492-859053b15028 service swift] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:59.923607 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ffda8-02f6-4992-a492-859053b15028 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:59.931570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ffda8-02f6-4992-a492-859053b15028 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:59.933148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ffda8-02f6-4992-a492-859053b15028 service swift] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:59.943144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1386/2777] 10.222.0.73 () {60 vars in 1384 bytes} [Tue Aug 30 00:04:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:05:08.527644 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d01eeb-40a7-449d-8190-2d45a7a9cff9 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:08.529122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-22d01eeb-40a7-449d-8190-2d45a7a9cff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:05:08.635074 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d01eeb-40a7-449d-8190-2d45a7a9cff9 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:08.639872 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:08.640502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:08.640786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:08.641063 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] PATH_INFO: `/v3/users/79c324b271244bc588fbbf538f438038` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:08.642190 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c324b271244bc588fbbf538f438038)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:08.644153 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:08.839238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c324b271244bc588fbbf538f438038'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:08.923098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c324b271244bc588fbbf538f438038'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:08.930799 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c324b271244bc588fbbf538f438038'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:08.931487 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c324b271244bc588fbbf538f438038'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:08.932753 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:08.946649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c324b271244bc588fbbf538f438038'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:08.953743 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1392/2778] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:05:08 2022] DELETE /identity/v3/users/79c324b271244bc588fbbf538f438038 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:05:09.223032 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ffda8-02f6-4992-a492-859053b15028 service swift] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:09.236698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ffda8-02f6-4992-a492-859053b15028 service swift] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:09.318563 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:09.319238 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:09.319523 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:09.319799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] PATH_INFO: `/v3/projects/bdf7d023bf454edf9c31e50ee0c10bcd` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:09.321379 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf7d023bf454edf9c31e50ee0c10bcd)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:09.323338 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:09.443201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf7d023bf454edf9c31e50ee0c10bcd', 'request_id': 'req-cf41b2af-c278-40fd-90c8-9b9a62a3b767'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:09.448733 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf7d023bf454edf9c31e50ee0c10bcd', 'request_id': 'req-cf41b2af-c278-40fd-90c8-9b9a62a3b767'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:09.517997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf7d023bf454edf9c31e50ee0c10bcd', 'request_id': 'req-cf41b2af-c278-40fd-90c8-9b9a62a3b767'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:09.531219 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] The token cache is being invalidate because project bdf7d023bf454edf9c31e50ee0c10bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:05:09.531518 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:09.532189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:09.533779 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1387/2779] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:05:09 2022] DELETE /identity/v3/projects/bdf7d023bf454edf9c31e50ee0c10bcd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:05:09.537846 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:09.539371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:05:09.553195 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e2bc2-6c8e-4f3a-bca1-e441ede53456 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:09.614258 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872d661-0a7d-4c72-a5e5-d7a73dbe5bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:09.614924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872d661-0a7d-4c72-a5e5-d7a73dbe5bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:09.615219 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872d661-0a7d-4c72-a5e5-d7a73dbe5bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:09.615492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872d661-0a7d-4c72-a5e5-d7a73dbe5bfd admin admin] PATH_INFO: `/v3/users/649e5e6756094875999fabb2399001f4` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:09.616629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872d661-0a7d-4c72-a5e5-d7a73dbe5bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=649e5e6756094875999fabb2399001f4)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:09.618626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872d661-0a7d-4c72-a5e5-d7a73dbe5bfd admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:09.792648 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-6872d661-0a7d-4c72-a5e5-d7a73dbe5bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649e5e6756094875999fabb2399001f4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:09.852061 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-6872d661-0a7d-4c72-a5e5-d7a73dbe5bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649e5e6756094875999fabb2399001f4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:09.860531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-6872d661-0a7d-4c72-a5e5-d7a73dbe5bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649e5e6756094875999fabb2399001f4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:09.861147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-6872d661-0a7d-4c72-a5e5-d7a73dbe5bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649e5e6756094875999fabb2399001f4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:09.873098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-6872d661-0a7d-4c72-a5e5-d7a73dbe5bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649e5e6756094875999fabb2399001f4'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:09.879019 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1393/2780] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:05:09 2022] DELETE /identity/v3/users/649e5e6756094875999fabb2399001f4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:05:10.111835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:10.113252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:05:10.127599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41b2af-c278-40fd-90c8-9b9a62a3b767 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:10.140454 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648bfe2-1c9b-45aa-b5aa-6f6ce49ec540 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:10.141018 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648bfe2-1c9b-45aa-b5aa-6f6ce49ec540 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:10.141829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648bfe2-1c9b-45aa-b5aa-6f6ce49ec540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:10.148830 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:10.165291 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-c648bfe2-1c9b-45aa-b5aa-6f6ce49ec540 None None] MFA Rules not processed for user `cc620e5da6504627b8033a31687697de`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:05:10.166587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c648bfe2-1c9b-45aa-b5aa-6f6ce49ec540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:05:10.189988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:10.190616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:10.190906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:10.191197 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] PATH_INFO: `/v3/projects/7aff84c479344861ba16584214dad26a` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:10.192350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aff84c479344861ba16584214dad26a)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:10.194298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:10.223504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1394/2781] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:05:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:05:10.321344 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aff84c479344861ba16584214dad26a', 'request_id': 'req-72ac9e32-495a-45c1-8351-abdff653d132'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:10.328572 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aff84c479344861ba16584214dad26a', 'request_id': 'req-72ac9e32-495a-45c1-8351-abdff653d132'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:10.397878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aff84c479344861ba16584214dad26a', 'request_id': 'req-72ac9e32-495a-45c1-8351-abdff653d132'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:10.409708 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] The token cache is being invalidate because project 7aff84c479344861ba16584214dad26a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:05:10.410065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:10.410871 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:05:10.414462 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1388/2782] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:05:10 2022] DELETE /identity/v3/projects/7aff84c479344861ba16584214dad26a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:05:20.216775 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:20.406341 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:08.033731 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb58ab7-1118-4457-ba4e-03b1c612138c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:08.034325 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb58ab7-1118-4457-ba4e-03b1c612138c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:08.034325 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb58ab7-1118-4457-ba4e-03b1c612138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:08.054639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-bfb58ab7-1118-4457-ba4e-03b1c612138c None None] MFA Rules not processed for user `cc620e5da6504627b8033a31687697de`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:06:08.055906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-bfb58ab7-1118-4457-ba4e-03b1c612138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:06:08.111329 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1395/2783] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:06:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:06:18.104605 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=25 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:56.535046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:56.536200 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:06:56.613774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9e32-495a-45c1-8351-abdff653d132 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:56.617397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddfee4-1729-4cbc-880f-e8502f000cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:56.617995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddfee4-1729-4cbc-880f-e8502f000cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:56.618273 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddfee4-1729-4cbc-880f-e8502f000cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:56.618542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddfee4-1729-4cbc-880f-e8502f000cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:56.620961 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-abddfee4-1729-4cbc-880f-e8502f000cc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:06:56.702040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddfee4-1729-4cbc-880f-e8502f000cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:56.703416 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddfee4-1729-4cbc-880f-e8502f000cc2 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:56.723960 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1389/2784] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:06:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:06:59.819784 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb58ab7-1118-4457-ba4e-03b1c612138c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:59.821595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-bfb58ab7-1118-4457-ba4e-03b1c612138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:06:59.834022 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb58ab7-1118-4457-ba4e-03b1c612138c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:59.837758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725606ad-0640-43b5-b41c-a55315e98ecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:59.838851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725606ad-0640-43b5-b41c-a55315e98ecf service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:59.838851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725606ad-0640-43b5-b41c-a55315e98ecf service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:59.839094 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725606ad-0640-43b5-b41c-a55315e98ecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:59.840661 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-725606ad-0640-43b5-b41c-a55315e98ecf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:06:59.853740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725606ad-0640-43b5-b41c-a55315e98ecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:59.855197 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725606ad-0640-43b5-b41c-a55315e98ecf service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:59.865956 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1396/2785] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:06:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:06.721356 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=72 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:09.861214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=6 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:13.387098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddfee4-1729-4cbc-880f-e8502f000cc2 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:13.388532 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-abddfee4-1729-4cbc-880f-e8502f000cc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:13.461695 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddfee4-1729-4cbc-880f-e8502f000cc2 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:13.466790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0c9fa-de51-4a87-b5b7-17158548fb08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:13.467460 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0c9fa-de51-4a87-b5b7-17158548fb08 service placement] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:13.469556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0c9fa-de51-4a87-b5b7-17158548fb08 service placement] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:13.469556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0c9fa-de51-4a87-b5b7-17158548fb08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:13.469836 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-2ae0c9fa-de51-4a87-b5b7-17158548fb08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:13.481875 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0c9fa-de51-4a87-b5b7-17158548fb08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:13.483507 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0c9fa-de51-4a87-b5b7-17158548fb08 service placement] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:13.493574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1390/2786] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:13.503982 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725606ad-0640-43b5-b41c-a55315e98ecf service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:13.505938 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-725606ad-0640-43b5-b41c-a55315e98ecf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:13.577686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725606ad-0640-43b5-b41c-a55315e98ecf service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:13.582345 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7261f63-5e31-4de3-980d-2c61d36f4194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:13.582943 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7261f63-5e31-4de3-980d-2c61d36f4194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:13.583223 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7261f63-5e31-4de3-980d-2c61d36f4194 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:13.583493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7261f63-5e31-4de3-980d-2c61d36f4194 admin admin] PATH_INFO: `/v3/users/cc620e5da6504627b8033a31687697de` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:13.584592 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7261f63-5e31-4de3-980d-2c61d36f4194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc620e5da6504627b8033a31687697de)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:13.586482 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7261f63-5e31-4de3-980d-2c61d36f4194 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:13.782065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e7261f63-5e31-4de3-980d-2c61d36f4194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc620e5da6504627b8033a31687697de'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:13.830324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e7261f63-5e31-4de3-980d-2c61d36f4194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc620e5da6504627b8033a31687697de'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:13.837701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e7261f63-5e31-4de3-980d-2c61d36f4194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc620e5da6504627b8033a31687697de'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:13.838380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e7261f63-5e31-4de3-980d-2c61d36f4194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc620e5da6504627b8033a31687697de'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:13.850510 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e7261f63-5e31-4de3-980d-2c61d36f4194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc620e5da6504627b8033a31687697de'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:13.856475 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1397/2787] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:07:13 2022] DELETE /identity/v3/users/cc620e5da6504627b8033a31687697de => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:14.089478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0c9fa-de51-4a87-b5b7-17158548fb08 service placement] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:14.100969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0c9fa-de51-4a87-b5b7-17158548fb08 service placement] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:14.159585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50352853-4a65-4935-aafa-dc71019e1580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:14.160331 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50352853-4a65-4935-aafa-dc71019e1580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:14.160609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50352853-4a65-4935-aafa-dc71019e1580 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:14.160882 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50352853-4a65-4935-aafa-dc71019e1580 admin admin] PATH_INFO: `/v3/projects/cb1169ec8dd047a9ad3d47b658c76336` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:14.162010 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50352853-4a65-4935-aafa-dc71019e1580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1169ec8dd047a9ad3d47b658c76336)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:14.163959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50352853-4a65-4935-aafa-dc71019e1580 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:14.271423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-50352853-4a65-4935-aafa-dc71019e1580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1169ec8dd047a9ad3d47b658c76336', 'request_id': 'req-50352853-4a65-4935-aafa-dc71019e1580'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:14.276863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-50352853-4a65-4935-aafa-dc71019e1580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1169ec8dd047a9ad3d47b658c76336', 'request_id': 'req-50352853-4a65-4935-aafa-dc71019e1580'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:14.345027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-50352853-4a65-4935-aafa-dc71019e1580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1169ec8dd047a9ad3d47b658c76336', 'request_id': 'req-50352853-4a65-4935-aafa-dc71019e1580'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:14.356520 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-50352853-4a65-4935-aafa-dc71019e1580 admin admin] The token cache is being invalidate because project cb1169ec8dd047a9ad3d47b658c76336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:07:14.356835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-50352853-4a65-4935-aafa-dc71019e1580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:14.357461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-50352853-4a65-4935-aafa-dc71019e1580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:14.359570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1391/2788] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:07:14 2022] DELETE /identity/v3/projects/cb1169ec8dd047a9ad3d47b658c76336 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:14.364595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e43f62-aa15-4a75-ac56-4d72dfb385cc None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:14.365701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e43f62-aa15-4a75-ac56-4d72dfb385cc None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:14.365701 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e43f62-aa15-4a75-ac56-4d72dfb385cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:14.421882 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-d6e43f62-aa15-4a75-ac56-4d72dfb385cc None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:14.423140 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-d6e43f62-aa15-4a75-ac56-4d72dfb385cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:14.465965 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:14.481607 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1398/2789] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:14.489541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c9ce5-5328-4afd-812b-dfde6b211621 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:14.490057 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c9ce5-5328-4afd-812b-dfde6b211621 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:14.490160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c9ce5-5328-4afd-812b-dfde6b211621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:14.509508 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-c68c9ce5-5328-4afd-812b-dfde6b211621 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:14.510724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c68c9ce5-5328-4afd-812b-dfde6b211621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:14.519152 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1392/2790] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:14.523290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e43f62-aa15-4a75-ac56-4d72dfb385cc None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:14.533537 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e43f62-aa15-4a75-ac56-4d72dfb385cc None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:14.538067 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4af22c-7378-4ef0-ad88-26cc3a2abf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:14.538676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af22c-7378-4ef0-ad88-26cc3a2abf89 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:14.538983 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af22c-7378-4ef0-ad88-26cc3a2abf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:14.539378 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af22c-7378-4ef0-ad88-26cc3a2abf89 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:14.540020 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4af22c-7378-4ef0-ad88-26cc3a2abf89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:07:14.540349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4af22c-7378-4ef0-ad88-26cc3a2abf89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:14.541921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4af22c-7378-4ef0-ad88-26cc3a2abf89 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:14.553830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1399/2791] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:07:14.558053 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c9ce5-5328-4afd-812b-dfde6b211621 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:14.567410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c9ce5-5328-4afd-812b-dfde6b211621 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:14.572301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801e5b0-c79c-4ec2-88bc-583d0b015863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:14.572906 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801e5b0-c79c-4ec2-88bc-583d0b015863 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:14.573182 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801e5b0-c79c-4ec2-88bc-583d0b015863 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:14.573450 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801e5b0-c79c-4ec2-88bc-583d0b015863 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:14.574072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801e5b0-c79c-4ec2-88bc-583d0b015863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:14.576247 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801e5b0-c79c-4ec2-88bc-583d0b015863 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:14.588029 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:14.717992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1393/2792] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:07:14 2022] POST /identity/v3/projects => generated 405 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:07:14.721889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4af22c-7378-4ef0-ad88-26cc3a2abf89 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:14.732084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4af22c-7378-4ef0-ad88-26cc3a2abf89 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:14.788824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297a8f5-f1cf-4bc4-a53f-dfdde6249eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:14.789433 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297a8f5-f1cf-4bc4-a53f-dfdde6249eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:14.789749 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297a8f5-f1cf-4bc4-a53f-dfdde6249eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:14.790025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297a8f5-f1cf-4bc4-a53f-dfdde6249eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:14.790678 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297a8f5-f1cf-4bc4-a53f-dfdde6249eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:14.792632 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297a8f5-f1cf-4bc4-a53f-dfdde6249eb2 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:14.921979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1400/2793] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:07:14 2022] POST /identity/v3/users => generated 303 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:07:14.926017 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801e5b0-c79c-4ec2-88bc-583d0b015863 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:14.940763 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801e5b0-c79c-4ec2-88bc-583d0b015863 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:14.945318 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088793c-7ae5-452d-91c4-91f1f7ebef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:14.945909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088793c-7ae5-452d-91c4-91f1f7ebef7e admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:14.946184 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088793c-7ae5-452d-91c4-91f1f7ebef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:14.946452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088793c-7ae5-452d-91c4-91f1f7ebef7e admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:14.947132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088793c-7ae5-452d-91c4-91f1f7ebef7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:14.948935 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088793c-7ae5-452d-91c4-91f1f7ebef7e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:14.959614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1394/2794] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:14.963693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297a8f5-f1cf-4bc4-a53f-dfdde6249eb2 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:14.982911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297a8f5-f1cf-4bc4-a53f-dfdde6249eb2 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:14.982911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe29136-6b21-470a-b51d-7afc6562c7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:14.982911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe29136-6b21-470a-b51d-7afc6562c7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:14.982911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe29136-6b21-470a-b51d-7afc6562c7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:14.983406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe29136-6b21-470a-b51d-7afc6562c7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:14.983406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe29136-6b21-470a-b51d-7afc6562c7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:14.983406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe29136-6b21-470a-b51d-7afc6562c7c5 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:14.992476 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1401/2795] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:14.996491 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088793c-7ae5-452d-91c4-91f1f7ebef7e admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:15.006995 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088793c-7ae5-452d-91c4-91f1f7ebef7e admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:15.011441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b610b-6a4b-4fce-b54c-77bc71684f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:15.012122 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b610b-6a4b-4fce-b54c-77bc71684f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:15.012400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b610b-6a4b-4fce-b54c-77bc71684f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:15.012672 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b610b-6a4b-4fce-b54c-77bc71684f47 admin admin] PATH_INFO: `/v3/projects/305ac7339f4c4b43947331afe2775357/users/f9f670c671994658981febb1a03120e8/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:15.027500 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b610b-6a4b-4fce-b54c-77bc71684f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=305ac7339f4c4b43947331afe2775357, user_id=f9f670c671994658981febb1a03120e8, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:15.030201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b610b-6a4b-4fce-b54c-77bc71684f47 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:15.093364 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1395/2796] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:07:14 2022] PUT /identity/v3/projects/305ac7339f4c4b43947331afe2775357/users/f9f670c671994658981febb1a03120e8/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:15.111968 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38b1c5-7a63-4816-a2a7-368a4eda405c None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:15.112274 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38b1c5-7a63-4816-a2a7-368a4eda405c None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:15.112544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38b1c5-7a63-4816-a2a7-368a4eda405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:15.141090 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-1a38b1c5-7a63-4816-a2a7-368a4eda405c None None] MFA Rules not processed for user `f9f670c671994658981febb1a03120e8`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:15.142318 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-1a38b1c5-7a63-4816-a2a7-368a4eda405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:15.206342 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1402/2797] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:15.210769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b610b-6a4b-4fce-b54c-77bc71684f47 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:15.271862 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b610b-6a4b-4fce-b54c-77bc71684f47 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:15.277644 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc8eb6-ee42-40be-8dac-677200b1b7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:15.278239 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc8eb6-ee42-40be-8dac-677200b1b7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:15.278521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc8eb6-ee42-40be-8dac-677200b1b7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:15.278799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc8eb6-ee42-40be-8dac-677200b1b7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:15.279461 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc8eb6-ee42-40be-8dac-677200b1b7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:15.281920 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc8eb6-ee42-40be-8dac-677200b1b7c8 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:15.368956 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1396/2798] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:07:15 2022] POST /identity/v3/projects => generated 405 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:07:15.373038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38b1c5-7a63-4816-a2a7-368a4eda405c None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:15.383962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38b1c5-7a63-4816-a2a7-368a4eda405c None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:15.425705 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:15.440116 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127b63e-6f5d-4cc4-b900-5786ac0a3464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:15.440798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127b63e-6f5d-4cc4-b900-5786ac0a3464 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:15.441081 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127b63e-6f5d-4cc4-b900-5786ac0a3464 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:15.441356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127b63e-6f5d-4cc4-b900-5786ac0a3464 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:15.441988 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127b63e-6f5d-4cc4-b900-5786ac0a3464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:15.443947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127b63e-6f5d-4cc4-b900-5786ac0a3464 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:15.516998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1403/2799] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:07:15 2022] POST /identity/v3/users => generated 309 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:07:15.520955 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc8eb6-ee42-40be-8dac-677200b1b7c8 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:15.533108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc8eb6-ee42-40be-8dac-677200b1b7c8 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:15.535964 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8cd8d-18cf-4e6d-977a-02f54d99df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:15.536561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8cd8d-18cf-4e6d-977a-02f54d99df17 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:15.536840 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8cd8d-18cf-4e6d-977a-02f54d99df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:15.537112 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8cd8d-18cf-4e6d-977a-02f54d99df17 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:15.537751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8cd8d-18cf-4e6d-977a-02f54d99df17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:15.539366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8cd8d-18cf-4e6d-977a-02f54d99df17 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:15.549689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1397/2800] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:15.553804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127b63e-6f5d-4cc4-b900-5786ac0a3464 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:15.564807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127b63e-6f5d-4cc4-b900-5786ac0a3464 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:15.569508 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d3939-87f7-4357-b2fb-470de3fdbab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:15.570161 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d3939-87f7-4357-b2fb-470de3fdbab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:15.570441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d3939-87f7-4357-b2fb-470de3fdbab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:15.570748 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d3939-87f7-4357-b2fb-470de3fdbab5 admin admin] PATH_INFO: `/v3/projects/6226c730d51742b4a9dc91180ffc0ed0/users/03f0f64630994a5fb56cc9e82fb50ea2/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:15.586240 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d3939-87f7-4357-b2fb-470de3fdbab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6226c730d51742b4a9dc91180ffc0ed0, user_id=03f0f64630994a5fb56cc9e82fb50ea2, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:15.588918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d3939-87f7-4357-b2fb-470de3fdbab5 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:15.665546 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1404/2801] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:07:15 2022] PUT /identity/v3/projects/6226c730d51742b4a9dc91180ffc0ed0/users/03f0f64630994a5fb56cc9e82fb50ea2/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:15.669585 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8cd8d-18cf-4e6d-977a-02f54d99df17 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:15.680199 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8cd8d-18cf-4e6d-977a-02f54d99df17 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:15.735881 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa361bd-d320-40fd-8bf3-68aa8e02eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:15.736834 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa361bd-d320-40fd-8bf3-68aa8e02eb31 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:15.737113 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa361bd-d320-40fd-8bf3-68aa8e02eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:15.737386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa361bd-d320-40fd-8bf3-68aa8e02eb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:15.738020 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa361bd-d320-40fd-8bf3-68aa8e02eb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:15.739637 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa361bd-d320-40fd-8bf3-68aa8e02eb31 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:15.750180 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1398/2802] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:15.754382 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d3939-87f7-4357-b2fb-470de3fdbab5 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:15.765207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d3939-87f7-4357-b2fb-470de3fdbab5 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:15.770025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81c969-dc41-442e-b2b7-af86c990fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:15.770686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c969-dc41-442e-b2b7-af86c990fc7f admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:15.771006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c969-dc41-442e-b2b7-af86c990fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:15.771284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c969-dc41-442e-b2b7-af86c990fc7f admin admin] PATH_INFO: `/v3/projects/6226c730d51742b4a9dc91180ffc0ed0/users/03f0f64630994a5fb56cc9e82fb50ea2/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:15.773248 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81c969-dc41-442e-b2b7-af86c990fc7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6226c730d51742b4a9dc91180ffc0ed0, user_id=03f0f64630994a5fb56cc9e82fb50ea2, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:15.775917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81c969-dc41-442e-b2b7-af86c990fc7f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:15.786097 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1405/2803] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:07:15 2022] PUT /identity/v3/projects/6226c730d51742b4a9dc91180ffc0ed0/users/03f0f64630994a5fb56cc9e82fb50ea2/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:15.796136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544b1e5-7317-43b7-8c05-55edde36338b None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:15.796418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544b1e5-7317-43b7-8c05-55edde36338b None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:15.796714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544b1e5-7317-43b7-8c05-55edde36338b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:15.827006 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-4544b1e5-7317-43b7-8c05-55edde36338b None None] MFA Rules not processed for user `03f0f64630994a5fb56cc9e82fb50ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:15.828250 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4544b1e5-7317-43b7-8c05-55edde36338b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:15.833407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:15.896441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1399/2804] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:15 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:15.906973 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81c969-dc41-442e-b2b7-af86c990fc7f admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:15.908754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4e81c969-dc41-442e-b2b7-af86c990fc7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:15.967377 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81c969-dc41-442e-b2b7-af86c990fc7f admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:15.971031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a023746-8a62-4719-953e-3d04f96201ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:15.971635 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a023746-8a62-4719-953e-3d04f96201ef service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:15.971944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a023746-8a62-4719-953e-3d04f96201ef service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:15.972193 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a023746-8a62-4719-953e-3d04f96201ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:15.981004 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a023746-8a62-4719-953e-3d04f96201ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:15.982417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a023746-8a62-4719-953e-3d04f96201ef service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:15.992251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1406/2805] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:15 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:16.123178 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544b1e5-7317-43b7-8c05-55edde36338b None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:16.187160 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544b1e5-7317-43b7-8c05-55edde36338b None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:16.191615 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:16.192241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:16.192517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:16.192790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] PATH_INFO: `/v3/users/f9f670c671994658981febb1a03120e8` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:16.193897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f670c671994658981febb1a03120e8)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:16.195914 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:16.354249 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f670c671994658981febb1a03120e8'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:16.366036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f670c671994658981febb1a03120e8'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:16.373028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f670c671994658981febb1a03120e8'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:16.374179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f670c671994658981febb1a03120e8'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:16.374794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f670c671994658981febb1a03120e8'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:16.436298 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1400/2806] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:07:16 2022] DELETE /identity/v3/users/f9f670c671994658981febb1a03120e8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:16.440918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b08943-dee9-4639-8d12-78c416736630 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:16.441206 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b08943-dee9-4639-8d12-78c416736630 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:16.441518 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b08943-dee9-4639-8d12-78c416736630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:16.461178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-35b08943-dee9-4639-8d12-78c416736630 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:16.462390 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-35b08943-dee9-4639-8d12-78c416736630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:16.519836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1407/2807] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:16.529521 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:16.530954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:16.556458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:16.612020 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d18ee-b62e-4dab-925b-c8381f9dcf49 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:16.615943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31d958-3936-4e27-8c5a-2dc032a66e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:16.616550 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31d958-3936-4e27-8c5a-2dc032a66e31 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:16.616831 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31d958-3936-4e27-8c5a-2dc032a66e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:16.617106 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31d958-3936-4e27-8c5a-2dc032a66e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:16.627299 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31d958-3936-4e27-8c5a-2dc032a66e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:16.628713 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31d958-3936-4e27-8c5a-2dc032a66e31 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:16.638129 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1401/2808] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:17.237997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b08943-dee9-4639-8d12-78c416736630 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:17.239486 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-35b08943-dee9-4639-8d12-78c416736630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:17.251441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b08943-dee9-4639-8d12-78c416736630 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:17.256268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:17.256962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:17.257247 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:17.257525 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] PATH_INFO: `/v3/projects/305ac7339f4c4b43947331afe2775357` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:17.258646 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=305ac7339f4c4b43947331afe2775357)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:17.260587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:17.348278 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:17.357407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '305ac7339f4c4b43947331afe2775357', 'request_id': 'req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:17.363601 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '305ac7339f4c4b43947331afe2775357', 'request_id': 'req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:17.369738 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '305ac7339f4c4b43947331afe2775357', 'request_id': 'req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:17.435334 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] The token cache is being invalidate because project 305ac7339f4c4b43947331afe2775357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:07:17.435729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:17.436405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:17.437885 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1408/2809] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:07:17 2022] DELETE /identity/v3/projects/305ac7339f4c4b43947331afe2775357 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:17.442414 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31d958-3936-4e27-8c5a-2dc032a66e31 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:17.453062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31d958-3936-4e27-8c5a-2dc032a66e31 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:17.508812 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca1647-baf5-46f9-b303-6e0f45e85bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:17.509436 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca1647-baf5-46f9-b303-6e0f45e85bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:17.509717 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca1647-baf5-46f9-b303-6e0f45e85bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:17.509994 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca1647-baf5-46f9-b303-6e0f45e85bf2 admin admin] PATH_INFO: `/v3/users/03f0f64630994a5fb56cc9e82fb50ea2` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:17.511162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca1647-baf5-46f9-b303-6e0f45e85bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f0f64630994a5fb56cc9e82fb50ea2)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:17.513070 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca1647-baf5-46f9-b303-6e0f45e85bf2 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:17.695038 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-41ca1647-baf5-46f9-b303-6e0f45e85bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f0f64630994a5fb56cc9e82fb50ea2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:17.708148 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-41ca1647-baf5-46f9-b303-6e0f45e85bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f0f64630994a5fb56cc9e82fb50ea2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:17.715033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-41ca1647-baf5-46f9-b303-6e0f45e85bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f0f64630994a5fb56cc9e82fb50ea2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:17.715694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-41ca1647-baf5-46f9-b303-6e0f45e85bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f0f64630994a5fb56cc9e82fb50ea2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:17.716324 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-41ca1647-baf5-46f9-b303-6e0f45e85bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f0f64630994a5fb56cc9e82fb50ea2'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:17.796440 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1402/2810] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:07:17 2022] DELETE /identity/v3/users/03f0f64630994a5fb56cc9e82fb50ea2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:18.191883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:18.193368 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:18.210086 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763cc8e-2486-4bed-a709-6a40c6f7eb1c admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:18.267975 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:18.268653 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:18.268953 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:18.269207 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c admin admin] PATH_INFO: `/v3/projects/6226c730d51742b4a9dc91180ffc0ed0` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:18.270322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6226c730d51742b4a9dc91180ffc0ed0)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:18.272262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:18.368246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6226c730d51742b4a9dc91180ffc0ed0', 'request_id': 'req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:18.374527 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6226c730d51742b4a9dc91180ffc0ed0', 'request_id': 'req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:18.380713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6226c730d51742b4a9dc91180ffc0ed0', 'request_id': 'req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:18.469629 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c admin admin] The token cache is being invalidate because project 6226c730d51742b4a9dc91180ffc0ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:07:18.469851 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:18.470466 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-83787d42-1caf-4c3f-96f3-ff8ee69bc44c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:18.471981 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1409/2811] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:07:18 2022] DELETE /identity/v3/projects/6226c730d51742b4a9dc91180ffc0ed0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:18.477036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d277de3-38ca-41c9-ab7d-5d689641fb89 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:18.477392 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d277de3-38ca-41c9-ab7d-5d689641fb89 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:18.477703 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d277de3-38ca-41c9-ab7d-5d689641fb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:18.500609 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-1d277de3-38ca-41c9-ab7d-5d689641fb89 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:18.501839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-1d277de3-38ca-41c9-ab7d-5d689641fb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:18.520723 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:18.560499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1403/2812] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:18.569543 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6743623-ff40-4f49-997a-68133d8be25f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:18.569831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6743623-ff40-4f49-997a-68133d8be25f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:18.570106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6743623-ff40-4f49-997a-68133d8be25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:18.590374 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f6743623-ff40-4f49-997a-68133d8be25f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:18.592254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f6743623-ff40-4f49-997a-68133d8be25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:18.600500 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1410/2813] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:18.604743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d277de3-38ca-41c9-ab7d-5d689641fb89 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:18.614959 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d277de3-38ca-41c9-ab7d-5d689641fb89 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:18.619636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d089a5-adae-4b4d-a6ab-fa2622e6f2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:18.620227 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d089a5-adae-4b4d-a6ab-fa2622e6f2bc admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:18.620504 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d089a5-adae-4b4d-a6ab-fa2622e6f2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:18.620774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d089a5-adae-4b4d-a6ab-fa2622e6f2bc admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:18.621408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d089a5-adae-4b4d-a6ab-fa2622e6f2bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:07:18.621724 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d089a5-adae-4b4d-a6ab-fa2622e6f2bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:18.623307 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d089a5-adae-4b4d-a6ab-fa2622e6f2bc admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:18.635039 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1404/2814] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:07:18.639359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6743623-ff40-4f49-997a-68133d8be25f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:18.649150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6743623-ff40-4f49-997a-68133d8be25f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:18.653765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b255470-e3de-4d65-8575-d5a4996e8aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:18.654860 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b255470-e3de-4d65-8575-d5a4996e8aec admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:18.655167 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b255470-e3de-4d65-8575-d5a4996e8aec admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:18.655436 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b255470-e3de-4d65-8575-d5a4996e8aec admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:18.656085 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b255470-e3de-4d65-8575-d5a4996e8aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:18.657994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b255470-e3de-4d65-8575-d5a4996e8aec admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:18.746371 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1411/2815] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:07:18 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:07:18.750512 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d089a5-adae-4b4d-a6ab-fa2622e6f2bc admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:18.760594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d089a5-adae-4b4d-a6ab-fa2622e6f2bc admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:18.816592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee6894-3a40-4eab-8f9e-e02bbe4ec4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:18.817191 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee6894-3a40-4eab-8f9e-e02bbe4ec4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:18.817467 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee6894-3a40-4eab-8f9e-e02bbe4ec4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:18.817744 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee6894-3a40-4eab-8f9e-e02bbe4ec4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:18.818357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee6894-3a40-4eab-8f9e-e02bbe4ec4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:18.820287 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee6894-3a40-4eab-8f9e-e02bbe4ec4c2 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:18.916007 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1405/2816] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:07:18 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:07:18.920055 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b255470-e3de-4d65-8575-d5a4996e8aec admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:18.930264 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b255470-e3de-4d65-8575-d5a4996e8aec admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:18.934862 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b7ca7-f697-4e83-b3bc-519019da23b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:18.937733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b7ca7-f697-4e83-b3bc-519019da23b2 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:18.937733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b7ca7-f697-4e83-b3bc-519019da23b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:18.937733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b7ca7-f697-4e83-b3bc-519019da23b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:18.937733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b7ca7-f697-4e83-b3bc-519019da23b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:18.938372 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b7ca7-f697-4e83-b3bc-519019da23b2 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:18.948181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1412/2817] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:18.952700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee6894-3a40-4eab-8f9e-e02bbe4ec4c2 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:18.962636 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee6894-3a40-4eab-8f9e-e02bbe4ec4c2 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:18.968064 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8aec2-1099-456d-abe6-bbfb9874d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:18.968650 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8aec2-1099-456d-abe6-bbfb9874d78b admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:18.968933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8aec2-1099-456d-abe6-bbfb9874d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:18.969207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8aec2-1099-456d-abe6-bbfb9874d78b admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:18.969843 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8aec2-1099-456d-abe6-bbfb9874d78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:18.971455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8aec2-1099-456d-abe6-bbfb9874d78b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:18.982190 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1406/2818] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:18.986239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b7ca7-f697-4e83-b3bc-519019da23b2 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:18.996299 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b7ca7-f697-4e83-b3bc-519019da23b2 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:19.001238 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412e003-4769-4d46-b4a6-6e0bfb5e75e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:19.001915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e003-4769-4d46-b4a6-6e0bfb5e75e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.002194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e003-4769-4d46-b4a6-6e0bfb5e75e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.002472 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e003-4769-4d46-b4a6-6e0bfb5e75e9 admin admin] PATH_INFO: `/v3/projects/7bb6a14e9de94c04914ef19d3f9e5fc8/users/5f85803a72054be6b304b869ce2dc2ad/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:19.014786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:19.018693 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412e003-4769-4d46-b4a6-6e0bfb5e75e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb6a14e9de94c04914ef19d3f9e5fc8, user_id=5f85803a72054be6b304b869ce2dc2ad, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:19.021342 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412e003-4769-4d46-b4a6-6e0bfb5e75e9 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:19.117099 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1413/2819] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:07:18 2022] PUT /identity/v3/projects/7bb6a14e9de94c04914ef19d3f9e5fc8/users/5f85803a72054be6b304b869ce2dc2ad/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:19.127630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8426a-4ff0-4243-bae7-d1f9d6d44a42 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.127916 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8426a-4ff0-4243-bae7-d1f9d6d44a42 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.128188 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8426a-4ff0-4243-bae7-d1f9d6d44a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:19.156781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-49a8426a-4ff0-4243-bae7-d1f9d6d44a42 None None] MFA Rules not processed for user `5f85803a72054be6b304b869ce2dc2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:19.157998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-49a8426a-4ff0-4243-bae7-d1f9d6d44a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:19.222115 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1407/2820] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:19.226573 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412e003-4769-4d46-b4a6-6e0bfb5e75e9 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:19.287430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412e003-4769-4d46-b4a6-6e0bfb5e75e9 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:19.291994 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42f3fd-3c38-4e41-ad80-40f1864175ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:19.292593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f3fd-3c38-4e41-ad80-40f1864175ee admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.292874 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f3fd-3c38-4e41-ad80-40f1864175ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.293148 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f3fd-3c38-4e41-ad80-40f1864175ee admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:19.293767 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42f3fd-3c38-4e41-ad80-40f1864175ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:19.295686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42f3fd-3c38-4e41-ad80-40f1864175ee admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:19.414616 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1414/2821] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:07:19 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:07:19.418682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8426a-4ff0-4243-bae7-d1f9d6d44a42 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:19.429888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8426a-4ff0-4243-bae7-d1f9d6d44a42 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:19.446590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:19.487346 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95584de-f138-4520-afff-2dcd1e93afbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:19.487980 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95584de-f138-4520-afff-2dcd1e93afbe admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.488262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95584de-f138-4520-afff-2dcd1e93afbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.488531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95584de-f138-4520-afff-2dcd1e93afbe admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:19.489157 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95584de-f138-4520-afff-2dcd1e93afbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:19.491089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95584de-f138-4520-afff-2dcd1e93afbe admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:19.544541 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1408/2822] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:07:19 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:07:19.548591 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42f3fd-3c38-4e41-ad80-40f1864175ee admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:19.558905 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42f3fd-3c38-4e41-ad80-40f1864175ee admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:19.564000 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595a1db-a369-4864-8e61-d877073fedec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:19.564597 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595a1db-a369-4864-8e61-d877073fedec admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.564880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595a1db-a369-4864-8e61-d877073fedec admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.565151 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595a1db-a369-4864-8e61-d877073fedec admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:19.565782 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595a1db-a369-4864-8e61-d877073fedec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:19.567444 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595a1db-a369-4864-8e61-d877073fedec admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:19.579226 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1415/2823] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:19.583163 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95584de-f138-4520-afff-2dcd1e93afbe admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:19.592968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95584de-f138-4520-afff-2dcd1e93afbe admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:19.597517 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ea606-dffb-48b1-8c1e-cba9c162505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:19.598156 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ea606-dffb-48b1-8c1e-cba9c162505b admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.598436 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ea606-dffb-48b1-8c1e-cba9c162505b admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.598710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ea606-dffb-48b1-8c1e-cba9c162505b admin admin] PATH_INFO: `/v3/projects/47e65083c875413287567593b64e4112/users/e6ed25008cd04c10b07d034f1a913975/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:19.614463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ea606-dffb-48b1-8c1e-cba9c162505b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e65083c875413287567593b64e4112, user_id=e6ed25008cd04c10b07d034f1a913975, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:19.617111 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ea606-dffb-48b1-8c1e-cba9c162505b admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:19.670427 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1409/2824] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:07:19 2022] PUT /identity/v3/projects/47e65083c875413287567593b64e4112/users/e6ed25008cd04c10b07d034f1a913975/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:19.674269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595a1db-a369-4864-8e61-d877073fedec admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:19.684609 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595a1db-a369-4864-8e61-d877073fedec admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:19.742214 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d850aa1-fad1-4002-b23a-c8a3f5a4f41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:19.743044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d850aa1-fad1-4002-b23a-c8a3f5a4f41a admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.743160 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d850aa1-fad1-4002-b23a-c8a3f5a4f41a admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.743403 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d850aa1-fad1-4002-b23a-c8a3f5a4f41a admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:19.744178 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d850aa1-fad1-4002-b23a-c8a3f5a4f41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:19.745749 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d850aa1-fad1-4002-b23a-c8a3f5a4f41a admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:19.756403 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1416/2825] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:19.760727 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ea606-dffb-48b1-8c1e-cba9c162505b admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:19.770981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ea606-dffb-48b1-8c1e-cba9c162505b admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:19.775660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a359b4-b7cd-4d50-825c-07ef3e3de715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:19.776301 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a359b4-b7cd-4d50-825c-07ef3e3de715 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.776582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a359b4-b7cd-4d50-825c-07ef3e3de715 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.776854 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a359b4-b7cd-4d50-825c-07ef3e3de715 admin admin] PATH_INFO: `/v3/projects/47e65083c875413287567593b64e4112/users/e6ed25008cd04c10b07d034f1a913975/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:19.778759 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a359b4-b7cd-4d50-825c-07ef3e3de715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e65083c875413287567593b64e4112, user_id=e6ed25008cd04c10b07d034f1a913975, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:19.781400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a359b4-b7cd-4d50-825c-07ef3e3de715 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:19.791380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1410/2826] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:07:19 2022] PUT /identity/v3/projects/47e65083c875413287567593b64e4112/users/e6ed25008cd04c10b07d034f1a913975/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:19.802125 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4b9b0-9509-4da0-adac-e852d56d9202 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.802343 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4b9b0-9509-4da0-adac-e852d56d9202 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.802611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4b9b0-9509-4da0-adac-e852d56d9202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:19.830221 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-6bc4b9b0-9509-4da0-adac-e852d56d9202 None None] MFA Rules not processed for user `e6ed25008cd04c10b07d034f1a913975`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:19.831455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6bc4b9b0-9509-4da0-adac-e852d56d9202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:19.876970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:19.897688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1417/2827] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:07:19.908533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a359b4-b7cd-4d50-825c-07ef3e3de715 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:19.910237 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-74a359b4-b7cd-4d50-825c-07ef3e3de715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:19.968570 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a359b4-b7cd-4d50-825c-07ef3e3de715 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:19.972312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4c1fb-d7a6-4b13-bc7c-1348ef6e8e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:19.972932 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4c1fb-d7a6-4b13-bc7c-1348ef6e8e6d service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.973195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4c1fb-d7a6-4b13-bc7c-1348ef6e8e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.973465 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4c1fb-d7a6-4b13-bc7c-1348ef6e8e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:20.029531 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4c1fb-d7a6-4b13-bc7c-1348ef6e8e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:20.031046 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4c1fb-d7a6-4b13-bc7c-1348ef6e8e6d service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:20.039929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1411/2828] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:23.121041 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4b9b0-9509-4da0-adac-e852d56d9202 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:23.131726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4b9b0-9509-4da0-adac-e852d56d9202 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:23.135380 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677e9bd-7eb0-4c59-a143-4b595ea8181c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:23.136043 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677e9bd-7eb0-4c59-a143-4b595ea8181c service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:23.136324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677e9bd-7eb0-4c59-a143-4b595ea8181c service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:23.136617 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677e9bd-7eb0-4c59-a143-4b595ea8181c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:23.145698 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677e9bd-7eb0-4c59-a143-4b595ea8181c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:23.147136 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677e9bd-7eb0-4c59-a143-4b595ea8181c service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:23.156562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1418/2829] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:30.035902 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:33.152356 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=13 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:37.653401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4c1fb-d7a6-4b13-bc7c-1348ef6e8e6d service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:37.716117 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4c1fb-d7a6-4b13-bc7c-1348ef6e8e6d service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:37.720561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:37.728443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:37.728443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:37.728443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] PATH_INFO: `/v3/users/5f85803a72054be6b304b869ce2dc2ad` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:37.728443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f85803a72054be6b304b869ce2dc2ad)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:37.728443 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:37.871787 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f85803a72054be6b304b869ce2dc2ad'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:37.883596 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f85803a72054be6b304b869ce2dc2ad'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:37.890357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f85803a72054be6b304b869ce2dc2ad'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:37.891071 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f85803a72054be6b304b869ce2dc2ad'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:37.891652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f85803a72054be6b304b869ce2dc2ad'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:37.943394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1412/2830] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:07:37 2022] DELETE /identity/v3/users/5f85803a72054be6b304b869ce2dc2ad => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:37.947887 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550fd9e-872f-4291-98a4-e8121f4d7f03 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:37.948349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550fd9e-872f-4291-98a4-e8121f4d7f03 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:37.952031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550fd9e-872f-4291-98a4-e8121f4d7f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:37.969239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-e550fd9e-872f-4291-98a4-e8121f4d7f03 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:37.969239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e550fd9e-872f-4291-98a4-e8121f4d7f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:38.026793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1419/2831] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:38.037353 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:38.038820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:38.095381 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9786158-e47b-4e58-94c6-190553675f83 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:38.099626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e3252-f10b-4605-b4b7-a294b9534a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:38.100229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e3252-f10b-4605-b4b7-a294b9534a45 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:38.100506 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e3252-f10b-4605-b4b7-a294b9534a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:38.100774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e3252-f10b-4605-b4b7-a294b9534a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:38.109700 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e3252-f10b-4605-b4b7-a294b9534a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:38.111146 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e3252-f10b-4605-b4b7-a294b9534a45 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:38.120422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1413/2832] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:07:38.528669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550fd9e-872f-4291-98a4-e8121f4d7f03 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:38.530230 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e550fd9e-872f-4291-98a4-e8121f4d7f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:38.545786 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550fd9e-872f-4291-98a4-e8121f4d7f03 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:38.548761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:38.549959 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:38.550262 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:38.550519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] PATH_INFO: `/v3/projects/7bb6a14e9de94c04914ef19d3f9e5fc8` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:38.551785 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb6a14e9de94c04914ef19d3f9e5fc8)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:38.553719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:38.640925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb6a14e9de94c04914ef19d3f9e5fc8', 'request_id': 'req-9a5e018f-930e-4480-943c-740d3ed7147e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:38.647286 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb6a14e9de94c04914ef19d3f9e5fc8', 'request_id': 'req-9a5e018f-930e-4480-943c-740d3ed7147e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:38.653619 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb6a14e9de94c04914ef19d3f9e5fc8', 'request_id': 'req-9a5e018f-930e-4480-943c-740d3ed7147e'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:38.714225 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] The token cache is being invalidate because project 7bb6a14e9de94c04914ef19d3f9e5fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:07:38.714515 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:38.715166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:38.716655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1420/2833] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:07:38 2022] DELETE /identity/v3/projects/7bb6a14e9de94c04914ef19d3f9e5fc8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:38.720674 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e3252-f10b-4605-b4b7-a294b9534a45 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:38.731215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e3252-f10b-4605-b4b7-a294b9534a45 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:38.749774 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:38.788317 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c90005-4d07-4a0c-86d8-4d02e462bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:38.788945 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c90005-4d07-4a0c-86d8-4d02e462bbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:38.789232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c90005-4d07-4a0c-86d8-4d02e462bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:38.789529 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c90005-4d07-4a0c-86d8-4d02e462bbe2 admin admin] PATH_INFO: `/v3/users/e6ed25008cd04c10b07d034f1a913975` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:38.790647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c90005-4d07-4a0c-86d8-4d02e462bbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ed25008cd04c10b07d034f1a913975)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:38.792586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c90005-4d07-4a0c-86d8-4d02e462bbe2 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:38.945555 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f5c90005-4d07-4a0c-86d8-4d02e462bbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ed25008cd04c10b07d034f1a913975'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:38.958099 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f5c90005-4d07-4a0c-86d8-4d02e462bbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ed25008cd04c10b07d034f1a913975'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:38.965232 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f5c90005-4d07-4a0c-86d8-4d02e462bbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ed25008cd04c10b07d034f1a913975'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:38.965901 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f5c90005-4d07-4a0c-86d8-4d02e462bbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ed25008cd04c10b07d034f1a913975'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:38.966509 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-f5c90005-4d07-4a0c-86d8-4d02e462bbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ed25008cd04c10b07d034f1a913975'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:39.024420 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1414/2834] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:07:38 2022] DELETE /identity/v3/users/e6ed25008cd04c10b07d034f1a913975 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:39.431446 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:39.432927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:39.446751 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e018f-930e-4480-943c-740d3ed7147e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:39.505947 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6f01f-5964-4a84-bec4-38d998adaf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:39.508997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6f01f-5964-4a84-bec4-38d998adaf41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:39.508997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6f01f-5964-4a84-bec4-38d998adaf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:39.508997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6f01f-5964-4a84-bec4-38d998adaf41 admin admin] PATH_INFO: `/v3/projects/47e65083c875413287567593b64e4112` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:39.508997 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6f01f-5964-4a84-bec4-38d998adaf41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e65083c875413287567593b64e4112)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:39.510193 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6f01f-5964-4a84-bec4-38d998adaf41 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:39.596441 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:39.612266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b5a6f01f-5964-4a84-bec4-38d998adaf41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e65083c875413287567593b64e4112', 'request_id': 'req-b5a6f01f-5964-4a84-bec4-38d998adaf41'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:39.617520 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b5a6f01f-5964-4a84-bec4-38d998adaf41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e65083c875413287567593b64e4112', 'request_id': 'req-b5a6f01f-5964-4a84-bec4-38d998adaf41'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:39.623501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b5a6f01f-5964-4a84-bec4-38d998adaf41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e65083c875413287567593b64e4112', 'request_id': 'req-b5a6f01f-5964-4a84-bec4-38d998adaf41'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:39.708076 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b5a6f01f-5964-4a84-bec4-38d998adaf41 admin admin] The token cache is being invalidate because project 47e65083c875413287567593b64e4112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:07:39.708350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b5a6f01f-5964-4a84-bec4-38d998adaf41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:39.708961 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-b5a6f01f-5964-4a84-bec4-38d998adaf41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:39.710426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1421/2835] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:07:39 2022] DELETE /identity/v3/projects/47e65083c875413287567593b64e4112 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:39.715290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbd98b-ae0e-46ad-bde4-33aa285b1023 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:39.715577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbd98b-ae0e-46ad-bde4-33aa285b1023 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:39.715852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbd98b-ae0e-46ad-bde4-33aa285b1023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:39.735817 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-cfcbd98b-ae0e-46ad-bde4-33aa285b1023 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:39.737568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cfcbd98b-ae0e-46ad-bde4-33aa285b1023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:39.797096 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1415/2836] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:39.805728 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684f31f-26e3-4adc-b12e-d4853f66a833 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:39.806011 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684f31f-26e3-4adc-b12e-d4853f66a833 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:39.806282 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684f31f-26e3-4adc-b12e-d4853f66a833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:39.826039 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-b684f31f-26e3-4adc-b12e-d4853f66a833 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:39.827267 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b684f31f-26e3-4adc-b12e-d4853f66a833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:39.834969 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1422/2837] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:39.839171 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbd98b-ae0e-46ad-bde4-33aa285b1023 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:39.849410 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbd98b-ae0e-46ad-bde4-33aa285b1023 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:39.854166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3103bf9-19da-4d60-80ad-d3e478efc9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:39.854765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3103bf9-19da-4d60-80ad-d3e478efc9ea admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:39.855080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3103bf9-19da-4d60-80ad-d3e478efc9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:39.855355 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3103bf9-19da-4d60-80ad-d3e478efc9ea admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:39.855999 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3103bf9-19da-4d60-80ad-d3e478efc9ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:07:39.856302 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3103bf9-19da-4d60-80ad-d3e478efc9ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:39.857888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3103bf9-19da-4d60-80ad-d3e478efc9ea admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:39.870201 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1416/2838] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:07:39.873939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684f31f-26e3-4adc-b12e-d4853f66a833 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:39.883284 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684f31f-26e3-4adc-b12e-d4853f66a833 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:39.888224 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e19a9-5f02-4aa7-ae7c-dc601c7beceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:39.888804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e19a9-5f02-4aa7-ae7c-dc601c7beceb admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:39.889112 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e19a9-5f02-4aa7-ae7c-dc601c7beceb admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:39.889386 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e19a9-5f02-4aa7-ae7c-dc601c7beceb admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:39.890044 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e19a9-5f02-4aa7-ae7c-dc601c7beceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:39.892054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e19a9-5f02-4aa7-ae7c-dc601c7beceb admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:39.979780 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1423/2839] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:07:39 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:07:39.983933 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3103bf9-19da-4d60-80ad-d3e478efc9ea admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:39.994753 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3103bf9-19da-4d60-80ad-d3e478efc9ea admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:40.020665 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:40.053397 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ff1c1-9029-474a-8a40-150eaf91d11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:40.053928 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ff1c1-9029-474a-8a40-150eaf91d11d admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.054207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ff1c1-9029-474a-8a40-150eaf91d11d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.054478 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ff1c1-9029-474a-8a40-150eaf91d11d admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.055258 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ff1c1-9029-474a-8a40-150eaf91d11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:40.057203 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ff1c1-9029-474a-8a40-150eaf91d11d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:40.172856 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1417/2840] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:07:39 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:07:40.177392 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e19a9-5f02-4aa7-ae7c-dc601c7beceb admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:40.187746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e19a9-5f02-4aa7-ae7c-dc601c7beceb admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:40.193027 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afc1e1-b549-4391-b329-e23c36765050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:40.193645 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afc1e1-b549-4391-b329-e23c36765050 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.199915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afc1e1-b549-4391-b329-e23c36765050 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.199915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afc1e1-b549-4391-b329-e23c36765050 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.199915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afc1e1-b549-4391-b329-e23c36765050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:40.199915 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afc1e1-b549-4391-b329-e23c36765050 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:40.206558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1424/2841] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:40.210577 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ff1c1-9029-474a-8a40-150eaf91d11d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:40.220336 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ff1c1-9029-474a-8a40-150eaf91d11d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:40.224850 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7cbd1-66f8-41ba-b8f7-889c2402c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:40.225437 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7cbd1-66f8-41ba-b8f7-889c2402c65c admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.225714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7cbd1-66f8-41ba-b8f7-889c2402c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.225983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7cbd1-66f8-41ba-b8f7-889c2402c65c admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.226611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7cbd1-66f8-41ba-b8f7-889c2402c65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:40.228217 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7cbd1-66f8-41ba-b8f7-889c2402c65c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:40.238765 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1418/2842] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:40.242715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afc1e1-b549-4391-b329-e23c36765050 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:40.253156 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afc1e1-b549-4391-b329-e23c36765050 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:40.257724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea9522-931f-45e2-8fea-668b8e3aac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:40.258358 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea9522-931f-45e2-8fea-668b8e3aac3d admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.258636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea9522-931f-45e2-8fea-668b8e3aac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.258942 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea9522-931f-45e2-8fea-668b8e3aac3d admin admin] PATH_INFO: `/v3/projects/92bf82bce6e240b6be7adabd45928937/users/a4f508e42911443db41c368412010fac/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.273129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea9522-931f-45e2-8fea-668b8e3aac3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=92bf82bce6e240b6be7adabd45928937, user_id=a4f508e42911443db41c368412010fac, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:40.275791 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea9522-931f-45e2-8fea-668b8e3aac3d admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:40.344198 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1425/2843] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:07:40 2022] PUT /identity/v3/projects/92bf82bce6e240b6be7adabd45928937/users/a4f508e42911443db41c368412010fac/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:07:40.354528 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780f9a-7274-4182-82be-48308578ec46 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.354818 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780f9a-7274-4182-82be-48308578ec46 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.355125 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780f9a-7274-4182-82be-48308578ec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.383943 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-21780f9a-7274-4182-82be-48308578ec46 None None] MFA Rules not processed for user `a4f508e42911443db41c368412010fac`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:40.385154 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-21780f9a-7274-4182-82be-48308578ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:40.448025 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1419/2844] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:40.452905 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea9522-931f-45e2-8fea-668b8e3aac3d admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:40.513650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea9522-931f-45e2-8fea-668b8e3aac3d admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:40.518254 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e59829-22ec-4f77-b912-eb45dbe316ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:40.518842 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e59829-22ec-4f77-b912-eb45dbe316ff admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.519147 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e59829-22ec-4f77-b912-eb45dbe316ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.519434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e59829-22ec-4f77-b912-eb45dbe316ff admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.520025 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e59829-22ec-4f77-b912-eb45dbe316ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:40.521926 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e59829-22ec-4f77-b912-eb45dbe316ff admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:40.624349 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1426/2845] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:07:40 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:07:40.628496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21780f9a-7274-4182-82be-48308578ec46 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:40.639579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21780f9a-7274-4182-82be-48308578ec46 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:40.695190 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9253d4-586a-4eff-ab11-f5b08c4b6d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:40.695794 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9253d4-586a-4eff-ab11-f5b08c4b6d88 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.696077 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9253d4-586a-4eff-ab11-f5b08c4b6d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.696354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9253d4-586a-4eff-ab11-f5b08c4b6d88 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.696981 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9253d4-586a-4eff-ab11-f5b08c4b6d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:40.699153 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9253d4-586a-4eff-ab11-f5b08c4b6d88 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:40.778484 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1420/2846] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:07:40 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:07:40.782435 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e59829-22ec-4f77-b912-eb45dbe316ff admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:40.793109 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e59829-22ec-4f77-b912-eb45dbe316ff admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:40.797652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521061e-364c-4a15-99f2-26c215fa3208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:40.798242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521061e-364c-4a15-99f2-26c215fa3208 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.798517 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521061e-364c-4a15-99f2-26c215fa3208 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.798787 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521061e-364c-4a15-99f2-26c215fa3208 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.800259 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521061e-364c-4a15-99f2-26c215fa3208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:40.805721 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521061e-364c-4a15-99f2-26c215fa3208 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:40.813430 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1427/2847] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:40.817592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9253d4-586a-4eff-ab11-f5b08c4b6d88 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:40.828045 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9253d4-586a-4eff-ab11-f5b08c4b6d88 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:40.832707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0317c-0ece-42b5-822e-67a88e2c2357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:40.833350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0317c-0ece-42b5-822e-67a88e2c2357 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.833629 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0317c-0ece-42b5-822e-67a88e2c2357 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.833903 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0317c-0ece-42b5-822e-67a88e2c2357 admin admin] PATH_INFO: `/v3/projects/2f7cadfa4a5549e28f97e486ca220a55/users/5507d7a0b3a84b2a819827ba727c5857/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.849418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0317c-0ece-42b5-822e-67a88e2c2357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f7cadfa4a5549e28f97e486ca220a55, user_id=5507d7a0b3a84b2a819827ba727c5857, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:40.852114 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0317c-0ece-42b5-822e-67a88e2c2357 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:40.920875 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1421/2848] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:07:40 2022] PUT /identity/v3/projects/2f7cadfa4a5549e28f97e486ca220a55/users/5507d7a0b3a84b2a819827ba727c5857/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:40.924790 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521061e-364c-4a15-99f2-26c215fa3208 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:40.934671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521061e-364c-4a15-99f2-26c215fa3208 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:40.954143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:40.991301 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe7a52-a78f-4dce-ae2d-047f186fc3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:40.991955 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe7a52-a78f-4dce-ae2d-047f186fc3ef admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.992231 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe7a52-a78f-4dce-ae2d-047f186fc3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.992501 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe7a52-a78f-4dce-ae2d-047f186fc3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.993124 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe7a52-a78f-4dce-ae2d-047f186fc3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:40.994713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe7a52-a78f-4dce-ae2d-047f186fc3ef admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:41.004143 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1428/2849] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:41.008351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0317c-0ece-42b5-822e-67a88e2c2357 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:41.014089 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:41.019938 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0317c-0ece-42b5-822e-67a88e2c2357 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:41.024769 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dc916-a1a5-4513-a402-14a27ac7117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:41.025415 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dc916-a1a5-4513-a402-14a27ac7117c admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:41.025696 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dc916-a1a5-4513-a402-14a27ac7117c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:41.025969 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dc916-a1a5-4513-a402-14a27ac7117c admin admin] PATH_INFO: `/v3/projects/2f7cadfa4a5549e28f97e486ca220a55/users/5507d7a0b3a84b2a819827ba727c5857/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:41.027919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dc916-a1a5-4513-a402-14a27ac7117c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f7cadfa4a5549e28f97e486ca220a55, user_id=5507d7a0b3a84b2a819827ba727c5857, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:41.030583 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dc916-a1a5-4513-a402-14a27ac7117c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:41.041354 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1422/2850] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:07:41 2022] PUT /identity/v3/projects/2f7cadfa4a5549e28f97e486ca220a55/users/5507d7a0b3a84b2a819827ba727c5857/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:41.109649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeebde-8fe3-4144-858f-a54335545a9b None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:41.109649 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeebde-8fe3-4144-858f-a54335545a9b None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:41.109889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeebde-8fe3-4144-858f-a54335545a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:41.136868 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-fcaeebde-8fe3-4144-858f-a54335545a9b None None] MFA Rules not processed for user `5507d7a0b3a84b2a819827ba727c5857`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:41.138065 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fcaeebde-8fe3-4144-858f-a54335545a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:41.205948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1429/2851] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:41.216676 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dc916-a1a5-4513-a402-14a27ac7117c admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:41.218391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-3b5dc916-a1a5-4513-a402-14a27ac7117c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:41.275795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dc916-a1a5-4513-a402-14a27ac7117c admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:41.279751 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbba7dc-3c72-4e84-afab-e6f9a16be2a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:41.280350 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbba7dc-3c72-4e84-afab-e6f9a16be2a6 service cinder] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:41.280622 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbba7dc-3c72-4e84-afab-e6f9a16be2a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:41.280892 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbba7dc-3c72-4e84-afab-e6f9a16be2a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:41.338081 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbba7dc-3c72-4e84-afab-e6f9a16be2a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:41.339566 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbba7dc-3c72-4e84-afab-e6f9a16be2a6 service cinder] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:41.348421 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1423/2852] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:46.314292 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeebde-8fe3-4144-858f-a54335545a9b None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:46.315755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fcaeebde-8fe3-4144-858f-a54335545a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:46.327794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeebde-8fe3-4144-858f-a54335545a9b None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:46.331797 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fcec7-c990-4231-a5ad-7a7ff108d203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:46.332434 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fcec7-c990-4231-a5ad-7a7ff108d203 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:46.332715 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fcec7-c990-4231-a5ad-7a7ff108d203 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:46.332985 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fcec7-c990-4231-a5ad-7a7ff108d203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:46.341970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fcec7-c990-4231-a5ad-7a7ff108d203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:46.343426 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fcec7-c990-4231-a5ad-7a7ff108d203 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:46.353562 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1430/2853] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:51.344388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:51.979623 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbba7dc-3c72-4e84-afab-e6f9a16be2a6 service cinder] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:52.041616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbba7dc-3c72-4e84-afab-e6f9a16be2a6 service cinder] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:52.046202 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:52.049772 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:52.049772 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:52.049772 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] PATH_INFO: `/v3/users/a4f508e42911443db41c368412010fac` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:52.049772 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f508e42911443db41c368412010fac)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:52.050530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:52.236223 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f508e42911443db41c368412010fac'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:52.248552 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f508e42911443db41c368412010fac'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:52.255919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f508e42911443db41c368412010fac'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:52.261863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f508e42911443db41c368412010fac'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:52.261863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f508e42911443db41c368412010fac'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:52.342805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1424/2854] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:07:51 2022] DELETE /identity/v3/users/a4f508e42911443db41c368412010fac => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:52.347217 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c010c-b3a4-426e-a0c6-7e2b1f2e849d None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:52.347687 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c010c-b3a4-426e-a0c6-7e2b1f2e849d None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:52.347807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c010c-b3a4-426e-a0c6-7e2b1f2e849d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:52.366970 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-c49c010c-b3a4-426e-a0c6-7e2b1f2e849d None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:52.370095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c49c010c-b3a4-426e-a0c6-7e2b1f2e849d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:52.426285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1431/2855] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:52.436102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:52.437498 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:52.494887 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600a15a-d4f7-4ebd-88aa-1e2e8ec4c44d admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:52.498561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e1c8-fd01-4a3b-8cc2-f523a98c7cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:52.499209 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e1c8-fd01-4a3b-8cc2-f523a98c7cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:52.499496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e1c8-fd01-4a3b-8cc2-f523a98c7cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:52.499771 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e1c8-fd01-4a3b-8cc2-f523a98c7cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:52.508842 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0e1c8-fd01-4a3b-8cc2-f523a98c7cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:52.510264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0e1c8-fd01-4a3b-8cc2-f523a98c7cd6 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:52.519625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1425/2856] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:52.979685 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c010c-b3a4-426e-a0c6-7e2b1f2e849d None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:52.982929 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-c49c010c-b3a4-426e-a0c6-7e2b1f2e849d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:52.993457 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c010c-b3a4-426e-a0c6-7e2b1f2e849d None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:52.998089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:53.000035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:53.000035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:53.000035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] PATH_INFO: `/v3/projects/92bf82bce6e240b6be7adabd45928937` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:53.000440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=92bf82bce6e240b6be7adabd45928937)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:53.002339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:53.094396 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:53.109792 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92bf82bce6e240b6be7adabd45928937', 'request_id': 'req-e86b30a9-e5cb-4417-8536-c3cc551708aa'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:53.115404 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92bf82bce6e240b6be7adabd45928937', 'request_id': 'req-e86b30a9-e5cb-4417-8536-c3cc551708aa'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:53.121803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92bf82bce6e240b6be7adabd45928937', 'request_id': 'req-e86b30a9-e5cb-4417-8536-c3cc551708aa'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:53.245266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] The token cache is being invalidate because project 92bf82bce6e240b6be7adabd45928937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:07:53.245565 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:53.246300 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:53.247831 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1432/2857] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:07:52 2022] DELETE /identity/v3/projects/92bf82bce6e240b6be7adabd45928937 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:53.251878 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e1c8-fd01-4a3b-8cc2-f523a98c7cd6 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:53.262351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e1c8-fd01-4a3b-8cc2-f523a98c7cd6 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:53.281683 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:53.320844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86366c-0e3f-4543-9611-3b90bb1e134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:53.321497 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86366c-0e3f-4543-9611-3b90bb1e134e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:53.321799 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86366c-0e3f-4543-9611-3b90bb1e134e admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:53.322074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86366c-0e3f-4543-9611-3b90bb1e134e admin admin] PATH_INFO: `/v3/users/5507d7a0b3a84b2a819827ba727c5857` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:53.323231 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86366c-0e3f-4543-9611-3b90bb1e134e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5507d7a0b3a84b2a819827ba727c5857)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:53.325525 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86366c-0e3f-4543-9611-3b90bb1e134e admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:53.487452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1a86366c-0e3f-4543-9611-3b90bb1e134e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5507d7a0b3a84b2a819827ba727c5857'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:53.499758 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1a86366c-0e3f-4543-9611-3b90bb1e134e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5507d7a0b3a84b2a819827ba727c5857'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:53.506777 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1a86366c-0e3f-4543-9611-3b90bb1e134e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5507d7a0b3a84b2a819827ba727c5857'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:53.507482 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1a86366c-0e3f-4543-9611-3b90bb1e134e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5507d7a0b3a84b2a819827ba727c5857'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:53.508098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-1a86366c-0e3f-4543-9611-3b90bb1e134e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5507d7a0b3a84b2a819827ba727c5857'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:53.571305 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1426/2858] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:07:53 2022] DELETE /identity/v3/users/5507d7a0b3a84b2a819827ba727c5857 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:53.933199 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:53.934642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:53.948404 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b30a9-e5cb-4417-8536-c3cc551708aa admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:54.006975 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:54.007534 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.007814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.008089 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b admin admin] PATH_INFO: `/v3/projects/2f7cadfa4a5549e28f97e486ca220a55` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.009203 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f7cadfa4a5549e28f97e486ca220a55)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:54.011126 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:54.102999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f7cadfa4a5549e28f97e486ca220a55', 'request_id': 'req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:54.108533 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f7cadfa4a5549e28f97e486ca220a55', 'request_id': 'req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:54.114829 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f7cadfa4a5549e28f97e486ca220a55', 'request_id': 'req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:54.165639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b admin admin] The token cache is being invalidate because project 2f7cadfa4a5549e28f97e486ca220a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:07:54.165921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:54.166541 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-cd7e0e3f-b8c0-4189-a17e-5ece8f41e19b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:07:54.168052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1433/2859] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:07:53 2022] DELETE /identity/v3/projects/2f7cadfa4a5549e28f97e486ca220a55 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:54.174375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb950-a5d6-4b84-aafc-7628090dbf48 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.174663 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb950-a5d6-4b84-aafc-7628090dbf48 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.174973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb950-a5d6-4b84-aafc-7628090dbf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.194845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-9a1cb950-a5d6-4b84-aafc-7628090dbf48 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:54.196083 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9a1cb950-a5d6-4b84-aafc-7628090dbf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:54.255574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1427/2860] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:54.263944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95380413-00fc-4e98-bf7a-d0cf7409ac97 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.264272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95380413-00fc-4e98-bf7a-d0cf7409ac97 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.264548 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95380413-00fc-4e98-bf7a-d0cf7409ac97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.285087 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-95380413-00fc-4e98-bf7a-d0cf7409ac97 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:54.292490 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-95380413-00fc-4e98-bf7a-d0cf7409ac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:54.294574 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1434/2861] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:54.298866 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb950-a5d6-4b84-aafc-7628090dbf48 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:54.309588 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb950-a5d6-4b84-aafc-7628090dbf48 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:54.314325 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5531e-92c8-43ee-87a9-adf1ab260629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:54.314992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5531e-92c8-43ee-87a9-adf1ab260629 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.315270 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5531e-92c8-43ee-87a9-adf1ab260629 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.315564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5531e-92c8-43ee-87a9-adf1ab260629 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.316206 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5531e-92c8-43ee-87a9-adf1ab260629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:07:54.316505 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5531e-92c8-43ee-87a9-adf1ab260629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:54.318147 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5531e-92c8-43ee-87a9-adf1ab260629 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:54.330648 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1428/2862] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:07:54.335194 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95380413-00fc-4e98-bf7a-d0cf7409ac97 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:54.344585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95380413-00fc-4e98-bf7a-d0cf7409ac97 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:54.349814 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7b545-69f0-43b7-b697-dff1423acb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:54.350407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7b545-69f0-43b7-b697-dff1423acb94 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.350686 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7b545-69f0-43b7-b697-dff1423acb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.350996 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7b545-69f0-43b7-b697-dff1423acb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.355761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7b545-69f0-43b7-b697-dff1423acb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:54.355761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7b545-69f0-43b7-b697-dff1423acb94 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:54.426921 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1435/2863] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:07:54 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:07:54.428594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5531e-92c8-43ee-87a9-adf1ab260629 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:54.438778 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5531e-92c8-43ee-87a9-adf1ab260629 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:54.465173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:54.495241 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af955c63-412b-41ef-85d2-c6cd72be6cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:54.495929 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af955c63-412b-41ef-85d2-c6cd72be6cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.496189 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af955c63-412b-41ef-85d2-c6cd72be6cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.496475 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af955c63-412b-41ef-85d2-c6cd72be6cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.497454 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af955c63-412b-41ef-85d2-c6cd72be6cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:54.499858 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af955c63-412b-41ef-85d2-c6cd72be6cc7 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:54.583696 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1429/2864] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:07:54 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:07:54.587407 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7b545-69f0-43b7-b697-dff1423acb94 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:54.598319 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7b545-69f0-43b7-b697-dff1423acb94 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:54.603084 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45fc06-ca15-4bd3-8a7f-cef85e06792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:54.603688 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45fc06-ca15-4bd3-8a7f-cef85e06792b admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.603971 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45fc06-ca15-4bd3-8a7f-cef85e06792b admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.604304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45fc06-ca15-4bd3-8a7f-cef85e06792b admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.604944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45fc06-ca15-4bd3-8a7f-cef85e06792b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:54.606538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45fc06-ca15-4bd3-8a7f-cef85e06792b admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:54.616502 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1436/2865] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:54.620463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af955c63-412b-41ef-85d2-c6cd72be6cc7 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:54.630561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af955c63-412b-41ef-85d2-c6cd72be6cc7 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:54.635162 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b570bc0-53ef-47b5-9ec5-9686b4247d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:54.635754 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b570bc0-53ef-47b5-9ec5-9686b4247d22 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.636036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b570bc0-53ef-47b5-9ec5-9686b4247d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.636312 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b570bc0-53ef-47b5-9ec5-9686b4247d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.636949 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b570bc0-53ef-47b5-9ec5-9686b4247d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:54.638527 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b570bc0-53ef-47b5-9ec5-9686b4247d22 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:54.650860 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1430/2866] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:07:54.654489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45fc06-ca15-4bd3-8a7f-cef85e06792b admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:54.665127 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45fc06-ca15-4bd3-8a7f-cef85e06792b admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:54.669767 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6e528-95bf-4e7e-8c2c-bdda83e04990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:54.670409 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6e528-95bf-4e7e-8c2c-bdda83e04990 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.670713 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6e528-95bf-4e7e-8c2c-bdda83e04990 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.671003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6e528-95bf-4e7e-8c2c-bdda83e04990 admin admin] PATH_INFO: `/v3/projects/a370feaa32484476b19d50e9d123f4d1/users/709527ee3663407b8ebb9d0af51fd6be/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.673196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:54.685880 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6e528-95bf-4e7e-8c2c-bdda83e04990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a370feaa32484476b19d50e9d123f4d1, user_id=709527ee3663407b8ebb9d0af51fd6be, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:54.688585 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6e528-95bf-4e7e-8c2c-bdda83e04990 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:54.788979 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1437/2867] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:07:54 2022] PUT /identity/v3/projects/a370feaa32484476b19d50e9d123f4d1/users/709527ee3663407b8ebb9d0af51fd6be/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:07:54.794463 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2108e-76d2-4490-801d-f1d719aad552 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.795715 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2108e-76d2-4490-801d-f1d719aad552 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.795715 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2108e-76d2-4490-801d-f1d719aad552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.814351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d3c2108e-76d2-4490-801d-f1d719aad552 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:54.818673 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d3c2108e-76d2-4490-801d-f1d719aad552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:54.874380 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1431/2868] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:54.884432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6e528-95bf-4e7e-8c2c-bdda83e04990 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:54.886129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-3df6e528-95bf-4e7e-8c2c-bdda83e04990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:54.945005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6e528-95bf-4e7e-8c2c-bdda83e04990 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:54.949026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9544b1-44e9-4416-9c65-a3be04578d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:54.949626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9544b1-44e9-4416-9c65-a3be04578d0d service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.949906 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9544b1-44e9-4416-9c65-a3be04578d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.950181 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9544b1-44e9-4416-9c65-a3be04578d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.959864 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9544b1-44e9-4416-9c65-a3be04578d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:54.961277 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9544b1-44e9-4416-9c65-a3be04578d0d service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:54.970638 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1438/2869] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:56.115789 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5610204-a7c9-4b7d-88ba-cea79798941a None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:56.117408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5610204-a7c9-4b7d-88ba-cea79798941a None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:56.117408 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5610204-a7c9-4b7d-88ba-cea79798941a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:56.147525 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d5610204-a7c9-4b7d-88ba-cea79798941a None None] MFA Rules not processed for user `709527ee3663407b8ebb9d0af51fd6be`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:56.148452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d5610204-a7c9-4b7d-88ba-cea79798941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:56.212616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1432/2870] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:56.224900 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9544b1-44e9-4416-9c65-a3be04578d0d service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:56.226492 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6d9544b1-44e9-4416-9c65-a3be04578d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:56.282453 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9544b1-44e9-4416-9c65-a3be04578d0d service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:56.285974 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837c9dd-f792-4425-af4e-6ece67882a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:56.286564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837c9dd-f792-4425-af4e-6ece67882a4e service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:56.286840 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837c9dd-f792-4425-af4e-6ece67882a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:56.287135 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837c9dd-f792-4425-af4e-6ece67882a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:56.295180 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837c9dd-f792-4425-af4e-6ece67882a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:56.296596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837c9dd-f792-4425-af4e-6ece67882a4e service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:56.305211 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1439/2871] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:58.019579 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c521c9-d054-426a-a691-3d253b7c7b7f None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:58.020135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c521c9-d054-426a-a691-3d253b7c7b7f None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:58.020135 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c521c9-d054-426a-a691-3d253b7c7b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:58.039565 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-d8c521c9-d054-426a-a691-3d253b7c7b7f None None] MFA Rules not processed for user `709527ee3663407b8ebb9d0af51fd6be`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:58.040773 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d8c521c9-d054-426a-a691-3d253b7c7b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:58.047593 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1433/2872] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:07:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:58.290963 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837c9dd-f792-4425-af4e-6ece67882a4e service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:58.300314 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837c9dd-f792-4425-af4e-6ece67882a4e service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:58.304464 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e10e96-b9a1-4aac-89e9-198c4b33a430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:58.305054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e10e96-b9a1-4aac-89e9-198c4b33a430 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:58.305340 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e10e96-b9a1-4aac-89e9-198c4b33a430 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:58.305614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e10e96-b9a1-4aac-89e9-198c4b33a430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:58.307406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-18e10e96-b9a1-4aac-89e9-198c4b33a430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:58.317098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e10e96-b9a1-4aac-89e9-198c4b33a430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:58.319129 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e10e96-b9a1-4aac-89e9-198c4b33a430 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:58.327326 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1440/2873] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:59.759564 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c521c9-d054-426a-a691-3d253b7c7b7f None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:59.761185 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-d8c521c9-d054-426a-a691-3d253b7c7b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:59.796873 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:59.834686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c521c9-d054-426a-a691-3d253b7c7b7f None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:59.840252 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b912cb-9cea-4b0b-811d-ee93042488ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:59.841510 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b912cb-9cea-4b0b-811d-ee93042488ff service placement] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:59.842062 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b912cb-9cea-4b0b-811d-ee93042488ff service placement] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:59.842334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b912cb-9cea-4b0b-811d-ee93042488ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:59.844097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e5b912cb-9cea-4b0b-811d-ee93042488ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:59.855841 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b912cb-9cea-4b0b-811d-ee93042488ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:59.857401 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b912cb-9cea-4b0b-811d-ee93042488ff service placement] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:59.869730 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1434/2874] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:05.589935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e10e96-b9a1-4aac-89e9-198c4b33a430 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:05.598818 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e10e96-b9a1-4aac-89e9-198c4b33a430 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:05.603031 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742834d1-3d55-4dec-95df-ebdea54d1768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:05.603671 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742834d1-3d55-4dec-95df-ebdea54d1768 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:05.604026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742834d1-3d55-4dec-95df-ebdea54d1768 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:05.604304 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742834d1-3d55-4dec-95df-ebdea54d1768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:05.606068 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-742834d1-3d55-4dec-95df-ebdea54d1768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:05.615803 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742834d1-3d55-4dec-95df-ebdea54d1768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:05.617266 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742834d1-3d55-4dec-95df-ebdea54d1768 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:05.625556 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1441/2875] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:09.869173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=18 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:13.150018 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b912cb-9cea-4b0b-811d-ee93042488ff service placement] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:13.151658 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-e5b912cb-9cea-4b0b-811d-ee93042488ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:13.226326 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b912cb-9cea-4b0b-811d-ee93042488ff service placement] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:13.231992 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802d2bd-5ff8-4c34-9748-67e58c2468e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:13.232614 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802d2bd-5ff8-4c34-9748-67e58c2468e5 service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:13.232896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802d2bd-5ff8-4c34-9748-67e58c2468e5 service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:13.233169 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802d2bd-5ff8-4c34-9748-67e58c2468e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:13.234988 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a802d2bd-5ff8-4c34-9748-67e58c2468e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:13.248668 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802d2bd-5ff8-4c34-9748-67e58c2468e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:13.250743 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802d2bd-5ff8-4c34-9748-67e58c2468e5 service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:13.262660 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1435/2876] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:15.621798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=71,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:20.595069 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e72c3-5db0-4c99-9fb2-95f938469902 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:20.595620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e72c3-5db0-4c99-9fb2-95f938469902 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:20.595620 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e72c3-5db0-4c99-9fb2-95f938469902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:20.614893 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-130e72c3-5db0-4c99-9fb2-95f938469902 None None] MFA Rules not processed for user `709527ee3663407b8ebb9d0af51fd6be`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:20.616110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-130e72c3-5db0-4c99-9fb2-95f938469902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:20.622842 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1442/2877] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:08:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:20.850575 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802d2bd-5ff8-4c34-9748-67e58c2468e5 service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:20.862423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802d2bd-5ff8-4c34-9748-67e58c2468e5 service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:20.866036 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c6efc-6f5e-4fb2-ad55-17057866d280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:20.866627 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c6efc-6f5e-4fb2-ad55-17057866d280 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:20.866939 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c6efc-6f5e-4fb2-ad55-17057866d280 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:20.867218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c6efc-6f5e-4fb2-ad55-17057866d280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:20.869041 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b15c6efc-6f5e-4fb2-ad55-17057866d280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:20.878533 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c6efc-6f5e-4fb2-ad55-17057866d280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:20.879982 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c6efc-6f5e-4fb2-ad55-17057866d280 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:20.888488 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1436/2878] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:30.610239 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:30.884820 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=40 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:40.530768 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ca86-180f-4620-86bf-23f93aae2346 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:40.531268 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ca86-180f-4620-86bf-23f93aae2346 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:40.531452 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ca86-180f-4620-86bf-23f93aae2346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:40.581185 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-fb82ca86-180f-4620-86bf-23f93aae2346 None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:40.582406 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-fb82ca86-180f-4620-86bf-23f93aae2346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:40.646953 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1443/2879] 10.222.0.73 () {58 vars in 1009 bytes} [Tue Aug 30 00:08:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:40.758296 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c6efc-6f5e-4fb2-ad55-17057866d280 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:40.759807 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b15c6efc-6f5e-4fb2-ad55-17057866d280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:40.854234 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c6efc-6f5e-4fb2-ad55-17057866d280 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:40.859294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c9d61-0102-45d3-8b84-548615b53ee5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:40.859895 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c9d61-0102-45d3-8b84-548615b53ee5 service swift] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:40.860176 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c9d61-0102-45d3-8b84-548615b53ee5 service swift] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:40.860452 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c9d61-0102-45d3-8b84-548615b53ee5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:40.868394 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c9d61-0102-45d3-8b84-548615b53ee5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:40.869967 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c9d61-0102-45d3-8b84-548615b53ee5 service swift] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:40.877851 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1437/2880] 10.222.0.73 () {60 vars in 1384 bytes} [Tue Aug 30 00:08:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:08:50.644026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=40 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:50.874811 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=41 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:57.289516 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3568aa1-6abc-4da8-ada7-55dee1b11197 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:57.290026 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3568aa1-6abc-4da8-ada7-55dee1b11197 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:57.290128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3568aa1-6abc-4da8-ada7-55dee1b11197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:57.309581 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-f3568aa1-6abc-4da8-ada7-55dee1b11197 None None] MFA Rules not processed for user `ef922e08ae644f6a84034366f59d5591`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:57.310789 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f3568aa1-6abc-4da8-ada7-55dee1b11197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:57.318676 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1444/2881] 10.222.0.73 () {58 vars in 967 bytes} [Tue Aug 30 00:08:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:57.330790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c9d61-0102-45d3-8b84-548615b53ee5 service swift] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:57.341436 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c9d61-0102-45d3-8b84-548615b53ee5 service swift] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:57.346740 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d1e80-c39a-4a01-a2a6-2d640012939d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fb249079b4831be08cc4c9f94d6df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:57.347372 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d1e80-c39a-4a01-a2a6-2d640012939d service swift] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:57.347652 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d1e80-c39a-4a01-a2a6-2d640012939d service swift] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:57.347923 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d1e80-c39a-4a01-a2a6-2d640012939d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:57.355919 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d1e80-c39a-4a01-a2a6-2d640012939d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:57.357480 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d1e80-c39a-4a01-a2a6-2d640012939d service swift] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:57.365911 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1438/2882] 10.222.0.73 () {60 vars in 1384 bytes} [Tue Aug 30 00:08:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:09:00.166399 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3568aa1-6abc-4da8-ada7-55dee1b11197 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:00.177399 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3568aa1-6abc-4da8-ada7-55dee1b11197 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:00.182405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ea64-2314-4e34-b0e1-79bb1fbaab51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:00.183046 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ea64-2314-4e34-b0e1-79bb1fbaab51 service placement] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:00.183339 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ea64-2314-4e34-b0e1-79bb1fbaab51 service placement] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:00.183610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ea64-2314-4e34-b0e1-79bb1fbaab51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:00.185362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-4335ea64-2314-4e34-b0e1-79bb1fbaab51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:00.197485 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335ea64-2314-4e34-b0e1-79bb1fbaab51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:00.199122 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335ea64-2314-4e34-b0e1-79bb1fbaab51 service placement] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:00.209612 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1445/2883] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:00.273542 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d1e80-c39a-4a01-a2a6-2d640012939d service swift] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:00.284808 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d1e80-c39a-4a01-a2a6-2d640012939d service swift] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:00.289735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bc3fd-e6e3-4253-a3fb-2c7cc9abfcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:00.290368 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bc3fd-e6e3-4253-a3fb-2c7cc9abfcac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:00.290712 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bc3fd-e6e3-4253-a3fb-2c7cc9abfcac admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:00.290967 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bc3fd-e6e3-4253-a3fb-2c7cc9abfcac admin admin] PATH_INFO: `/v3/users/709527ee3663407b8ebb9d0af51fd6be` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:00.292104 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bc3fd-e6e3-4253-a3fb-2c7cc9abfcac admin admin] RBAC: Authorizing `identity:delete_user(user_id=709527ee3663407b8ebb9d0af51fd6be)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:00.294051 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bc3fd-e6e3-4253-a3fb-2c7cc9abfcac admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:00.428294 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0d6bc3fd-e6e3-4253-a3fb-2c7cc9abfcac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709527ee3663407b8ebb9d0af51fd6be'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:00.440630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0d6bc3fd-e6e3-4253-a3fb-2c7cc9abfcac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709527ee3663407b8ebb9d0af51fd6be'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:00.447580 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0d6bc3fd-e6e3-4253-a3fb-2c7cc9abfcac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709527ee3663407b8ebb9d0af51fd6be'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:00.448255 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0d6bc3fd-e6e3-4253-a3fb-2c7cc9abfcac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709527ee3663407b8ebb9d0af51fd6be'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:00.448867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-0d6bc3fd-e6e3-4253-a3fb-2c7cc9abfcac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709527ee3663407b8ebb9d0af51fd6be'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:00.500128 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1439/2884] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:09:00 2022] DELETE /identity/v3/users/709527ee3663407b8ebb9d0af51fd6be => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:09:00.977440 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ea64-2314-4e34-b0e1-79bb1fbaab51 service placement] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:00.989394 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ea64-2314-4e34-b0e1-79bb1fbaab51 service placement] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:01.051395 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b8606-9786-4ae4-8547-ee66c2a86d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:01.052746 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b8606-9786-4ae4-8547-ee66c2a86d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:01.053095 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b8606-9786-4ae4-8547-ee66c2a86d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:01.053385 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b8606-9786-4ae4-8547-ee66c2a86d3f admin admin] PATH_INFO: `/v3/projects/a370feaa32484476b19d50e9d123f4d1` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:01.054667 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b8606-9786-4ae4-8547-ee66c2a86d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a370feaa32484476b19d50e9d123f4d1)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:01.056778 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b8606-9786-4ae4-8547-ee66c2a86d3f admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:01.169807 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f17b8606-9786-4ae4-8547-ee66c2a86d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a370feaa32484476b19d50e9d123f4d1', 'request_id': 'req-f17b8606-9786-4ae4-8547-ee66c2a86d3f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:01.178200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f17b8606-9786-4ae4-8547-ee66c2a86d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a370feaa32484476b19d50e9d123f4d1', 'request_id': 'req-f17b8606-9786-4ae4-8547-ee66c2a86d3f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:01.184417 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f17b8606-9786-4ae4-8547-ee66c2a86d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a370feaa32484476b19d50e9d123f4d1', 'request_id': 'req-f17b8606-9786-4ae4-8547-ee66c2a86d3f'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:01.249544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f17b8606-9786-4ae4-8547-ee66c2a86d3f admin admin] The token cache is being invalidate because project a370feaa32484476b19d50e9d123f4d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:09:01.249830 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f17b8606-9786-4ae4-8547-ee66c2a86d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:01.250489 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-f17b8606-9786-4ae4-8547-ee66c2a86d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:01.251999 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1446/2885] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:09:00 2022] DELETE /identity/v3/projects/a370feaa32484476b19d50e9d123f4d1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:09:01.257530 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b4a9-4ae9-481a-9f2c-ddd44301dbcd None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:01.257764 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b4a9-4ae9-481a-9f2c-ddd44301dbcd None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:01.258040 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b4a9-4ae9-481a-9f2c-ddd44301dbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:01.277458 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-7d65b4a9-4ae9-481a-9f2c-ddd44301dbcd None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:01.278664 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7d65b4a9-4ae9-481a-9f2c-ddd44301dbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:01.337097 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1440/2886] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:01.345488 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae3fa-9127-4a8b-89d1-1375334dd364 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:01.345773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae3fa-9127-4a8b-89d1-1375334dd364 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:01.346049 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae3fa-9127-4a8b-89d1-1375334dd364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:01.366844 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-b16ae3fa-9127-4a8b-89d1-1375334dd364 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:01.368077 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b16ae3fa-9127-4a8b-89d1-1375334dd364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:01.375871 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1447/2887] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:01.380053 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65b4a9-4ae9-481a-9f2c-ddd44301dbcd None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:01.389752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65b4a9-4ae9-481a-9f2c-ddd44301dbcd None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:01.394218 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629764a7-1529-49c0-acb4-273262958771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:01.394805 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629764a7-1529-49c0-acb4-273262958771 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:01.395116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629764a7-1529-49c0-acb4-273262958771 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:01.395386 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629764a7-1529-49c0-acb4-273262958771 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:01.396021 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629764a7-1529-49c0-acb4-273262958771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:09:01.396319 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629764a7-1529-49c0-acb4-273262958771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:01.397890 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629764a7-1529-49c0-acb4-273262958771 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:01.409107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1441/2888] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:09:01.413610 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ae3fa-9127-4a8b-89d1-1375334dd364 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:01.422740 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ae3fa-9127-4a8b-89d1-1375334dd364 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:01.428177 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a176048-9a66-47b4-ad19-bd4ff0936d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:01.428761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a176048-9a66-47b4-ad19-bd4ff0936d55 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:01.429037 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a176048-9a66-47b4-ad19-bd4ff0936d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:01.429305 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a176048-9a66-47b4-ad19-bd4ff0936d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:01.429917 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a176048-9a66-47b4-ad19-bd4ff0936d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:01.431821 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a176048-9a66-47b4-ad19-bd4ff0936d55 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:01.531280 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1448/2889] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:09:01 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:09:01.536257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629764a7-1529-49c0-acb4-273262958771 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:01.546686 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629764a7-1529-49c0-acb4-273262958771 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:01.599833 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:01.615574 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41da1-0141-4794-8ab9-5efb3ef3dd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:01.618107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41da1-0141-4794-8ab9-5efb3ef3dd36 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:01.618107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41da1-0141-4794-8ab9-5efb3ef3dd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:01.618107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41da1-0141-4794-8ab9-5efb3ef3dd36 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:01.618107 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb41da1-0141-4794-8ab9-5efb3ef3dd36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:01.619264 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb41da1-0141-4794-8ab9-5efb3ef3dd36 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:01.724839 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1442/2890] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:09:01 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:09:01.729158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a176048-9a66-47b4-ad19-bd4ff0936d55 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:01.742308 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a176048-9a66-47b4-ad19-bd4ff0936d55 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:01.749873 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86e41a-b009-48d5-b843-794e8a61c54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:01.751035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86e41a-b009-48d5-b843-794e8a61c54e admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:01.751321 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86e41a-b009-48d5-b843-794e8a61c54e admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:01.751593 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86e41a-b009-48d5-b843-794e8a61c54e admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:01.752257 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86e41a-b009-48d5-b843-794e8a61c54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:01.754498 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86e41a-b009-48d5-b843-794e8a61c54e admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:01.765028 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1449/2891] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:09:01.769136 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41da1-0141-4794-8ab9-5efb3ef3dd36 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:01.779496 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41da1-0141-4794-8ab9-5efb3ef3dd36 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:01.784179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1387d9c-13a5-476d-a875-5716c8ee3f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:01.784711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1387d9c-13a5-476d-a875-5716c8ee3f00 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:01.784986 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1387d9c-13a5-476d-a875-5716c8ee3f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:01.785282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1387d9c-13a5-476d-a875-5716c8ee3f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:01.788766 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1387d9c-13a5-476d-a875-5716c8ee3f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:01.788766 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1387d9c-13a5-476d-a875-5716c8ee3f00 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:01.798586 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1443/2892] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:09:01.803669 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86e41a-b009-48d5-b843-794e8a61c54e admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:01.813962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86e41a-b009-48d5-b843-794e8a61c54e admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:01.819158 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0786a0-64f7-4697-8fe2-7729d126f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:01.819828 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0786a0-64f7-4697-8fe2-7729d126f186 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:01.820106 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0786a0-64f7-4697-8fe2-7729d126f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:01.820375 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0786a0-64f7-4697-8fe2-7729d126f186 admin admin] PATH_INFO: `/v3/projects/2a20caf6c7b545a6b24e98f8d1b33f56/users/3aa3038e9cd94e8e9f4623462425f148/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:01.839924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0786a0-64f7-4697-8fe2-7729d126f186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a20caf6c7b545a6b24e98f8d1b33f56, user_id=3aa3038e9cd94e8e9f4623462425f148, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:01.844272 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0786a0-64f7-4697-8fe2-7729d126f186 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:01.924734 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1450/2893] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:09:01 2022] PUT /identity/v3/projects/2a20caf6c7b545a6b24e98f8d1b33f56/users/3aa3038e9cd94e8e9f4623462425f148/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:09:01.935428 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef85814-1d7f-49b2-8881-c3a54cba66a3 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:01.935716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef85814-1d7f-49b2-8881-c3a54cba66a3 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:01.935991 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef85814-1d7f-49b2-8881-c3a54cba66a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:01.964348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-4ef85814-1d7f-49b2-8881-c3a54cba66a3 None None] MFA Rules not processed for user `3aa3038e9cd94e8e9f4623462425f148`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:01.965573 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4ef85814-1d7f-49b2-8881-c3a54cba66a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:02.039721 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1444/2894] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:02.051971 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0786a0-64f7-4697-8fe2-7729d126f186 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:02.053811 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-da0786a0-64f7-4697-8fe2-7729d126f186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:02.064836 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:02.119448 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0786a0-64f7-4697-8fe2-7729d126f186 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:02.123362 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9cb97-7f74-4e3f-ac69-ef9843e0e54d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:02.129060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9cb97-7f74-4e3f-ac69-ef9843e0e54d service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:02.129060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9cb97-7f74-4e3f-ac69-ef9843e0e54d service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:02.129060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9cb97-7f74-4e3f-ac69-ef9843e0e54d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:02.138057 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9cb97-7f74-4e3f-ac69-ef9843e0e54d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:02.140120 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9cb97-7f74-4e3f-ac69-ef9843e0e54d service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:02.152640 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1451/2895] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:12.034625 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:12.170410 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=23 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:34.347215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef85814-1d7f-49b2-8881-c3a54cba66a3 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:34.415257 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef85814-1d7f-49b2-8881-c3a54cba66a3 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:34.419940 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:34.420568 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:34.420888 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:34.421195 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] PATH_INFO: `/v3/users/3aa3038e9cd94e8e9f4623462425f148` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:34.422322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa3038e9cd94e8e9f4623462425f148)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:34.424269 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:34.631279 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa3038e9cd94e8e9f4623462425f148'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:34.643587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa3038e9cd94e8e9f4623462425f148'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:34.651304 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa3038e9cd94e8e9f4623462425f148'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:34.655193 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa3038e9cd94e8e9f4623462425f148'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:34.655193 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa3038e9cd94e8e9f4623462425f148'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:34.737389 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1445/2896] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:09:34 2022] DELETE /identity/v3/users/3aa3038e9cd94e8e9f4623462425f148 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:09:34.741933 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1a5e-98f4-4600-a2e9-5bd80da43d4f None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:34.743251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1a5e-98f4-4600-a2e9-5bd80da43d4f None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:34.743251 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1a5e-98f4-4600-a2e9-5bd80da43d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:34.761707 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-476c1a5e-98f4-4600-a2e9-5bd80da43d4f None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:34.762948 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-476c1a5e-98f4-4600-a2e9-5bd80da43d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:34.821631 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1452/2897] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:09:34.831306 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:34.832716 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:34.890322 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63e81f-dc82-40e2-8966-6dae68885bc7 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:34.893790 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195203a-061e-45aa-a040-20a8f493952d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:34.894388 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195203a-061e-45aa-a040-20a8f493952d service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:34.894669 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195203a-061e-45aa-a040-20a8f493952d service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:34.894977 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195203a-061e-45aa-a040-20a8f493952d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:34.903882 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195203a-061e-45aa-a040-20a8f493952d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:34.905303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195203a-061e-45aa-a040-20a8f493952d service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:34.915001 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1446/2898] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:35.293935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1a5e-98f4-4600-a2e9-5bd80da43d4f None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:35.295408 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-476c1a5e-98f4-4600-a2e9-5bd80da43d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:35.308218 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1a5e-98f4-4600-a2e9-5bd80da43d4f None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:35.312993 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:35.313719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:35.313956 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:35.314242 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6 admin admin] PATH_INFO: `/v3/projects/2a20caf6c7b545a6b24e98f8d1b33f56` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:35.315465 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a20caf6c7b545a6b24e98f8d1b33f56)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:35.317359 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:35.429555 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a20caf6c7b545a6b24e98f8d1b33f56', 'request_id': 'req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:35.435808 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a20caf6c7b545a6b24e98f8d1b33f56', 'request_id': 'req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:35.442113 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a20caf6c7b545a6b24e98f8d1b33f56', 'request_id': 'req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:35.518473 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6 admin admin] The token cache is being invalidate because project 2a20caf6c7b545a6b24e98f8d1b33f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:09:35.518761 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:35.519402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-9bba02c1-d35c-4880-b7b1-3ddbfd6b13a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:35.520927 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1453/2899] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:09:35 2022] DELETE /identity/v3/projects/2a20caf6c7b545a6b24e98f8d1b33f56 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:09:35.526065 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c64ce1-7191-494e-a595-e4f8cda664e1 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:35.526548 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c64ce1-7191-494e-a595-e4f8cda664e1 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:35.526667 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c64ce1-7191-494e-a595-e4f8cda664e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:35.546534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-29c64ce1-7191-494e-a595-e4f8cda664e1 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:35.547747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-29c64ce1-7191-494e-a595-e4f8cda664e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:35.565072 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:35.608708 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1447/2900] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:09:35.616843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac5eb9-8d6c-4208-bbff-cfd426997797 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:35.618183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac5eb9-8d6c-4208-bbff-cfd426997797 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:35.618183 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac5eb9-8d6c-4208-bbff-cfd426997797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:35.639364 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-2dac5eb9-8d6c-4208-bbff-cfd426997797 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:35.640602 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2dac5eb9-8d6c-4208-bbff-cfd426997797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:35.648623 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1454/2901] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:35.653348 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c64ce1-7191-494e-a595-e4f8cda664e1 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:35.663004 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c64ce1-7191-494e-a595-e4f8cda664e1 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:35.668684 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bfd0d-4366-460f-b157-afcfaf518f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:35.669284 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bfd0d-4366-460f-b157-afcfaf518f03 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:35.669565 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bfd0d-4366-460f-b157-afcfaf518f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:35.669835 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bfd0d-4366-460f-b157-afcfaf518f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:35.670473 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bfd0d-4366-460f-b157-afcfaf518f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:09:35.670773 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bfd0d-4366-460f-b157-afcfaf518f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:35.672395 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bfd0d-4366-460f-b157-afcfaf518f03 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:35.683775 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1448/2902] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:09:35.687905 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac5eb9-8d6c-4208-bbff-cfd426997797 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:35.697060 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac5eb9-8d6c-4208-bbff-cfd426997797 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:35.701679 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb89c2-13ba-49b9-97fa-d0b15526e887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:35.702269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb89c2-13ba-49b9-97fa-d0b15526e887 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:35.702547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb89c2-13ba-49b9-97fa-d0b15526e887 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:35.702816 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb89c2-13ba-49b9-97fa-d0b15526e887 admin admin] PATH_INFO: `/v3/projects` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:35.703469 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb89c2-13ba-49b9-97fa-d0b15526e887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:35.705342 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb89c2-13ba-49b9-97fa-d0b15526e887 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:35.812504 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1455/2903] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:09:35 2022] POST /identity/v3/projects => generated 399 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:09:35.816534 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bfd0d-4366-460f-b157-afcfaf518f03 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:35.828166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bfd0d-4366-460f-b157-afcfaf518f03 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:35.884578 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411036d0-a536-4cec-9a34-b68296d67a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:35.885179 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411036d0-a536-4cec-9a34-b68296d67a74 admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:35.885459 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411036d0-a536-4cec-9a34-b68296d67a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:35.885728 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411036d0-a536-4cec-9a34-b68296d67a74 admin admin] PATH_INFO: `/v3/users` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:35.886352 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411036d0-a536-4cec-9a34-b68296d67a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:35.888277 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411036d0-a536-4cec-9a34-b68296d67a74 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:35.958851 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1449/2904] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:09:35 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:09:35.963626 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb89c2-13ba-49b9-97fa-d0b15526e887 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:35.973934 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb89c2-13ba-49b9-97fa-d0b15526e887 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:35.979064 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d00f1f-9dbd-4444-973b-32f92e1a7636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:35.979661 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d00f1f-9dbd-4444-973b-32f92e1a7636 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:35.979938 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d00f1f-9dbd-4444-973b-32f92e1a7636 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:35.980211 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d00f1f-9dbd-4444-973b-32f92e1a7636 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:35.980883 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d00f1f-9dbd-4444-973b-32f92e1a7636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:35.982463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d00f1f-9dbd-4444-973b-32f92e1a7636 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:35.992599 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1456/2905] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:09:35.996648 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411036d0-a536-4cec-9a34-b68296d67a74 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:36.006682 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411036d0-a536-4cec-9a34-b68296d67a74 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:36.012015 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1e1ff-48c3-4aab-b0f0-3884da825921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:36.012611 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1e1ff-48c3-4aab-b0f0-3884da825921 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:36.012893 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1e1ff-48c3-4aab-b0f0-3884da825921 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:36.013166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1e1ff-48c3-4aab-b0f0-3884da825921 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:36.013802 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1e1ff-48c3-4aab-b0f0-3884da825921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:36.015430 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1e1ff-48c3-4aab-b0f0-3884da825921 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:36.026594 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1450/2906] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:09:36.030544 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d00f1f-9dbd-4444-973b-32f92e1a7636 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:36.040361 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d00f1f-9dbd-4444-973b-32f92e1a7636 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:36.044904 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82884d3-6176-42c2-afbf-04673a73c347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:36.045538 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82884d3-6176-42c2-afbf-04673a73c347 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:36.045813 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82884d3-6176-42c2-afbf-04673a73c347 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:36.046082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82884d3-6176-42c2-afbf-04673a73c347 admin admin] PATH_INFO: `/v3/projects/1e06f37402a2473897742e896ef4110e/users/2fcd08a753764b30a2ea6e6bbfd34c58/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:36.060220 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82884d3-6176-42c2-afbf-04673a73c347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e06f37402a2473897742e896ef4110e, user_id=2fcd08a753764b30a2ea6e6bbfd34c58, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:36.062824 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82884d3-6176-42c2-afbf-04673a73c347 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:36.155935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1457/2907] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:09:36 2022] PUT /identity/v3/projects/1e06f37402a2473897742e896ef4110e/users/2fcd08a753764b30a2ea6e6bbfd34c58/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:09:36.166362 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4838b9-36e3-4520-bc2e-1811f2cb86f3 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:36.166647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4838b9-36e3-4520-bc2e-1811f2cb86f3 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:36.166954 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4838b9-36e3-4520-bc2e-1811f2cb86f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:36.194139 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-bd4838b9-36e3-4520-bc2e-1811f2cb86f3 None None] MFA Rules not processed for user `2fcd08a753764b30a2ea6e6bbfd34c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:36.195400 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bd4838b9-36e3-4520-bc2e-1811f2cb86f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:36.259347 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1451/2908] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:36.270552 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82884d3-6176-42c2-afbf-04673a73c347 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:36.272246 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-a82884d3-6176-42c2-afbf-04673a73c347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:36.294322 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:36.328670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82884d3-6176-42c2-afbf-04673a73c347 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:36.332390 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698da76-4b05-40b1-b884-68a670455635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea872bd7ac2f4640a97648ccf96c02da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:36.334861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698da76-4b05-40b1-b884-68a670455635 service cinder] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:36.334861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698da76-4b05-40b1-b884-68a670455635 service cinder] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:36.334861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698da76-4b05-40b1-b884-68a670455635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:36.342576 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698da76-4b05-40b1-b884-68a670455635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:36.344035 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698da76-4b05-40b1-b884-68a670455635 service cinder] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:36.353833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1458/2909] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:40.526016 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4838b9-36e3-4520-bc2e-1811f2cb86f3 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:40.527455 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bd4838b9-36e3-4520-bc2e-1811f2cb86f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:40.550034 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:40.602522 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4838b9-36e3-4520-bc2e-1811f2cb86f3 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:40.608027 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a30fe-e95e-46e2-b68c-540ffa21e5a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:40.608626 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a30fe-e95e-46e2-b68c-540ffa21e5a6 service placement] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:40.608900 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a30fe-e95e-46e2-b68c-540ffa21e5a6 service placement] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:40.609167 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a30fe-e95e-46e2-b68c-540ffa21e5a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:40.610973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-cf8a30fe-e95e-46e2-b68c-540ffa21e5a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:40.623371 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a30fe-e95e-46e2-b68c-540ffa21e5a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:40.624922 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a30fe-e95e-46e2-b68c-540ffa21e5a6 service placement] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:40.634632 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1452/2910] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:42.058636 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698da76-4b05-40b1-b884-68a670455635 service cinder] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:42.122110 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698da76-4b05-40b1-b884-68a670455635 service cinder] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:42.126683 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:42.127479 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:42.127764 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:42.128038 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] PATH_INFO: `/v3/users/2fcd08a753764b30a2ea6e6bbfd34c58` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:42.129159 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fcd08a753764b30a2ea6e6bbfd34c58)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:42.131103 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:42.325166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fcd08a753764b30a2ea6e6bbfd34c58'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:42.390763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fcd08a753764b30a2ea6e6bbfd34c58'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:42.398652 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fcd08a753764b30a2ea6e6bbfd34c58'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:42.399435 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fcd08a753764b30a2ea6e6bbfd34c58'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:42.412347 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fcd08a753764b30a2ea6e6bbfd34c58'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:42.418416 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1459/2911] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:09:42 2022] DELETE /identity/v3/users/2fcd08a753764b30a2ea6e6bbfd34c58 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:09:42.423109 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075abb3-5c9e-408a-9209-e3fef700b5c6 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:42.423595 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075abb3-5c9e-408a-9209-e3fef700b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:42.423747 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075abb3-5c9e-408a-9209-e3fef700b5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:42.442630 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-4075abb3-5c9e-408a-9209-e3fef700b5c6 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:42.443848 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4075abb3-5c9e-408a-9209-e3fef700b5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:42.501141 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1453/2912] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:42.510798 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:42.512802 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:42.557005 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:42.568765 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7b591-fab0-4eb6-b8a3-2a9ec805f528 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:42.572423 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff63422-28d1-40f7-b14d-b0491a2b3604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:42.573032 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63422-28d1-40f7-b14d-b0491a2b3604 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:42.573312 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63422-28d1-40f7-b14d-b0491a2b3604 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:42.573588 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63422-28d1-40f7-b14d-b0491a2b3604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:42.583098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff63422-28d1-40f7-b14d-b0491a2b3604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:42.584462 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff63422-28d1-40f7-b14d-b0491a2b3604 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:42.593719 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1460/2913] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:43.004132 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075abb3-5c9e-408a-9209-e3fef700b5c6 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:43.005603 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-4075abb3-5c9e-408a-9209-e3fef700b5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:43.018385 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075abb3-5c9e-408a-9209-e3fef700b5c6 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:43.023247 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:43.023896 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.024173 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.024446 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c admin admin] PATH_INFO: `/v3/projects/1e06f37402a2473897742e896ef4110e` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.025752 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e06f37402a2473897742e896ef4110e)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:43.028423 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:43.130144 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e06f37402a2473897742e896ef4110e', 'request_id': 'req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:43.135681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e06f37402a2473897742e896ef4110e', 'request_id': 'req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:43.202931 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e06f37402a2473897742e896ef4110e', 'request_id': 'req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:43.214303 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c admin admin] The token cache is being invalidate because project 1e06f37402a2473897742e896ef4110e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:09:43.214592 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:43.215227 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-acd4c3e9-9e52-48de-a69f-82f9d39bc15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:09:43.216704 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1454/2914] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:09:43 2022] DELETE /identity/v3/projects/1e06f37402a2473897742e896ef4110e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:09:43.221804 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096b96c-04a4-414a-a30d-1c1cc7c15c07 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.222285 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096b96c-04a4-414a-a30d-1c1cc7c15c07 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.222490 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096b96c-04a4-414a-a30d-1c1cc7c15c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.242822 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-6096b96c-04a4-414a-a30d-1c1cc7c15c07 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:43.244166 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6096b96c-04a4-414a-a30d-1c1cc7c15c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:43.305554 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1461/2915] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:43.315236 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3a2d-dc3f-4244-85fc-91511a6c1470 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.315519 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3a2d-dc3f-4244-85fc-91511a6c1470 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.315791 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3a2d-dc3f-4244-85fc-91511a6c1470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.337547 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-ac0f3a2d-dc3f-4244-85fc-91511a6c1470 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:43.338786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-ac0f3a2d-dc3f-4244-85fc-91511a6c1470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:43.347207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1455/2916] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:43.351577 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096b96c-04a4-414a-a30d-1c1cc7c15c07 None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:43.361446 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096b96c-04a4-414a-a30d-1c1cc7c15c07 None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:43.366529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfdfb6-21c4-40b8-82a4-f2f8e74c6552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:43.367174 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfdfb6-21c4-40b8-82a4-f2f8e74c6552 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.367481 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfdfb6-21c4-40b8-82a4-f2f8e74c6552 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.367754 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfdfb6-21c4-40b8-82a4-f2f8e74c6552 admin admin] PATH_INFO: `/v3/domains` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.368405 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfdfb6-21c4-40b8-82a4-f2f8e74c6552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:09:43.368710 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfdfb6-21c4-40b8-82a4-f2f8e74c6552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:43.370303 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfdfb6-21c4-40b8-82a4-f2f8e74c6552 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:43.387287 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1462/2917] 10.222.0.73 () {58 vars in 1153 bytes} [Tue Aug 30 00:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:09:43.388282 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f3a2d-dc3f-4244-85fc-91511a6c1470 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:43.397561 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f3a2d-dc3f-4244-85fc-91511a6c1470 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:43.402334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321b2cb-ec6c-4417-92e4-34d5800c047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:43.402953 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321b2cb-ec6c-4417-92e4-34d5800c047a admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.403231 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321b2cb-ec6c-4417-92e4-34d5800c047a admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.403502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321b2cb-ec6c-4417-92e4-34d5800c047a admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.404146 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321b2cb-ec6c-4417-92e4-34d5800c047a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:43.406026 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321b2cb-ec6c-4417-92e4-34d5800c047a admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:43.490604 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1456/2918] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:09:43 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:09:43.494758 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfdfb6-21c4-40b8-82a4-f2f8e74c6552 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:43.505639 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfdfb6-21c4-40b8-82a4-f2f8e74c6552 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:43.564834 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d065d6-77d7-45a7-9be2-c443fe070fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:43.565445 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d065d6-77d7-45a7-9be2-c443fe070fed admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.565729 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d065d6-77d7-45a7-9be2-c443fe070fed admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.566006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d065d6-77d7-45a7-9be2-c443fe070fed admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.566627 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d065d6-77d7-45a7-9be2-c443fe070fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:43.568682 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d065d6-77d7-45a7-9be2-c443fe070fed admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:43.661350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1463/2919] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:09:43 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:09:43.665418 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321b2cb-ec6c-4417-92e4-34d5800c047a admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:43.671515 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:43.676968 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321b2cb-ec6c-4417-92e4-34d5800c047a admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:43.682351 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a5f8-cc8e-423c-bd4d-a697eb476cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:43.687008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a5f8-cc8e-423c-bd4d-a697eb476cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.687008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a5f8-cc8e-423c-bd4d-a697eb476cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.687008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a5f8-cc8e-423c-bd4d-a697eb476cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.687008 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856a5f8-cc8e-423c-bd4d-a697eb476cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:43.687602 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856a5f8-cc8e-423c-bd4d-a697eb476cd3 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:43.697833 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1457/2920] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:09:43.702052 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d065d6-77d7-45a7-9be2-c443fe070fed admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:43.712655 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d065d6-77d7-45a7-9be2-c443fe070fed admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:43.717402 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca564b2-7a65-4564-ab87-4d6b635c1f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:43.718006 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca564b2-7a65-4564-ab87-4d6b635c1f26 admin admin] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.718290 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca564b2-7a65-4564-ab87-4d6b635c1f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.718558 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca564b2-7a65-4564-ab87-4d6b635c1f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.719244 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca564b2-7a65-4564-ab87-4d6b635c1f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:43.720859 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca564b2-7a65-4564-ab87-4d6b635c1f26 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:43.732123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1464/2921] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:09:43.736639 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a5f8-cc8e-423c-bd4d-a697eb476cd3 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:43.748863 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a5f8-cc8e-423c-bd4d-a697eb476cd3 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:43.754067 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e75f8a-d3f5-40e2-9d23-3082341c3663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:43.754725 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e75f8a-d3f5-40e2-9d23-3082341c3663 admin admin] REQUEST_METHOD: `PUT` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.755054 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e75f8a-d3f5-40e2-9d23-3082341c3663 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.755334 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e75f8a-d3f5-40e2-9d23-3082341c3663 admin admin] PATH_INFO: `/v3/projects/ba9a6eea5dff4038b7903a278e60b40e/users/b4620f28170b4eeea2c6ec9d09844925/roles/aaefcf4fc05547caa577d6f4db32e1b5` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.769952 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e75f8a-d3f5-40e2-9d23-3082341c3663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9a6eea5dff4038b7903a278e60b40e, user_id=b4620f28170b4eeea2c6ec9d09844925, role_id=aaefcf4fc05547caa577d6f4db32e1b5)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:43.772647 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e75f8a-d3f5-40e2-9d23-3082341c3663 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:43.871087 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1458/2922] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:09:43 2022] PUT /identity/v3/projects/ba9a6eea5dff4038b7903a278e60b40e/users/b4620f28170b4eeea2c6ec9d09844925/roles/aaefcf4fc05547caa577d6f4db32e1b5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:09:43.876249 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde0001-a370-4184-94bd-f375eebb8304 None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.876539 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde0001-a370-4184-94bd-f375eebb8304 None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.876817 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde0001-a370-4184-94bd-f375eebb8304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.898139 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-ebde0001-a370-4184-94bd-f375eebb8304 None None] MFA Rules not processed for user `8c4ae54dfe2844c3bb1795a2873a02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:43.899414 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ebde0001-a370-4184-94bd-f375eebb8304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:43.947131 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:43.961704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1465/2923] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:43.971844 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e75f8a-d3f5-40e2-9d23-3082341c3663 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:43.973645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a1e75f8a-d3f5-40e2-9d23-3082341c3663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:44.032722 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e75f8a-d3f5-40e2-9d23-3082341c3663 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:44.036378 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06b2fb-4cee-47b3-8b90-0232ba98c7c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:44.036973 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06b2fb-4cee-47b3-8b90-0232ba98c7c9 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:44.037274 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06b2fb-4cee-47b3-8b90-0232ba98c7c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:44.037739 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06b2fb-4cee-47b3-8b90-0232ba98c7c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:44.047357 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06b2fb-4cee-47b3-8b90-0232ba98c7c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:44.048714 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06b2fb-4cee-47b3-8b90-0232ba98c7c9 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:44.057989 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1459/2924] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:49.132177 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2abb68-9362-451b-8356-644cbfd7fffa None None] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:49.132724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2abb68-9362-451b-8356-644cbfd7fffa None None] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:49.132724 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2abb68-9362-451b-8356-644cbfd7fffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:49.163437 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.auth.core [None req-6c2abb68-9362-451b-8356-644cbfd7fffa None None] MFA Rules not processed for user `b4620f28170b4eeea2c6ec9d09844925`. Rule list: `[]` (Enabled: `True`). {{(pid=93263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:49.164673 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-6c2abb68-9362-451b-8356-644cbfd7fffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:49.233463 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1466/2925] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:49.238556 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06b2fb-4cee-47b3-8b90-0232ba98c7c9 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:49.250490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06b2fb-4cee-47b3-8b90-0232ba98c7c9 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:49.255219 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d57156-02dc-495f-8609-64f97879857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:49.255821 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d57156-02dc-495f-8609-64f97879857a admin admin] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:49.256102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d57156-02dc-495f-8609-64f97879857a admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:49.256375 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d57156-02dc-495f-8609-64f97879857a admin admin] PATH_INFO: `/v3/projects` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:49.256999 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d57156-02dc-495f-8609-64f97879857a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:49.258911 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d57156-02dc-495f-8609-64f97879857a admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:49.349548 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1460/2926] 10.222.0.73 () {60 vars in 1153 bytes} [Tue Aug 30 00:09:49 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:09:49.354567 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2abb68-9362-451b-8356-644cbfd7fffa None None] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:49.367373 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2abb68-9362-451b-8356-644cbfd7fffa None None] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:49.426535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa1b43-927e-41cc-a843-7535e2f19826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:49.431962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa1b43-927e-41cc-a843-7535e2f19826 admin admin] REQUEST_METHOD: `POST` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:49.431962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa1b43-927e-41cc-a843-7535e2f19826 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:49.431962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa1b43-927e-41cc-a843-7535e2f19826 admin admin] PATH_INFO: `/v3/users` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:49.431962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa1b43-927e-41cc-a843-7535e2f19826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:49.431962 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa1b43-927e-41cc-a843-7535e2f19826 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:49.506763 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1467/2927] 10.222.0.73 () {60 vars in 1144 bytes} [Tue Aug 30 00:09:49 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:09:49.508275 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d57156-02dc-495f-8609-64f97879857a admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:49.519215 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d57156-02dc-495f-8609-64f97879857a admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:49.525074 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6de90-0d61-47a1-951d-de74155bca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:49.529645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6de90-0d61-47a1-951d-de74155bca47 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:49.529645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6de90-0d61-47a1-951d-de74155bca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:49.529645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6de90-0d61-47a1-951d-de74155bca47 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:49.529645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6de90-0d61-47a1-951d-de74155bca47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:49.529645 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6de90-0d61-47a1-951d-de74155bca47 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:49.540361 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1461/2928] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:09:49.545360 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa1b43-927e-41cc-a843-7535e2f19826 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:49.557455 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa1b43-927e-41cc-a843-7535e2f19826 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:49.561390 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c4fb-b684-41a9-aa36-ec8f1dffed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:49.562114 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c4fb-b684-41a9-aa36-ec8f1dffed74 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:49.562397 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c4fb-b684-41a9-aa36-ec8f1dffed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:49.562670 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c4fb-b684-41a9-aa36-ec8f1dffed74 admin admin] PATH_INFO: `/v3/projects/d2ce8af0a6d1449c8e17e17d2f7bc40a/users/aa832bcae92c470dbc339a9bf96587a0/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:49.579523 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c4fb-b684-41a9-aa36-ec8f1dffed74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ce8af0a6d1449c8e17e17d2f7bc40a, user_id=aa832bcae92c470dbc339a9bf96587a0, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:49.582288 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c4fb-b684-41a9-aa36-ec8f1dffed74 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:49.651431 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1468/2929] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:09:49 2022] PUT /identity/v3/projects/d2ce8af0a6d1449c8e17e17d2f7bc40a/users/aa832bcae92c470dbc339a9bf96587a0/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:09:49.655602 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6de90-0d61-47a1-951d-de74155bca47 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:49.665732 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6de90-0d61-47a1-951d-de74155bca47 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:49.723108 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415e729-ceea-4123-9820-92c083e63a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:49.723796 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415e729-ceea-4123-9820-92c083e63a84 admin admin] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:49.724075 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415e729-ceea-4123-9820-92c083e63a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:49.724349 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415e729-ceea-4123-9820-92c083e63a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:49.724998 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415e729-ceea-4123-9820-92c083e63a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:49.726599 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415e729-ceea-4123-9820-92c083e63a84 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:49.739795 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1462/2930] 10.222.0.73 () {58 vars in 1122 bytes} [Tue Aug 30 00:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:09:49.744531 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c4fb-b684-41a9-aa36-ec8f1dffed74 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:49.756202 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c4fb-b684-41a9-aa36-ec8f1dffed74 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:49.760793 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74a235-40e8-4a47-8321-48fe5f514a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:49.761445 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74a235-40e8-4a47-8321-48fe5f514a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:49.761725 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74a235-40e8-4a47-8321-48fe5f514a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:49.761998 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74a235-40e8-4a47-8321-48fe5f514a50 admin admin] PATH_INFO: `/v3/projects/d2ce8af0a6d1449c8e17e17d2f7bc40a/users/aa832bcae92c470dbc339a9bf96587a0/roles/2b3a10551a5542538c01e7d4d1b76af3` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:49.763959 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74a235-40e8-4a47-8321-48fe5f514a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ce8af0a6d1449c8e17e17d2f7bc40a, user_id=aa832bcae92c470dbc339a9bf96587a0, role_id=2b3a10551a5542538c01e7d4d1b76af3)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:49.766570 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74a235-40e8-4a47-8321-48fe5f514a50 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:49.776833 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1469/2931] 10.222.0.73 () {60 vars in 1483 bytes} [Tue Aug 30 00:09:49 2022] PUT /identity/v3/projects/d2ce8af0a6d1449c8e17e17d2f7bc40a/users/aa832bcae92c470dbc339a9bf96587a0/roles/2b3a10551a5542538c01e7d4d1b76af3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:09:55.000490 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a675e4-f76d-448a-b72a-8ceb3f719ebf None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:55.001080 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a675e4-f76d-448a-b72a-8ceb3f719ebf None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:55.001193 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a675e4-f76d-448a-b72a-8ceb3f719ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:55.033110 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-55a675e4-f76d-448a-b72a-8ceb3f719ebf None None] MFA Rules not processed for user `aa832bcae92c470dbc339a9bf96587a0`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:55.034590 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-55a675e4-f76d-448a-b72a-8ceb3f719ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:55.058358 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:55.114366 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1463/2932] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:55.137170 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74a235-40e8-4a47-8321-48fe5f514a50 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:55.149054 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-ab74a235-40e8-4a47-8321-48fe5f514a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:55.179925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:55.223911 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74a235-40e8-4a47-8321-48fe5f514a50 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:55.229650 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1027b-9019-40dc-aa33-4afb6c22d43e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:55.230271 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1027b-9019-40dc-aa33-4afb6c22d43e service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:55.230553 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1027b-9019-40dc-aa33-4afb6c22d43e service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:55.230827 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1027b-9019-40dc-aa33-4afb6c22d43e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:55.291938 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1027b-9019-40dc-aa33-4afb6c22d43e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:55.293529 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1027b-9019-40dc-aa33-4afb6c22d43e service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:55.302595 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1470/2933] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:57.845251 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937ba32-391a-4a6c-b829-6765dfc1a893 None None] REQUEST_METHOD: `POST` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:57.845711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937ba32-391a-4a6c-b829-6765dfc1a893 None None] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:57.845711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937ba32-391a-4a6c-b829-6765dfc1a893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:57.865582 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.auth.core [None req-a937ba32-391a-4a6c-b829-6765dfc1a893 None None] MFA Rules not processed for user `b4620f28170b4eeea2c6ec9d09844925`. Rule list: `[]` (Enabled: `True`). {{(pid=93262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:57.866909 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-a937ba32-391a-4a6c-b829-6765dfc1a893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:57.874715 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1464/2934] 10.222.0.73 () {58 vars in 958 bytes} [Tue Aug 30 00:09:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:10:05.337042 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=41 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:07.859474 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=22 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:17.485082 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1027b-9019-40dc-aa33-4afb6c22d43e service nova] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:10:17.496777 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1027b-9019-40dc-aa33-4afb6c22d43e service nova] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:10:17.502742 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dce108-c0ec-48c3-90f6-08870eb8b262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:10:17.503493 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dce108-c0ec-48c3-90f6-08870eb8b262 service nova] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:17.503773 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dce108-c0ec-48c3-90f6-08870eb8b262 service nova] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:17.504043 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dce108-c0ec-48c3-90f6-08870eb8b262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:17.505925 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-52dce108-c0ec-48c3-90f6-08870eb8b262 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:17.519265 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dce108-c0ec-48c3-90f6-08870eb8b262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:10:17.521560 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dce108-c0ec-48c3-90f6-08870eb8b262 service nova] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:10:17.533668 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1471/2935] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:10:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:10:26.777681 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937ba32-391a-4a6c-b829-6765dfc1a893 None None] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:10:26.832707 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937ba32-391a-4a6c-b829-6765dfc1a893 None None] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:10:26.836262 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b61771-5951-49c4-b8ce-c24bf19c1388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:10:26.836867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b61771-5951-49c4-b8ce-c24bf19c1388 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:26.837149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b61771-5951-49c4-b8ce-c24bf19c1388 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:26.837422 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b61771-5951-49c4-b8ce-c24bf19c1388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:26.846735 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b61771-5951-49c4-b8ce-c24bf19c1388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:10:26.848194 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b61771-5951-49c4-b8ce-c24bf19c1388 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:10:26.858116 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1465/2936] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:10:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:10:27.529271 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=6 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:36.853581 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=26 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:12:18.077236 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dce108-c0ec-48c3-90f6-08870eb8b262 service nova] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:12:18.086924 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dce108-c0ec-48c3-90f6-08870eb8b262 service nova] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:12:18.091003 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c1e88-d85e-4bf4-9a8e-0150f050189c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:12:18.092726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c1e88-d85e-4bf4-9a8e-0150f050189c service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:12:18.092726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c1e88-d85e-4bf4-9a8e-0150f050189c service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:12:18.092726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c1e88-d85e-4bf4-9a8e-0150f050189c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:12:18.094033 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f61c1e88-d85e-4bf4-9a8e-0150f050189c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:12:18.108200 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c1e88-d85e-4bf4-9a8e-0150f050189c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:12:18.109606 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c1e88-d85e-4bf4-9a8e-0150f050189c service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:12:18.120704 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1472/2937] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:12:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:12:19.305777 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b61771-5951-49c4-b8ce-c24bf19c1388 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:12:19.314502 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b61771-5951-49c4-b8ce-c24bf19c1388 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:12:19.318098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c17522-48fb-4d38-a108-6e62b3be5480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:12:19.318689 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c17522-48fb-4d38-a108-6e62b3be5480 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:12:19.318997 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c17522-48fb-4d38-a108-6e62b3be5480 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:12:19.319267 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c17522-48fb-4d38-a108-6e62b3be5480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:12:19.321011 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-b8c17522-48fb-4d38-a108-6e62b3be5480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:12:19.334852 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c17522-48fb-4d38-a108-6e62b3be5480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:12:19.336286 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c17522-48fb-4d38-a108-6e62b3be5480 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:12:19.347727 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1466/2938] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:12:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:12:28.115672 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=6 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:12:29.342205 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=6 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:12:31.673733 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c1e88-d85e-4bf4-9a8e-0150f050189c service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:12:31.675260 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f61c1e88-d85e-4bf4-9a8e-0150f050189c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:12:31.686098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c1e88-d85e-4bf4-9a8e-0150f050189c service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:12:31.690922 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7097b18-62ef-407f-992f-2c932c9e2e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:12:31.691560 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097b18-62ef-407f-992f-2c932c9e2e09 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:12:31.691845 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097b18-62ef-407f-992f-2c932c9e2e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:12:31.692119 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097b18-62ef-407f-992f-2c932c9e2e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:12:31.693918 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-f7097b18-62ef-407f-992f-2c932c9e2e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:12:31.704350 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7097b18-62ef-407f-992f-2c932c9e2e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:12:31.705770 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7097b18-62ef-407f-992f-2c932c9e2e09 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:12:31.714367 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1473/2939] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:12:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:12:31.797580 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c17522-48fb-4d38-a108-6e62b3be5480 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:12:31.806373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c17522-48fb-4d38-a108-6e62b3be5480 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:12:31.810102 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2122d-fe50-4372-8c37-d522bf4cb646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:12:31.810694 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2122d-fe50-4372-8c37-d522bf4cb646 service neutron] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:12:31.811014 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2122d-fe50-4372-8c37-d522bf4cb646 service neutron] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:12:31.811290 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2122d-fe50-4372-8c37-d522bf4cb646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:12:31.813587 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c4a2122d-fe50-4372-8c37-d522bf4cb646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:12:31.827638 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2122d-fe50-4372-8c37-d522bf4cb646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:12:31.831037 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2122d-fe50-4372-8c37-d522bf4cb646 service neutron] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:12:31.840391 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1467/2940] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:12:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:12:41.710564 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=6 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:12:41.835616 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=6 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:34.317939 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7097b18-62ef-407f-992f-2c932c9e2e09 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:13:34.327100 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7097b18-62ef-407f-992f-2c932c9e2e09 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:13:34.330642 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22136ae-3bca-412e-af63-95d4bdc231c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '707518bbe380425aa793f005548bc9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:13:34.331269 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22136ae-3bca-412e-af63-95d4bdc231c8 service neutron] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:34.331547 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22136ae-3bca-412e-af63-95d4bdc231c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:34.331843 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22136ae-3bca-412e-af63-95d4bdc231c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:34.333535 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b22136ae-3bca-412e-af63-95d4bdc231c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:34.343935 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22136ae-3bca-412e-af63-95d4bdc231c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:13:34.345324 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22136ae-3bca-412e-af63-95d4bdc231c8 service neutron] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:13:34.353225 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1474/2941] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:13:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:13:44.349666 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=6 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:48.291174 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2122d-fe50-4372-8c37-d522bf4cb646 service neutron] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:13:48.292698 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c4a2122d-fe50-4372-8c37-d522bf4cb646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:48.309456 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2122d-fe50-4372-8c37-d522bf4cb646 service neutron] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:13:48.315897 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7bd7c-87f1-477d-9186-13e72679a45c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a1b0b274294a288dbf07cd99f95407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:13:48.316974 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7bd7c-87f1-477d-9186-13e72679a45c service nova] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:48.317499 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7bd7c-87f1-477d-9186-13e72679a45c service nova] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:48.318207 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7bd7c-87f1-477d-9186-13e72679a45c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:48.320473 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-c3f7bd7c-87f1-477d-9186-13e72679a45c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:48.336825 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7bd7c-87f1-477d-9186-13e72679a45c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:13:48.338602 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7bd7c-87f1-477d-9186-13e72679a45c service nova] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:13:48.352098 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1468/2942] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:13:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:13:58.346028 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=6 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:14:00.954519 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22136ae-3bca-412e-af63-95d4bdc231c8 service neutron] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:14:00.955614 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-b22136ae-3bca-412e-af63-95d4bdc231c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:14:01.027182 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22136ae-3bca-412e-af63-95d4bdc231c8 service neutron] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:14:01.033237 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782374a-d6e6-4c23-bcc7-3f976feb48d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:14:01.033842 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782374a-d6e6-4c23-bcc7-3f976feb48d3 service placement] REQUEST_METHOD: `GET` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:14:01.034596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782374a-d6e6-4c23-bcc7-3f976feb48d3 service placement] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:14:01.034596 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782374a-d6e6-4c23-bcc7-3f976feb48d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:14:01.036368 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-9782374a-d6e6-4c23-bcc7-3f976feb48d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:14:01.048273 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782374a-d6e6-4c23-bcc7-3f976feb48d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:14:01.049823 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782374a-d6e6-4c23-bcc7-3f976feb48d3 service placement] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:14:01.059613 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1475/2943] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:14:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:14:01.080845 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7bd7c-87f1-477d-9186-13e72679a45c service nova] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:14:01.142078 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7bd7c-87f1-477d-9186-13e72679a45c service nova] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:14:01.146736 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:14:01.149407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:14:01.149407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:14:01.149407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] PATH_INFO: `/v3/users/b4620f28170b4eeea2c6ec9d09844925` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:14:01.149407 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4620f28170b4eeea2c6ec9d09844925)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:14:01.150979 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:14:01.300229 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4620f28170b4eeea2c6ec9d09844925'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:01.312441 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4620f28170b4eeea2c6ec9d09844925'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:01.319691 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4620f28170b4eeea2c6ec9d09844925'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:01.320413 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4620f28170b4eeea2c6ec9d09844925'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:01.321033 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4620f28170b4eeea2c6ec9d09844925'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:01.382051 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1469/2944] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:14:01 2022] DELETE /identity/v3/users/b4620f28170b4eeea2c6ec9d09844925 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:14:01.624150 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782374a-d6e6-4c23-bcc7-3f976feb48d3 service placement] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:14:01.636138 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782374a-d6e6-4c23-bcc7-3f976feb48d3 service placement] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:14:01.694944 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:14:01.695587 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:14:01.695876 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:14:01.696149 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] PATH_INFO: `/v3/projects/ba9a6eea5dff4038b7903a278e60b40e` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:14:01.697274 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9a6eea5dff4038b7903a278e60b40e)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:14:01.699196 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:14:01.806098 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9a6eea5dff4038b7903a278e60b40e', 'request_id': 'req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:01.812611 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9a6eea5dff4038b7903a278e60b40e', 'request_id': 'req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:01.818889 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9a6eea5dff4038b7903a278e60b40e', 'request_id': 'req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:01.902202 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] The token cache is being invalidate because project ba9a6eea5dff4038b7903a278e60b40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:14:01.902424 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:01.903128 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:01.904726 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1476/2945] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:14:01 2022] DELETE /identity/v3/projects/ba9a6eea5dff4038b7903a278e60b40e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:14:01.908768 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:14:01.910166 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:14:01.924044 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9647a-1fa4-4ef1-abe7-1f70790f1727 admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:14:01.978781 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:14:01.979431 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:14:01.979711 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:14:01.979983 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] PATH_INFO: `/v3/users/aa832bcae92c470dbc339a9bf96587a0` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:14:01.981127 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa832bcae92c470dbc339a9bf96587a0)` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:14:01.983553 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:14:02.004867 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:14:02.168345 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa832bcae92c470dbc339a9bf96587a0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:02.180718 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa832bcae92c470dbc339a9bf96587a0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:02.189376 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa832bcae92c470dbc339a9bf96587a0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:02.192288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa832bcae92c470dbc339a9bf96587a0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:02.192288 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.notifications [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa832bcae92c470dbc339a9bf96587a0'} {{(pid=93262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:02.274434 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1470/2946] 10.222.0.73 () {58 vars in 1224 bytes} [Tue Aug 30 00:14:01 2022] DELETE /identity/v3/users/aa832bcae92c470dbc339a9bf96587a0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:14:02.522202 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] Authenticating user token {{(pid=93263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:14:02.529123 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.fernet_utils [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:14:02.538205 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbde7b0-d0d5-422c-b9fc-61a8cbfd40d0 admin admin] Validating token access rules against request {{(pid=93263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:14:02.557739 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:14:02.598480 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f8230-5eea-4749-bb4f-40535b5c5b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c4ae54dfe2844c3bb1795a2873a02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '959954cde09c4c1cb490e7a7a1c17381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:14:02.599148 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f8230-5eea-4749-bb4f-40535b5c5b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:14:02.599432 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f8230-5eea-4749-bb4f-40535b5c5b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:14:02.599709 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f8230-5eea-4749-bb4f-40535b5c5b84 admin admin] PATH_INFO: `/v3/projects/d2ce8af0a6d1449c8e17e17d2f7bc40a` {{(pid=93263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:14:02.600861 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f8230-5eea-4749-bb4f-40535b5c5b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ce8af0a6d1449c8e17e17d2f7bc40a)` {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:14:02.602755 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f8230-5eea-4749-bb4f-40535b5c5b84 admin admin] RBAC: Authorization granted {{(pid=93263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:14:02.697741 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-da9f8230-5eea-4749-bb4f-40535b5c5b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ce8af0a6d1449c8e17e17d2f7bc40a', 'request_id': 'req-da9f8230-5eea-4749-bb4f-40535b5c5b84'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:02.703722 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-da9f8230-5eea-4749-bb4f-40535b5c5b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ce8af0a6d1449c8e17e17d2f7bc40a', 'request_id': 'req-da9f8230-5eea-4749-bb4f-40535b5c5b84'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:02.709794 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-da9f8230-5eea-4749-bb4f-40535b5c5b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ce8af0a6d1449c8e17e17d2f7bc40a', 'request_id': 'req-da9f8230-5eea-4749-bb4f-40535b5c5b84'} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:02.754507 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-da9f8230-5eea-4749-bb4f-40535b5c5b84 admin admin] The token cache is being invalidate because project d2ce8af0a6d1449c8e17e17d2f7bc40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:14:02.754870 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-da9f8230-5eea-4749-bb4f-40535b5c5b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:02.755511 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG keystone.notifications [None req-da9f8230-5eea-4749-bb4f-40535b5c5b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:14:02.756995 dv-cinder-854273-4-smb devstack@keystone.service[93263]: [pid: 93263|app: 0|req: 1477/2947] 10.222.0.73 () {58 vars in 1233 bytes} [Tue Aug 30 00:14:02 2022] DELETE /identity/v3/projects/d2ce8af0a6d1449c8e17e17d2f7bc40a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:14:12.270786 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:14:12.751412 dv-cinder-854273-4-smb devstack@keystone.service[93263]: DEBUG dbcounter [-] [93263] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:14:45.565373 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] Authenticating user token {{(pid=93262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:14:45.566773 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:14:45.712438 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf1c56-60cf-4786-a255-5daa22af90fb admin admin] Validating token access rules against request {{(pid=93262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:14:45.769601 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b62201-4812-4dad-a0ba-c514fb0910bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79452e14fa4984875dca43672ed25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da13e1cbae664d5a92198052526ee459', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:14:45.770208 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b62201-4812-4dad-a0ba-c514fb0910bf service placement] REQUEST_METHOD: `GET` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:14:45.770483 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b62201-4812-4dad-a0ba-c514fb0910bf service placement] SCRIPT_NAME: `/identity` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:14:45.771393 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b62201-4812-4dad-a0ba-c514fb0910bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:14:45.773159 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.fernet_utils [None req-f1b62201-4812-4dad-a0ba-c514fb0910bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:14:45.784149 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b62201-4812-4dad-a0ba-c514fb0910bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:14:45.785710 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b62201-4812-4dad-a0ba-c514fb0910bf service placement] RBAC: Authorization granted {{(pid=93262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:14:45.796289 dv-cinder-854273-4-smb devstack@keystone.service[93262]: [pid: 93262|app: 0|req: 1471/2948] 10.222.0.73 () {60 vars in 1365 bytes} [Tue Aug 30 00:14:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:14:55.792168 dv-cinder-854273-4-smb devstack@keystone.service[93262]: DEBUG dbcounter [-] [93262] Writing DB stats keystone:SELECT=89 {{(pid=93262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}